-- Logs begin at Tue 2022-08-09 01:14:11 UTC, end at Tue 2022-08-09 02:47:16 UTC. -- Aug 09 02:16:29.970799 dv-cinder-852461-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 09 02:16:29.978419 dv-cinder-852461-1-smb devstack@keystone.service[80273]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 09 02:16:29.980429 dv-cinder-852461-1-smb devstack@keystone.service[80273]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 02:16:29 2022] *** Aug 09 02:16:29.980429 dv-cinder-852461-1-smb devstack@keystone.service[80273]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 02:16:29.980429 dv-cinder-852461-1-smb devstack@keystone.service[80273]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 02:16:29.980429 dv-cinder-852461-1-smb devstack@keystone.service[80273]: nodename: dv-cinder-852461-1-smb Aug 09 02:16:29.980429 dv-cinder-852461-1-smb devstack@keystone.service[80273]: machine: x86_64 Aug 09 02:16:29.980748 dv-cinder-852461-1-smb devstack@keystone.service[80273]: clock source: unix Aug 09 02:16:29.980748 dv-cinder-852461-1-smb devstack@keystone.service[80273]: pcre jit disabled Aug 09 02:16:29.980748 dv-cinder-852461-1-smb devstack@keystone.service[80273]: detected number of CPU cores: 4 Aug 09 02:16:29.980748 dv-cinder-852461-1-smb devstack@keystone.service[80273]: current working directory: / Aug 09 02:16:29.980748 dv-cinder-852461-1-smb devstack@keystone.service[80273]: detected binary path: /usr/bin/uwsgi-core Aug 09 02:16:29.980748 dv-cinder-852461-1-smb devstack@keystone.service[80273]: your processes number limit is 47680 Aug 09 02:16:29.980748 dv-cinder-852461-1-smb devstack@keystone.service[80273]: your memory page size is 4096 bytes Aug 09 02:16:29.980748 dv-cinder-852461-1-smb devstack@keystone.service[80273]: detected max file descriptor number: 2048 Aug 09 02:16:29.980748 dv-cinder-852461-1-smb devstack@keystone.service[80273]: lock engine: pthread robust mutexes Aug 09 02:16:29.980748 dv-cinder-852461-1-smb devstack@keystone.service[80273]: thunder lock: enabled Aug 09 02:16:29.981452 dv-cinder-852461-1-smb devstack@keystone.service[80273]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 09 02:16:29.981452 dv-cinder-852461-1-smb devstack@keystone.service[80273]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 02:16:30.020944 dv-cinder-852461-1-smb devstack@keystone.service[80273]: Python main interpreter initialized at 0x55ae030669c0 Aug 09 02:16:30.020944 dv-cinder-852461-1-smb devstack@keystone.service[80273]: python threads support enabled Aug 09 02:16:30.020944 dv-cinder-852461-1-smb devstack@keystone.service[80273]: your server socket listen backlog is limited to 100 connections Aug 09 02:16:30.020944 dv-cinder-852461-1-smb devstack@keystone.service[80273]: your mercy for graceful operations on workers is 90 seconds Aug 09 02:16:30.021361 dv-cinder-852461-1-smb devstack@keystone.service[80273]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 02:16:30.021437 dv-cinder-852461-1-smb devstack@keystone.service[80273]: *** Operational MODE: preforking *** Aug 09 02:16:30.021691 dv-cinder-852461-1-smb devstack@keystone.service[80273]: *** uWSGI is running in multiple interpreter mode *** Aug 09 02:16:30.021691 dv-cinder-852461-1-smb devstack@keystone.service[80273]: spawned uWSGI master process (pid: 80273) Aug 09 02:16:30.021890 dv-cinder-852461-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 09 02:16:30.025045 dv-cinder-852461-1-smb devstack@keystone.service[80273]: spawned uWSGI worker 1 (pid: 80285, cores: 1) Aug 09 02:16:30.025045 dv-cinder-852461-1-smb devstack@keystone.service[80273]: spawned uWSGI worker 2 (pid: 80286, cores: 1) Aug 09 02:16:30.025045 dv-cinder-852461-1-smb devstack@keystone.service[80273]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 02:16:35.538822 dv-cinder-852461-1-smb devstack@keystone.service[80285]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 02:16:35.538822 dv-cinder-852461-1-smb devstack@keystone.service[80285]: from cryptography.utils import int_from_bytes Aug 09 02:16:35.539661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 02:16:35.539661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: from cryptography.utils import int_from_bytes Aug 09 02:16:35.540095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 02:16:35.540095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: from cryptography.utils import int_from_bytes Aug 09 02:16:35.540224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 02:16:35.540224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: from cryptography.utils import int_from_bytes Aug 09 02:16:35.588969 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 02:16:35.589131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 02:16:35.589218 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 02:16:35.589295 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 02:16:35.589354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] command line args: [] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 02:16:35.589409 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] command line args: [] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 02:16:35.589616 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 02:16:35.589720 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 02:16:35.589798 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ================================================================================ {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 02:16:35.589869 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ================================================================================ {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 02:16:35.590035 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] admin_token = **** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.590173 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] admin_token = **** {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.590282 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] config_dir = [] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.590470 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.590568 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] config_dir = [] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.590659 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] config_source = [] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.590732 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.590821 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] debug = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.590952 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] config_source = [] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.591023 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.591259 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] debug = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.591332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.591425 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.591581 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.591660 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.591785 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.591864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.592034 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.592125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.592411 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] list_limit = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.592516 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.592579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] log_config_append = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.592643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.592700 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] list_limit = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.592767 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] log_dir = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.592942 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] log_config_append = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.593068 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] log_file = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.593133 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.593214 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.593319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] log_dir = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.593426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.593531 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] log_file = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.593660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.593843 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.593966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.594078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.594178 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.594251 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.594439 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.594520 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.594687 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.594775 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.594906 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.594990 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.595087 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.595164 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.595355 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.595443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.595584 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.595667 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.595828 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.595903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.596074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.596203 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.596350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.596480 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.596774 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.596855 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.597006 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] publish_errors = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.597104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.597260 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.597407 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.597491 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.597651 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.597799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.597897 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.598128 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.598365 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] standard_threads = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.598445 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.598578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] publish_errors = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.598655 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.598822 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.598909 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.598987 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.599152 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.599228 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] use_journal = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.599313 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] use_json = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.599453 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.599533 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] use_stderr = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.599642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] use_syslog = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.599725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.599869 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.599947 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.600121 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.600223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] standard_threads = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.600358 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.600503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.600618 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.600809 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.600896 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.601044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.601123 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.601250 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] use_journal = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.601326 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.601458 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] use_json = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.601572 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.601656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] use_stderr = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.601806 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.601883 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] use_syslog = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.602094 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.602170 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 02:16:35.602344 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.602441 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.602643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.602742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.602958 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.603122 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.603253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.603422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.603548 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.604325 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.604423 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.604641 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.604727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.605007 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.605107 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.605343 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.605420 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.605651 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.605738 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.605974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.606225 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.606310 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.606595 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.606671 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.606839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.606982 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.607091 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.607332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.607407 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.607585 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.607675 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.607836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.607945 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.608075 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.608252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.608328 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.608563 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.608640 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.608815 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.608902 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.609078 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.609193 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.609340 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.609506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.609606 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.609795 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.609871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.610084 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.610161 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.610326 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.610402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.610562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.610714 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.610802 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.611015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.611091 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.611263 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.611339 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.611519 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.611603 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.611754 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.611837 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.611987 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.612064 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.612228 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.612311 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.612458 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.612540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.612691 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.612766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.612923 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.613094 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.613182 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.613253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.613412 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.613488 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.613642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.613728 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.613873 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.613947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.614101 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.614175 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.614333 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.614415 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.614565 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.614641 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.614804 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.614880 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.615034 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.615117 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.615273 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.615355 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.615508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.615583 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.615742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.615825 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.615976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.616050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.616211 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.616291 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.616427 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.616536 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.616677 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.616788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.616913 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.617048 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.617155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.617268 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.617393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.617498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.617629 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.617710 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.617868 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.617997 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.618086 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.618157 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.618320 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.618409 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.618560 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.618658 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.618789 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.618871 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.619019 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.619113 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.619302 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.619380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.619544 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.619635 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.619778 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.619899 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.620011 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.620087 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.620247 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.620329 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.620495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.620576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.620986 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.621088 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.621244 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.621324 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.621488 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.621569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.621725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.621812 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.621942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.622019 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.622176 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.622257 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.622410 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.622495 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.622641 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.622726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.622877 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.622955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.623122 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.623199 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.623360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.623438 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.623596 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.623731 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.623860 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.623989 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.624123 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.624249 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.624373 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.624499 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.624499 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.624746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.624952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.625143 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.625274 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.625402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.625527 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.625653 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.625788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.625925 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.626067 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.626196 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.626329 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.626462 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.626599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.626726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.626858 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.626983 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.627109 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.627233 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.627377 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.627498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.627630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.627758 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.627890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.628015 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.628142 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] auth.external = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.628275 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.628411 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.628536 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.628536 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.628779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.628904 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.629055 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.629055 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] auth.password = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.629293 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.629431 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] auth.token = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.629558 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.629713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.629848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.629979 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.630126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] auth.external = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.630255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.630380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.630505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.630636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.630761 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.630896 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.631022 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.631022 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.631254 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] auth.password = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.631377 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] credential.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.631500 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] auth.token = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.631632 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.631763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.631890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.632013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.632134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.632265 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.632398 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.632520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.632643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.632767 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.632891 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.633068 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.633203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.633326 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.633453 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.633588 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] credential.caching = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.633715 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.633837 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.633975 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.634101 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.634224 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.634347 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.634472 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.634597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.634731 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.634857 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.634981 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.635116 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.635243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.635376 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.635509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] federation.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.635635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.635759 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.635887 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.636015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.636140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.636279 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.636404 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.636533 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.636533 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.636777 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.636904 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.637061 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.637187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.637187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.637430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.637555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.637555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.637802 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.637936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.637936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.638181 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] federation.caching = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.638309 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.638309 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.638558 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.638683 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.638822 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.638950 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.638950 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.639192 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.639329 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.639329 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.639576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.639701 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.639701 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.639938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.640150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.640150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.640393 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.640532 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.640660 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.640793 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.640793 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.641057 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.641182 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.641310 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.641437 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.641579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.641713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.641841 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.641968 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.642094 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.caching = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.642221 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.642363 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.642490 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.642616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.642743 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.642870 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.642996 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.643131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.643259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.643383 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.643508 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.643639 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.643766 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.643901 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.644037 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.644164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.644290 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.644415 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.644540 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.644673 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.644799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.644924 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.645068 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.645198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.645328 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.645464 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.645600 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.645733 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.645873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.646002 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.646129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.646269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.646398 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.646398 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.646639 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.646767 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.646894 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.647030 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.647159 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.647287 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.647413 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.647551 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.647677 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.647813 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.647941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.648069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.648195 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.648320 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.648448 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.648584 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.648711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.648839 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.648964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.649135 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.649213 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.649297 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.649371 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.649442 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.649512 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.649581 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.649657 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.649737 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.649810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.649882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.649953 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.650022 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.650092 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.650170 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.650244 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.650314 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.650399 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.650473 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.651056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.651136 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.651209 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.651279 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.651349 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.651418 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.651495 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.651568 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.651643 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.651714 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.651784 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.651853 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.651930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.652001 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.652071 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.652140 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.652209 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.652279 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.652356 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.652429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.652498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.652576 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.652719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.652807 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.652945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.653046 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.653209 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.653288 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.653449 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.653527 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.653683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.653764 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.653926 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.654004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.654173 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.654250 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.654407 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.654487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.654652 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.654730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.654901 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.654979 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.655137 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.655217 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.655376 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.655454 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.655609 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.655687 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.655846 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.655925 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.656079 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.656156 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.656314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.656391 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.656545 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.656624 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.656788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.656872 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.657075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.657163 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.657283 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.657364 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.657520 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.657598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.657759 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] resource.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.657838 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.657995 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.658074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.658242 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.658320 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.658473 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.658550 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.658708 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.658786 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.658944 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.659022 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.659181 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.659311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.659449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.659587 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.659722 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.659849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.659976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.660101 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.660235 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] role.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.660362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.660487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] role.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.660612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.660740 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.660866 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.660998 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.661149 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.661284 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.661410 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.661534 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.661661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.661798 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.661924 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.662047 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.662172 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.662296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.662420 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.662420 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.662738 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.662865 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] resource.caching = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.662988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.662988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.663232 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.663364 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.663490 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.663490 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.663721 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.663847 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.663979 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.664105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.664228 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.664352 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.664476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.664606 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.664748 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.664875 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.665000 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.665144 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.665268 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.665392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] role.caching = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.665392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] role.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.665640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.665769 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.665899 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.666028 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.666750 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.666892 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.667021 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.667156 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.667282 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.667405 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.667530 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.667662 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.667792 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.667915 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.668040 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.668164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.668287 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.668419 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.668550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.668679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.668813 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.668938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.669103 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.669246 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.669326 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.669326 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.669454 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.669530 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.669602 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.669681 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] token.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.669753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.669823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.669892 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.669961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.670080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.670169 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.670244 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.670314 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.670314 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.670441 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.670519 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.670631 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.670714 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.670785 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.670893 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.671009 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.671144 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.671266 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.671382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.671515 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.671724 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.671804 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.671966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.672054 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.672199 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.672276 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.672453 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.672531 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.672682 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.672762 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.672925 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.673004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.673202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.673280 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.673443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.673523 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.connection = **** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.673679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.673767 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.673919 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] token.caching = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.673997 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.674159 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.674236 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.674397 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.674476 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.674634 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.674711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.674871 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.674948 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.675105 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.675185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.675343 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.675421 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.675585 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.675662 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.675818 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.675896 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.676061 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.676139 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.676295 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.676373 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.676534 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.676612 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.676766 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.676842 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.677008 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.677144 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.677261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.677341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.677499 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.677577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.677733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.677820 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.677892 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 02:16:35.678025 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.678289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.connection = **** {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.678537 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.678787 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.679027 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.679269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.679507 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.679745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.679982 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.680220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.680466 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.680703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.680949 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.681208 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.681459 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.681696 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.681975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.682209 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.682450 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.682687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 02:16:35.682858 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 02:16:35.706894 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.707119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.707341 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.708490 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.708724 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.708953 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.717562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.719359 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.746345 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.746568 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.747982 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.748216 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.799120 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.799248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.849776 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.849903 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.850036 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.850116 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.915279 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.915505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.915598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.915725 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.915811 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.915941 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.916026 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.916202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.916283 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.916424 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.916507 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.916642 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.939290 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.939504 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.939603 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.939709 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.939810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.939938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.940022 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.940157 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.940238 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.940373 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.940456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.940586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.940668 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.940800 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.952145 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.952381 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.965468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.965634 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.965721 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.965870 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.965969 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.966095 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.966178 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.966307 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.966389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.966521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.966604 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.966730 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80285) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.966812 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.966942 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80286) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 02:16:35.983777 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:35.983987 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 02:16:35.984085 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:35.984267 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 02:16:35.984361 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:35.984570 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 02:16:35.984663 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:35.984803 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 02:16:35.984919 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:35.985115 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:35.985223 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:35.985375 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:35.985457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:35.985631 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:35.985713 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:35.985890 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:35.997270 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:35.997545 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:35.997628 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:35.997812 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:35.997896 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:35.998089 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:35.998173 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:35.998426 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.004963 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.005441 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.008047 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.008334 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.008518 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.008626 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.008805 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.008910 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.009121 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.009208 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.009407 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.009489 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.009703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.009796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.010509 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.010591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.010789 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.010870 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.011064 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.011153 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.011337 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.011417 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.011619 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.011897 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.034945 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.035537 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.036436 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.036720 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.037062 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.037364 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.041333 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.041614 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.041896 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.042005 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.042293 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.042577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.048390 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.048680 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.049220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.049475 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.052694 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.052985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.053290 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.053524 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.053608 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.053820 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.053904 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.054092 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.054171 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.054363 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.054444 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.054629 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.054712 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.054909 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.055184 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.055457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.070242 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.070521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.071139 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.071422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.075088 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.075867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.078351 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.078647 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.079048 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.079348 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.083008 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.083740 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.086184 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.086937 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.089946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.090245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.090527 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.090688 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.090841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.090978 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.091082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.091265 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.091372 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.091558 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.091840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.092131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.107243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.107533 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.107800 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.108065 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.108146 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.108365 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.108637 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.108903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.114877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.115870 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.116437 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.116713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.117478 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.117760 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.120058 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.120340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.120880 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.121200 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.121380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.121464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.121668 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.121965 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.122259 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.122542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.132797 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.133114 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.133402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.133681 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.133958 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.135892 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.135995 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.136088 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.136174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.136174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.136174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.136174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.136440 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.136716 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.151647 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.153392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.154631 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.156358 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.157571 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.159130 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.159340 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.160614 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.160905 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.161001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.161217 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.162436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.162732 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.163028 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.167616 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.169240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.169511 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.171133 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.172147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.172440 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.172731 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.173010 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.174100 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.174397 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.174693 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.174976 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.181326 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.181628 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.182522 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.183597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.183892 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.184176 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.189383 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80285) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.189667 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.189947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.190222 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.190494 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.190775 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.191047 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.191263 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80286) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 02:16:36.191346 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.191557 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.191676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.191841 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.191957 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.192121 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.192241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.192396 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.192505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.192687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.192821 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.192959 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.193061 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80285) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.193332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.193715 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.194000 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.194286 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.194554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.194833 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.195096 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80286) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 02:16:36.226827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ae030669c0 pid: 80285 (default app) Aug 09 02:16:36.228741 dv-cinder-852461-1-smb devstack@keystone.service[80286]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ae030669c0 pid: 80286 (default app) Aug 09 02:16:36.230122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f217fe3-0373-473f-aa80-67a9a67e65cb None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:36.230409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f217fe3-0373-473f-aa80-67a9a67e65cb None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:36.230682 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f217fe3-0373-473f-aa80-67a9a67e65cb None None] PATH_INFO: `/v3` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:36.235024 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Tue Aug 9 02:16:36 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:16:43.775670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc70fde-ecee-45d8-955e-e3ce4405ecbe None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:43.776244 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc70fde-ecee-45d8-955e-e3ce4405ecbe None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:43.776244 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc70fde-ecee-45d8-955e-e3ce4405ecbe None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:43.780689 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:16:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:16:43.785892 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585a618-f998-4fd9-8be0-8a1d72ba1670 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:43.786325 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585a618-f998-4fd9-8be0-8a1d72ba1670 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:43.786441 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585a618-f998-4fd9-8be0-8a1d72ba1670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:43.856933 dv-cinder-852461-1-smb devstack@keystone.service[80285]: INFO dbcounter [None req-7585a618-f998-4fd9-8be0-8a1d72ba1670 None None] Registered counter for database keystone Aug 09 02:16:43.876507 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG oslo_db.sqlalchemy.engines [None req-7585a618-f998-4fd9-8be0-8a1d72ba1670 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80285) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 02:16:43.882601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writer thread running {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 02:16:44.063664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG passlib.handlers.bcrypt [None req-7585a618-f998-4fd9-8be0-8a1d72ba1670 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80285) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 09 02:16:44.064026 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG passlib.handlers.bcrypt [None req-7585a618-f998-4fd9-8be0-8a1d72ba1670 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80285) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 09 02:16:44.117609 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7585a618-f998-4fd9-8be0-8a1d72ba1670 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:16:44.119821 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7585a618-f998-4fd9-8be0-8a1d72ba1670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:16:44.251682 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:16:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 09 02:16:44.408396 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc70fde-ecee-45d8-955e-e3ce4405ecbe None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:44.477504 dv-cinder-852461-1-smb devstack@keystone.service[80286]: INFO dbcounter [None req-7cc70fde-ecee-45d8-955e-e3ce4405ecbe None None] Registered counter for database keystone Aug 09 02:16:44.499104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG oslo_db.sqlalchemy.engines [None req-7cc70fde-ecee-45d8-955e-e3ce4405ecbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80286) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 02:16:44.505285 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writer thread running {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 02:16:44.623963 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc70fde-ecee-45d8-955e-e3ce4405ecbe None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:44.628238 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e48b66-7b19-4bc8-b11f-99042b4fc4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:44.628863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e48b66-7b19-4bc8-b11f-99042b4fc4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:44.629171 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e48b66-7b19-4bc8-b11f-99042b4fc4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:44.629446 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e48b66-7b19-4bc8-b11f-99042b4fc4e5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:44.637403 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e48b66-7b19-4bc8-b11f-99042b4fc4e5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:44.689279 dv-cinder-852461-1-smb devstack@keystone.service[80286]: WARNING keystone.common.rbac_enforcer.enforcer [None req-50e48b66-7b19-4bc8-b11f-99042b4fc4e5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 09 02:16:44.689577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e48b66-7b19-4bc8-b11f-99042b4fc4e5 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:44.698944 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Tue Aug 9 02:16:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 09 02:16:44.704836 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585a618-f998-4fd9-8be0-8a1d72ba1670 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:44.719585 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585a618-f998-4fd9-8be0-8a1d72ba1670 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:44.723953 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303113e-0bb6-44e4-93f9-73c623d7590b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:44.725085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303113e-0bb6-44e4-93f9-73c623d7590b admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:44.725367 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303113e-0bb6-44e4-93f9-73c623d7590b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:44.725639 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303113e-0bb6-44e4-93f9-73c623d7590b admin admin] PATH_INFO: `/v3/projects/5637b6dc3c504974958d887ed2c87b3c` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:44.727063 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303113e-0bb6-44e4-93f9-73c623d7590b admin admin] RBAC: Authorizing `identity:get_project(project_id=5637b6dc3c504974958d887ed2c87b3c)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:44.778515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b303113e-0bb6-44e4-93f9-73c623d7590b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 09 02:16:44.778862 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303113e-0bb6-44e4-93f9-73c623d7590b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:44.783485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Tue Aug 9 02:16:44 2022] GET /identity/v3/projects/5637b6dc3c504974958d887ed2c87b3c => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:16:46.762264 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61d9be-e3cf-447d-8369-c86f5e579b5c None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:46.762803 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61d9be-e3cf-447d-8369-c86f5e579b5c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:46.762803 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61d9be-e3cf-447d-8369-c86f5e579b5c None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:46.766921 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:16:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:16:46.772306 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5e16e-8dfc-47e0-9e60-59bc7a8431a3 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:46.772704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5e16e-8dfc-47e0-9e60-59bc7a8431a3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:46.772859 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5e16e-8dfc-47e0-9e60-59bc7a8431a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:46.795643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-4dc5e16e-8dfc-47e0-9e60-59bc7a8431a3 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:16:46.797200 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4dc5e16e-8dfc-47e0-9e60-59bc7a8431a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:16:46.804831 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:16:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 09 02:16:46.826026 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61d9be-e3cf-447d-8369-c86f5e579b5c None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:46.838517 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61d9be-e3cf-447d-8369-c86f5e579b5c None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:46.842728 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca73600-fffe-4fdf-9da9-4e8a6a934b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:46.843322 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca73600-fffe-4fdf-9da9-4e8a6a934b8a admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:46.843631 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca73600-fffe-4fdf-9da9-4e8a6a934b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:46.843907 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca73600-fffe-4fdf-9da9-4e8a6a934b8a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:46.851516 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca73600-fffe-4fdf-9da9-4e8a6a934b8a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:46.853988 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca73600-fffe-4fdf-9da9-4e8a6a934b8a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:46.862628 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Tue Aug 9 02:16:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 02:16:46.867546 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5e16e-8dfc-47e0-9e60-59bc7a8431a3 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:46.876770 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5e16e-8dfc-47e0-9e60-59bc7a8431a3 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:46.881139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dd8cb-cca9-4e74-84ec-a193edc46083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:46.881788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dd8cb-cca9-4e74-84ec-a193edc46083 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:46.882099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dd8cb-cca9-4e74-84ec-a193edc46083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:46.882374 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dd8cb-cca9-4e74-84ec-a193edc46083 admin admin] PATH_INFO: `/v3/users/49d550c3e3b54e2aaebfc450900dd727` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:46.883688 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00dd8cb-cca9-4e74-84ec-a193edc46083 admin admin] RBAC: Authorizing `identity:get_user(user_id=49d550c3e3b54e2aaebfc450900dd727)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:46.885551 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00dd8cb-cca9-4e74-84ec-a193edc46083 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:46.887050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Tue Aug 9 02:16:46 2022] GET /identity/v3/users/49d550c3e3b54e2aaebfc450900dd727 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:16:48.916963 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28d82f-acb6-40c4-955e-01e9b568e513 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:48.917528 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28d82f-acb6-40c4-955e-01e9b568e513 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:48.917528 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28d82f-acb6-40c4-955e-01e9b568e513 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:48.919054 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:16:48.923826 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a78cf-39e4-4fe7-8da4-5eb643e8abe3 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:48.924213 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a78cf-39e4-4fe7-8da4-5eb643e8abe3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:48.924499 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a78cf-39e4-4fe7-8da4-5eb643e8abe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:48.936619 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a541a1-57fa-402b-9e02-aaf310a5b202 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:48.936900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a541a1-57fa-402b-9e02-aaf310a5b202 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:48.937204 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a541a1-57fa-402b-9e02-aaf310a5b202 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:48.939693 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:16:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:16:48.944978 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098725dd-82c3-4d26-8d30-5d02524b2ea1 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:48.945297 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098725dd-82c3-4d26-8d30-5d02524b2ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:48.945584 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098725dd-82c3-4d26-8d30-5d02524b2ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:48.948334 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-006a78cf-39e4-4fe7-8da4-5eb643e8abe3 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:16:48.950335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-006a78cf-39e4-4fe7-8da4-5eb643e8abe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:16:48.989490 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG passlib.handlers.bcrypt [None req-098725dd-82c3-4d26-8d30-5d02524b2ea1 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80286) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 09 02:16:48.989936 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG passlib.handlers.bcrypt [None req-098725dd-82c3-4d26-8d30-5d02524b2ea1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80286) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 09 02:16:49.032802 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:16:49.035450 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-098725dd-82c3-4d26-8d30-5d02524b2ea1 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:16:49.037053 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-098725dd-82c3-4d26-8d30-5d02524b2ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:16:49.055599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a78cf-39e4-4fe7-8da4-5eb643e8abe3 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:49.079509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:16:49.135079 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 02:16:49.156766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098725dd-82c3-4d26-8d30-5d02524b2ea1 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:49.159878 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a78cf-39e4-4fe7-8da4-5eb643e8abe3 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:49.193463 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecffe6e-88af-47f8-b66e-7b09fcf4b891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:49.194035 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecffe6e-88af-47f8-b66e-7b09fcf4b891 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:49.194316 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecffe6e-88af-47f8-b66e-7b09fcf4b891 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:49.194588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecffe6e-88af-47f8-b66e-7b09fcf4b891 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:49.206005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecffe6e-88af-47f8-b66e-7b09fcf4b891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:16:49.215253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-8ecffe6e-88af-47f8-b66e-7b09fcf4b891 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:16:49.215253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:16:49.215253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:16:49.215253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:16:49.215253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:16:49.215253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:16:49.215253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:16:49.215253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:16:49.215253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:16:49.215253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:16:49.215253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:16:49.215253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:16:49.215253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:16:49.215253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:16:49.215253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:16:49.215253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:16:49.216286 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:16:49.216286 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:16:49.216286 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:16:49.216286 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:16:49.216286 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:16:49.216286 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:16:49.216286 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:16:49.216286 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:16:49.216286 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:16:49.216286 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:16:49.216286 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:16:49.216286 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:16:49.216286 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:16:49.216286 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:16:49.216286 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:16:49.216286 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:16:49.217135 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:16:49.217135 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:16:49.217135 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:16:49.217135 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:16:49.217135 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:16:49.217135 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:16:49.217135 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:16:49.217135 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:16:49.217135 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:16:49.217135 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:16:49.217135 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:16:49.217135 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:16:49.217135 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:16:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:16:49.222246 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecffe6e-88af-47f8-b66e-7b09fcf4b891 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:49.255257 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098725dd-82c3-4d26-8d30-5d02524b2ea1 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:49.257593 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:16:49.293705 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ba657-34dd-4133-85e3-1c1658928a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:49.294557 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ba657-34dd-4133-85e3-1c1658928a44 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:49.294840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ba657-34dd-4133-85e3-1c1658928a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:49.295123 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ba657-34dd-4133-85e3-1c1658928a44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:49.311199 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:16:49.329822 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecffe6e-88af-47f8-b66e-7b09fcf4b891 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:49.362496 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ba657-34dd-4133-85e3-1c1658928a44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:49.364031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ba657-34dd-4133-85e3-1c1658928a44 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:49.364933 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa36dc4-5301-45fc-8cc4-bd5cebfd9eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:49.365561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa36dc4-5301-45fc-8cc4-bd5cebfd9eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:49.365840 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa36dc4-5301-45fc-8cc4-bd5cebfd9eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:49.366105 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa36dc4-5301-45fc-8cc4-bd5cebfd9eb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:49.366755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa36dc4-5301-45fc-8cc4-bd5cebfd9eb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:16:49.367054 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa36dc4-5301-45fc-8cc4-bd5cebfd9eb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:49.368441 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa36dc4-5301-45fc-8cc4-bd5cebfd9eb5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:49.379787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:16:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:16:49.385823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa36dc4-5301-45fc-8cc4-bd5cebfd9eb5 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:49.468948 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:16:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 02:16:49.474773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ba657-34dd-4133-85e3-1c1658928a44 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:49.478097 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:16:49.574392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ba657-34dd-4133-85e3-1c1658928a44 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:49.590421 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa36dc4-5301-45fc-8cc4-bd5cebfd9eb5 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:49.607359 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07b61e-1c38-4009-8366-f388e5600cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:49.608207 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07b61e-1c38-4009-8366-f388e5600cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:49.608486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07b61e-1c38-4009-8366-f388e5600cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:49.608758 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07b61e-1c38-4009-8366-f388e5600cc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:49.623756 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151ddda-9e1e-4cc5-9b04-8652d57841c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:49.624380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151ddda-9e1e-4cc5-9b04-8652d57841c2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:49.624659 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151ddda-9e1e-4cc5-9b04-8652d57841c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:49.624931 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151ddda-9e1e-4cc5-9b04-8652d57841c2 None admin] PATH_INFO: `/v3/users/49d550c3e3b54e2aaebfc450900dd727` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:49.626546 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151ddda-9e1e-4cc5-9b04-8652d57841c2 None admin] RBAC: Authorizing `identity:get_user(user_id=49d550c3e3b54e2aaebfc450900dd727)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:49.627786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07b61e-1c38-4009-8366-f388e5600cc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:49.628001 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151ddda-9e1e-4cc5-9b04-8652d57841c2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:49.629273 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e07b61e-1c38-4009-8366-f388e5600cc8 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:49.629675 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:16:49 2022] GET /identity/v3/users/49d550c3e3b54e2aaebfc450900dd727 => generated 247 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:16:49.635433 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151ddda-9e1e-4cc5-9b04-8652d57841c2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:49.647840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-4e07b61e-1c38-4009-8366-f388e5600cc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:16:49.647840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:16:49.647840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:16:49.647840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:16:49.647840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:16:49.647840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:16:49.647840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:16:49.647840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:16:49.647840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:16:49.647840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:16:49.647840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:16:49.647840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:16:49.647840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:16:49.647840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:16:49.647840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:16:49.647840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:16:49.648867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:16:49.648867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:16:49.648867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:16:49.648867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:16:49.648867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:16:49.648867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:16:49.648867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:16:49.648867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:16:49.648867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:16:49.648867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:16:49.648867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:16:49.648867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:16:49.648867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:16:49.648867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:16:49.648867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:16:49.648867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:16:49.648867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:16:49.650004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:16:49.650004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:16:49.650004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:16:49.650004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 9/18] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:16:49.652184 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:16:49.654867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07b61e-1c38-4009-8366-f388e5600cc8 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:49.709941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:16:49.737925 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151ddda-9e1e-4cc5-9b04-8652d57841c2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:49.753332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07b61e-1c38-4009-8366-f388e5600cc8 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:49.773040 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145bbcef-f0be-471d-8e57-b8cd2616d3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:49.773675 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bbcef-f0be-471d-8e57-b8cd2616d3dc None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:49.773958 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bbcef-f0be-471d-8e57-b8cd2616d3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:49.774232 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bbcef-f0be-471d-8e57-b8cd2616d3dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:49.775347 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145bbcef-f0be-471d-8e57-b8cd2616d3dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:49.776802 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145bbcef-f0be-471d-8e57-b8cd2616d3dc None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:49.783101 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:16:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:16:49.784258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145bbcef-f0be-471d-8e57-b8cd2616d3dc None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:49.786308 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e3674-06a2-4d16-821d-98d12ccfa8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:49.786904 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e3674-06a2-4d16-821d-98d12ccfa8ee None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:49.787187 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e3674-06a2-4d16-821d-98d12ccfa8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:49.787460 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e3674-06a2-4d16-821d-98d12ccfa8ee None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:49.788109 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e3674-06a2-4d16-821d-98d12ccfa8ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:16:49.788410 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e3674-06a2-4d16-821d-98d12ccfa8ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:49.789830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e3674-06a2-4d16-821d-98d12ccfa8ee None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:49.807561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 10/20] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:16:49.869635 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:16:49.890902 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145bbcef-f0be-471d-8e57-b8cd2616d3dc None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:49.925694 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5f784-5f74-4b18-8752-f913c03314c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:49.926364 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5f784-5f74-4b18-8752-f913c03314c8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:49.926583 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5f784-5f74-4b18-8752-f913c03314c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:49.926858 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5f784-5f74-4b18-8752-f913c03314c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:49.927602 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5f784-5f74-4b18-8752-f913c03314c8 None admin] RBAC: Adding query filter params (role.id=e2095c5a29d74c33b9dcb16f8e5343bf, scope.domain.id=default, user.id=49d550c3e3b54e2aaebfc450900dd727) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:16:49.927911 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5f784-5f74-4b18-8752-f913c03314c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:49.929427 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5f784-5f74-4b18-8752-f913c03314c8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:49.938511 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 11/21] 10.222.0.16 () {56 vars in 1322 bytes} [Tue Aug 9 02:16:49 2022] GET /identity/v3/role_assignments?user.id=49d550c3e3b54e2aaebfc450900dd727&scope.domain.id=default&role.id=e2095c5a29d74c33b9dcb16f8e5343bf => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:16:52.226883 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd793d09-fcd7-4383-afb7-dd252afe51e6 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:52.226883 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd793d09-fcd7-4383-afb7-dd252afe51e6 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:52.226883 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd793d09-fcd7-4383-afb7-dd252afe51e6 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:52.226883 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 11/22] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:16:52.232695 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30ee28-b44a-4aed-8b9e-9346c5828dc7 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:52.233087 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30ee28-b44a-4aed-8b9e-9346c5828dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:52.233257 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30ee28-b44a-4aed-8b9e-9346c5828dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:52.263575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-6b30ee28-b44a-4aed-8b9e-9346c5828dc7 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:16:52.264790 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6b30ee28-b44a-4aed-8b9e-9346c5828dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:16:52.356983 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 12/23] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:16:52.396331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd793d09-fcd7-4383-afb7-dd252afe51e6 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:52.442977 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec304cc-d3a8-4664-9e86-2ac50844120f None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:52.443630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec304cc-d3a8-4664-9e86-2ac50844120f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:52.444095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec304cc-d3a8-4664-9e86-2ac50844120f None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:52.445716 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:16:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:16:52.451632 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a7e0b-2ade-4d91-98f3-34125dab534f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:52.452148 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a7e0b-2ade-4d91-98f3-34125dab534f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:52.452611 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a7e0b-2ade-4d91-98f3-34125dab534f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:52.484335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7e7a7e0b-2ade-4d91-98f3-34125dab534f None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:16:52.485867 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7e7a7e0b-2ade-4d91-98f3-34125dab534f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:16:52.582771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd793d09-fcd7-4383-afb7-dd252afe51e6 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:52.609706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:16:52.636584 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebc867-76de-4cd0-a35a-1f3917a790b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:52.637244 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebc867-76de-4cd0-a35a-1f3917a790b1 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:52.637526 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebc867-76de-4cd0-a35a-1f3917a790b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:52.637805 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebc867-76de-4cd0-a35a-1f3917a790b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:52.649654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 14/25] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 09 02:16:52.651111 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a480f-c9f9-4bc3-bfb7-a3a8149475c1 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:52.651406 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a480f-c9f9-4bc3-bfb7-a3a8149475c1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:52.651677 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a480f-c9f9-4bc3-bfb7-a3a8149475c1 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:52.653135 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 15/26] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:16:52.659359 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ddbcc-8d2e-4df3-b3ec-1956e921d64f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:52.659638 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ddbcc-8d2e-4df3-b3ec-1956e921d64f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:52.659998 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ddbcc-8d2e-4df3-b3ec-1956e921d64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:52.666051 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebc867-76de-4cd0-a35a-1f3917a790b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:16:52.667410 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:16:52.672553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-caebc867-76de-4cd0-a35a-1f3917a790b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:16:52.672553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:16:52.672553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:16:52.672553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:16:52.672553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:16:52.672553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:16:52.672553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:16:52.672553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:16:52.672553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:16:52.672553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:16:52.672553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:16:52.672553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:16:52.672553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:16:52.672553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:16:52.672553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:16:52.672553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:16:52.673623 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:16:52.673623 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:16:52.673623 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:16:52.673623 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:16:52.673623 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:16:52.673623 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:16:52.673623 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:16:52.673623 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:16:52.673623 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:16:52.673623 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:16:52.673623 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:16:52.673623 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:16:52.673623 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:16:52.673623 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:16:52.673623 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:16:52.673623 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:16:52.674398 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:16:52.674398 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:16:52.674398 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:16:52.674398 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:16:52.674398 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:16:52.674398 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:16:52.674398 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:16:52.674398 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:16:52.674398 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:16:52.674398 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:16:52.674398 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:16:52.674398 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:16:52.679344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 12/27] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:16:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:16:52.679780 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-429ddbcc-8d2e-4df3-b3ec-1956e921d64f None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:16:52.681517 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a6a64-3f00-4cce-b145-aafc5a786bab None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:52.681907 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a6a64-3f00-4cce-b145-aafc5a786bab None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:52.682129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-429ddbcc-8d2e-4df3-b3ec-1956e921d64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:16:52.682384 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a6a64-3f00-4cce-b145-aafc5a786bab None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:52.684017 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 13/28] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:16:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:16:52.684786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a6a64-3f00-4cce-b145-aafc5a786bab None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:52.768426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 16/29] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:16:52.770131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00981547-05bb-4e97-ba6b-63d8c2201b29 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:52.770557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00981547-05bb-4e97-ba6b-63d8c2201b29 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:52.770970 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00981547-05bb-4e97-ba6b-63d8c2201b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:52.793816 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-00981547-05bb-4e97-ba6b-63d8c2201b29 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:16:52.795440 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-00981547-05bb-4e97-ba6b-63d8c2201b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:16:52.799579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a6a64-3f00-4cce-b145-aafc5a786bab None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:52.873874 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 17/30] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:16:52.875043 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00981547-05bb-4e97-ba6b-63d8c2201b29 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:52.944837 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c411ef-422b-4f83-8231-1c7ef179b8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:52.945573 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c411ef-422b-4f83-8231-1c7ef179b8ef None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:52.946261 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c411ef-422b-4f83-8231-1c7ef179b8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:52.946261 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c411ef-422b-4f83-8231-1c7ef179b8ef None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:52.947590 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c411ef-422b-4f83-8231-1c7ef179b8ef None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:52.949130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c411ef-422b-4f83-8231-1c7ef179b8ef None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:52.962526 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:16:53.003656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00981547-05bb-4e97-ba6b-63d8c2201b29 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:53.039004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a06ab-b44f-4174-9259-cd8865bedd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:53.040464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a06ab-b44f-4174-9259-cd8865bedd6a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:53.040883 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a06ab-b44f-4174-9259-cd8865bedd6a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:53.041319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0a06ab-b44f-4174-9259-cd8865bedd6a None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:53.042124 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a06ab-b44f-4174-9259-cd8865bedd6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:16:53.042567 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a06ab-b44f-4174-9259-cd8865bedd6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:53.044152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0a06ab-b44f-4174-9259-cd8865bedd6a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:53.053321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 18/31] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:16:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:16:53.054421 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a06ab-b44f-4174-9259-cd8865bedd6a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:53.099190 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 14/32] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Aug 9 02:16:52 2022] POST /identity/v3/roles => generated 225 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:16:53.100511 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c411ef-422b-4f83-8231-1c7ef179b8ef None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:53.161990 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0a06ab-b44f-4174-9259-cd8865bedd6a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:53.167513 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:16:53.225408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:16:53.230752 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d31596-aa32-4f4d-839f-d10c238f7ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:53.231738 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d31596-aa32-4f4d-839f-d10c238f7ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:53.232211 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d31596-aa32-4f4d-839f-d10c238f7ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:53.232785 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d31596-aa32-4f4d-839f-d10c238f7ec9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:53.245918 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d31596-aa32-4f4d-839f-d10c238f7ec9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:53.247736 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d31596-aa32-4f4d-839f-d10c238f7ec9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:53.262439 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c411ef-422b-4f83-8231-1c7ef179b8ef None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:53.266274 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-21d31596-aa32-4f4d-839f-d10c238f7ec9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:16:53.266274 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:16:53.266274 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:16:53.266274 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:16:53.266274 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:16:53.266274 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:16:53.266274 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:16:53.266274 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:16:53.266274 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:16:53.266274 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:16:53.266274 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:16:53.266274 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:16:53.266274 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:16:53.266274 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:16:53.266274 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:16:53.266274 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:16:53.267133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:16:53.267133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:16:53.267133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:16:53.267133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:16:53.267133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:16:53.267133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:16:53.267133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:16:53.267133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:16:53.267133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:16:53.267133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:16:53.267133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:16:53.267133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:16:53.267133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:16:53.267133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:16:53.267133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:16:53.267133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:16:53.267133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:16:53.267892 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:16:53.267892 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:16:53.267892 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:16:53.269765 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 19/33] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:16:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:16:53.271066 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d31596-aa32-4f4d-839f-d10c238f7ec9 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:53.301080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c90899-35c9-4a48-978b-3c61e980137e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:53.302008 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c90899-35c9-4a48-978b-3c61e980137e None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:53.302447 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c90899-35c9-4a48-978b-3c61e980137e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:53.302855 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c90899-35c9-4a48-978b-3c61e980137e None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:53.303670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c90899-35c9-4a48-978b-3c61e980137e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:53.305403 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c90899-35c9-4a48-978b-3c61e980137e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:53.340483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 15/34] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Aug 9 02:16:53 2022] POST /identity/v3/roles => generated 219 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:16:53.341733 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c90899-35c9-4a48-978b-3c61e980137e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:53.400892 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d31596-aa32-4f4d-839f-d10c238f7ec9 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:53.442919 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b04ddd-99e0-42fb-8b5a-01ec122e62af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:53.443730 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b04ddd-99e0-42fb-8b5a-01ec122e62af None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:53.444105 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b04ddd-99e0-42fb-8b5a-01ec122e62af None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:53.444478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b04ddd-99e0-42fb-8b5a-01ec122e62af None admin] PATH_INFO: `/v3/users/49d550c3e3b54e2aaebfc450900dd727` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:53.445937 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b04ddd-99e0-42fb-8b5a-01ec122e62af None admin] RBAC: Authorizing `identity:get_user(user_id=49d550c3e3b54e2aaebfc450900dd727)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:53.447642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b04ddd-99e0-42fb-8b5a-01ec122e62af None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:53.449461 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 20/35] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:16:53 2022] GET /identity/v3/users/49d550c3e3b54e2aaebfc450900dd727 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:16:53.455463 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b04ddd-99e0-42fb-8b5a-01ec122e62af None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:53.510368 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:16:53.570905 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b04ddd-99e0-42fb-8b5a-01ec122e62af None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:53.612036 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc7b6f-0aee-45b5-85a2-9343393918b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:53.612675 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc7b6f-0aee-45b5-85a2-9343393918b9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:53.612956 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc7b6f-0aee-45b5-85a2-9343393918b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:53.613259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc7b6f-0aee-45b5-85a2-9343393918b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:53.615012 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc7b6f-0aee-45b5-85a2-9343393918b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:53.616456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc7b6f-0aee-45b5-85a2-9343393918b9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:53.618185 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 21/36] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:16:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:16:53.624282 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc7b6f-0aee-45b5-85a2-9343393918b9 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:53.626118 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:16:53.639228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c90899-35c9-4a48-978b-3c61e980137e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:53.678726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952f404-4b23-4ed4-99cb-546897452ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:53.679679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952f404-4b23-4ed4-99cb-546897452ebb None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:53.680187 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952f404-4b23-4ed4-99cb-546897452ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:53.680721 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952f404-4b23-4ed4-99cb-546897452ebb None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:53.681613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952f404-4b23-4ed4-99cb-546897452ebb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:16:53.682120 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952f404-4b23-4ed4-99cb-546897452ebb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:53.683717 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952f404-4b23-4ed4-99cb-546897452ebb None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:53.697402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 16/37] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:16:53.699040 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748cfd8-0425-41a3-865f-f81e82f5a6d8 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:53.699531 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748cfd8-0425-41a3-865f-f81e82f5a6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:53.700025 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748cfd8-0425-41a3-865f-f81e82f5a6d8 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:53.701492 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 17/38] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:16:53.704712 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748cfd8-0425-41a3-865f-f81e82f5a6d8 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:53.748577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc7b6f-0aee-45b5-85a2-9343393918b9 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:53.766113 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:16:53.787695 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a91fa-27e0-41a8-b924-9342744e2537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:53.788354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a91fa-27e0-41a8-b924-9342744e2537 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:53.788630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a91fa-27e0-41a8-b924-9342744e2537 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:53.788905 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a91fa-27e0-41a8-b924-9342744e2537 None admin] PATH_INFO: `/v3/domains/default/users/49d550c3e3b54e2aaebfc450900dd727/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:53.790910 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a91fa-27e0-41a8-b924-9342744e2537 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=49d550c3e3b54e2aaebfc450900dd727, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:53.792370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a91fa-27e0-41a8-b924-9342744e2537 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:53.818951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748cfd8-0425-41a3-865f-f81e82f5a6d8 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:53.852469 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328db2c-26f4-45b9-9867-eda22268b657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:53.852994 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328db2c-26f4-45b9-9867-eda22268b657 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:53.853300 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328db2c-26f4-45b9-9867-eda22268b657 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:53.853572 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328db2c-26f4-45b9-9867-eda22268b657 None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:53.854448 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328db2c-26f4-45b9-9867-eda22268b657 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:53.855883 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328db2c-26f4-45b9-9867-eda22268b657 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:53.885977 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 18/39] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 9 02:16:53 2022] POST /identity/v3/projects => generated 301 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:16:53.887191 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80189963-45aa-4f5d-805b-00d7154da495 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:53.887484 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80189963-45aa-4f5d-805b-00d7154da495 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:53.887752 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80189963-45aa-4f5d-805b-00d7154da495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:53.908716 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 22/40] 10.222.0.16 () {58 vars in 1361 bytes} [Tue Aug 9 02:16:53 2022] PUT /identity/v3/domains/default/users/49d550c3e3b54e2aaebfc450900dd727/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:16:53.910561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1a630-4016-4bd7-9e72-fc8fe1798502 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:53.910865 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1a630-4016-4bd7-9e72-fc8fe1798502 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:53.911150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1a630-4016-4bd7-9e72-fc8fe1798502 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:53.913705 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-80189963-45aa-4f5d-805b-00d7154da495 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:16:53.915764 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-80189963-45aa-4f5d-805b-00d7154da495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:16:53.915940 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 23/41] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:16:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:16:53.918907 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:16:53.925512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb09fdb-a710-44b9-b111-da4b9c650c3f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:53.925849 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb09fdb-a710-44b9-b111-da4b9c650c3f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:53.926079 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb09fdb-a710-44b9-b111-da4b9c650c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:53.966089 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2eb09fdb-a710-44b9-b111-da4b9c650c3f None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:16:53.970058 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2eb09fdb-a710-44b9-b111-da4b9c650c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:16:54.033676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 19/42] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:16:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:16:54.056554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80189963-45aa-4f5d-805b-00d7154da495 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:54.065596 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 24/43] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:16:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:16:54.096590 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb09fdb-a710-44b9-b111-da4b9c650c3f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:54.178935 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80189963-45aa-4f5d-805b-00d7154da495 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:54.203853 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb09fdb-a710-44b9-b111-da4b9c650c3f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:54.207525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:16:54.220346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991078e-73bb-4e56-8cac-c6a147c73cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:54.220931 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991078e-73bb-4e56-8cac-c6a147c73cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:54.221247 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991078e-73bb-4e56-8cac-c6a147c73cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:54.221876 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991078e-73bb-4e56-8cac-c6a147c73cd3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:54.222733 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991078e-73bb-4e56-8cac-c6a147c73cd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:54.224194 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991078e-73bb-4e56-8cac-c6a147c73cd3 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:54.225976 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 20/44] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:16:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:16:54.231566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991078e-73bb-4e56-8cac-c6a147c73cd3 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:54.240975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:16:54.247525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb400a0-6dc1-4e65-a581-e76424720871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:54.248220 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb400a0-6dc1-4e65-a581-e76424720871 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:54.248513 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb400a0-6dc1-4e65-a581-e76424720871 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:54.249347 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb400a0-6dc1-4e65-a581-e76424720871 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:54.250041 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb400a0-6dc1-4e65-a581-e76424720871 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:54.255245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb400a0-6dc1-4e65-a581-e76424720871 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:54.274958 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 25/45] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Aug 9 02:16:54 2022] POST /identity/v3/roles => generated 223 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:16:54.344879 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991078e-73bb-4e56-8cac-c6a147c73cd3 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:54.382209 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90897a1c-60bc-49e9-904c-8a285ed81513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:54.382966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90897a1c-60bc-49e9-904c-8a285ed81513 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:54.383259 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90897a1c-60bc-49e9-904c-8a285ed81513 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:54.383590 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90897a1c-60bc-49e9-904c-8a285ed81513 None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:54.384755 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90897a1c-60bc-49e9-904c-8a285ed81513 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:54.386297 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90897a1c-60bc-49e9-904c-8a285ed81513 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:54.415811 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 21/46] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 9 02:16:54 2022] POST /identity/v3/projects => generated 312 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:16:55.966533 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7deec-f3f7-4c92-b45b-8586351db845 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:55.967079 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7deec-f3f7-4c92-b45b-8586351db845 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:55.967079 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b7deec-f3f7-4c92-b45b-8586351db845 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:55.968432 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 26/47] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:16:55.973579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2a11a-3b63-423e-bf78-c66c72a04086 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:55.974407 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2a11a-3b63-423e-bf78-c66c72a04086 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:55.974757 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2a11a-3b63-423e-bf78-c66c72a04086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:55.993967 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a6c2a11a-3b63-423e-bf78-c66c72a04086 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:16:55.995430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a6c2a11a-3b63-423e-bf78-c66c72a04086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:16:56.047191 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:16:56.062052 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 22/48] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:16:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:16:56.084179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7deec-f3f7-4c92-b45b-8586351db845 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:56.185583 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b7deec-f3f7-4c92-b45b-8586351db845 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:56.218862 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc427e04-7a1d-483f-9512-03fa79e04b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:56.219429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc427e04-7a1d-483f-9512-03fa79e04b8d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:56.219715 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc427e04-7a1d-483f-9512-03fa79e04b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:56.219995 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc427e04-7a1d-483f-9512-03fa79e04b8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:56.230460 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc427e04-7a1d-483f-9512-03fa79e04b8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:16:56.235259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-bc427e04-7a1d-483f-9512-03fa79e04b8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:16:56.235259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:16:56.235259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:16:56.235259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:16:56.235259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:16:56.235259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:16:56.235259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:16:56.235259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:16:56.235259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:16:56.235259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:16:56.235259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:16:56.235259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:16:56.235259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:16:56.235259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:16:56.235259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:16:56.235259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:16:56.236081 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:16:56.236081 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:16:56.236081 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:16:56.236081 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:16:56.236081 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:16:56.236081 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:16:56.236081 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:16:56.236081 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:16:56.236081 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:16:56.236081 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:16:56.236081 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:16:56.236081 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:16:56.236081 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:16:56.236081 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:16:56.236081 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:16:56.236081 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:16:56.236875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:16:56.236875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:16:56.236875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:16:56.236875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:16:56.236875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:16:56.236875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:16:56.236875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:16:56.236875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:16:56.236875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:16:56.236875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:16:56.236875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:16:56.236875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:16:56.236875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 27/49] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:16:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:16:56.242281 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2a11a-3b63-423e-bf78-c66c72a04086 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:56.347701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2a11a-3b63-423e-bf78-c66c72a04086 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:56.381311 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce3103-4659-40a0-abf3-d423f0038f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:56.381920 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce3103-4659-40a0-abf3-d423f0038f4e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:56.382201 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce3103-4659-40a0-abf3-d423f0038f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:56.382475 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce3103-4659-40a0-abf3-d423f0038f4e None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:56.383137 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce3103-4659-40a0-abf3-d423f0038f4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:16:56.384022 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce3103-4659-40a0-abf3-d423f0038f4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:56.385433 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce3103-4659-40a0-abf3-d423f0038f4e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:56.397028 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 23/50] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:16:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:16:56.403052 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc427e04-7a1d-483f-9512-03fa79e04b8d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:56.415482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e8355-b893-4e53-a983-a4e7d336bbfa None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:56.415768 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e8355-b893-4e53-a983-a4e7d336bbfa None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:56.416044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e8355-b893-4e53-a983-a4e7d336bbfa None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:56.417401 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 24/51] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:16:56.422221 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad42456-2385-4226-bba8-58832c7450d5 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:56.422504 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad42456-2385-4226-bba8-58832c7450d5 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:56.422780 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad42456-2385-4226-bba8-58832c7450d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:56.428072 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:16:56.440914 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-1ad42456-2385-4226-bba8-58832c7450d5 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:16:56.442125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1ad42456-2385-4226-bba8-58832c7450d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:16:56.486370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:16:56.505350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc427e04-7a1d-483f-9512-03fa79e04b8d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:56.506990 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 25/52] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:16:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 02:16:56.529290 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad42456-2385-4226-bba8-58832c7450d5 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:56.538774 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bda06e-4bc0-43b0-a673-e4731e3e59d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:56.539404 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bda06e-4bc0-43b0-a673-e4731e3e59d7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:56.539719 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bda06e-4bc0-43b0-a673-e4731e3e59d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:56.540118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bda06e-4bc0-43b0-a673-e4731e3e59d7 None admin] PATH_INFO: `/v3/users/49d550c3e3b54e2aaebfc450900dd727` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:56.541280 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bda06e-4bc0-43b0-a673-e4731e3e59d7 None admin] RBAC: Authorizing `identity:get_user(user_id=49d550c3e3b54e2aaebfc450900dd727)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:56.542746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bda06e-4bc0-43b0-a673-e4731e3e59d7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:56.544447 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 28/53] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:16:56 2022] GET /identity/v3/users/49d550c3e3b54e2aaebfc450900dd727 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:16:56.549634 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bda06e-4bc0-43b0-a673-e4731e3e59d7 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:56.629496 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad42456-2385-4226-bba8-58832c7450d5 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:56.646395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:16:56.655448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bda06e-4bc0-43b0-a673-e4731e3e59d7 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:56.662566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1721024-adf8-4ae9-ae6b-2e0e4a64a92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:56.663194 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1721024-adf8-4ae9-ae6b-2e0e4a64a92e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:56.663475 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1721024-adf8-4ae9-ae6b-2e0e4a64a92e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:56.663747 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1721024-adf8-4ae9-ae6b-2e0e4a64a92e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:56.664865 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1721024-adf8-4ae9-ae6b-2e0e4a64a92e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:56.666343 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1721024-adf8-4ae9-ae6b-2e0e4a64a92e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:56.667907 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 26/54] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:16:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:16:56.673748 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1721024-adf8-4ae9-ae6b-2e0e4a64a92e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:56.688064 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71664b85-4e23-484b-8398-daa64ef3b373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:56.688804 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71664b85-4e23-484b-8398-daa64ef3b373 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:56.689113 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71664b85-4e23-484b-8398-daa64ef3b373 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:56.689393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71664b85-4e23-484b-8398-daa64ef3b373 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:56.690499 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71664b85-4e23-484b-8398-daa64ef3b373 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:56.691938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71664b85-4e23-484b-8398-daa64ef3b373 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:56.693666 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 29/55] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:16:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:16:56.699770 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71664b85-4e23-484b-8398-daa64ef3b373 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:56.723343 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:16:56.773456 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1721024-adf8-4ae9-ae6b-2e0e4a64a92e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:56.798752 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71664b85-4e23-484b-8398-daa64ef3b373 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:56.807177 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48411793-a70f-4f60-8a0c-3a442ac7a0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:56.807783 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48411793-a70f-4f60-8a0c-3a442ac7a0f1 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:56.808071 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48411793-a70f-4f60-8a0c-3a442ac7a0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:56.808343 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48411793-a70f-4f60-8a0c-3a442ac7a0f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:56.808981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48411793-a70f-4f60-8a0c-3a442ac7a0f1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:56.810459 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48411793-a70f-4f60-8a0c-3a442ac7a0f1 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:56.832524 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34294fe7-9424-44ef-84ca-690d7e834afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:56.833159 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34294fe7-9424-44ef-84ca-690d7e834afa None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:56.833443 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34294fe7-9424-44ef-84ca-690d7e834afa None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:56.833725 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34294fe7-9424-44ef-84ca-690d7e834afa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:56.834437 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34294fe7-9424-44ef-84ca-690d7e834afa None admin] RBAC: Adding query filter params (role.id=e2095c5a29d74c33b9dcb16f8e5343bf, scope.domain.id=default, user.id=49d550c3e3b54e2aaebfc450900dd727) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:16:56.834743 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34294fe7-9424-44ef-84ca-690d7e834afa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:56.836213 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 27/56] 10.222.0.16 () {60 vars in 1140 bytes} [Tue Aug 9 02:16:56 2022] POST /identity/v3/projects => generated 298 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:16:56.836321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34294fe7-9424-44ef-84ca-690d7e834afa None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:56.842297 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 30/57] 10.222.0.16 () {56 vars in 1322 bytes} [Tue Aug 9 02:16:56 2022] GET /identity/v3/role_assignments?user.id=49d550c3e3b54e2aaebfc450900dd727&scope.domain.id=default&role.id=e2095c5a29d74c33b9dcb16f8e5343bf => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:16:58.850965 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f9293-3ade-4c16-8625-85e4cd56eb10 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:58.851475 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f9293-3ade-4c16-8625-85e4cd56eb10 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:58.851581 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f9293-3ade-4c16-8625-85e4cd56eb10 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:58.853516 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 28/58] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:16:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:16:58.858631 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe26c24-ed6f-4e52-a1d8-7ddf77ffdc7d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:58.859017 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe26c24-ed6f-4e52-a1d8-7ddf77ffdc7d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:58.859190 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe26c24-ed6f-4e52-a1d8-7ddf77ffdc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:58.876977 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-dbe26c24-ed6f-4e52-a1d8-7ddf77ffdc7d None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:16:58.878203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-dbe26c24-ed6f-4e52-a1d8-7ddf77ffdc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:16:58.895011 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:16:58.943104 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 31/59] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:16:58.969667 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f9293-3ade-4c16-8625-85e4cd56eb10 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:59.064636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:16:59.068983 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f9293-3ade-4c16-8625-85e4cd56eb10 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:59.102472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550ef11-2484-4f55-9b54-ffd11104c4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:59.103044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550ef11-2484-4f55-9b54-ffd11104c4d2 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:59.103327 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550ef11-2484-4f55-9b54-ffd11104c4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:59.103602 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550ef11-2484-4f55-9b54-ffd11104c4d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:59.104777 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550ef11-2484-4f55-9b54-ffd11104c4d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:59.106270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550ef11-2484-4f55-9b54-ffd11104c4d2 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:59.107831 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 29/60] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:16:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:16:59.113443 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe26c24-ed6f-4e52-a1d8-7ddf77ffdc7d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:16:59.209181 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe26c24-ed6f-4e52-a1d8-7ddf77ffdc7d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:16:59.241673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcea63c-a89c-4667-983e-5a4603594f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:16:59.242273 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcea63c-a89c-4667-983e-5a4603594f34 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:16:59.242583 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcea63c-a89c-4667-983e-5a4603594f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:16:59.242860 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcea63c-a89c-4667-983e-5a4603594f34 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:16:59.243507 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcea63c-a89c-4667-983e-5a4603594f34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:16:59.245230 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcea63c-a89c-4667-983e-5a4603594f34 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:16:59.270752 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 32/61] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 9 02:16:59 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:17:02.236322 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a007a14-ff68-4930-a249-2f897dc1fa60 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:02.237324 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a007a14-ff68-4930-a249-2f897dc1fa60 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:02.237809 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a007a14-ff68-4930-a249-2f897dc1fa60 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:02.239647 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 30/62] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:02.245283 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82e602-17cb-4f16-870d-838f2e2ccff0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:02.245687 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82e602-17cb-4f16-870d-838f2e2ccff0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:02.245844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82e602-17cb-4f16-870d-838f2e2ccff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:02.274161 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2d82e602-17cb-4f16-870d-838f2e2ccff0 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:02.275579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2d82e602-17cb-4f16-870d-838f2e2ccff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:02.282069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:02.374344 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 33/63] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:02.411006 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a007a14-ff68-4930-a249-2f897dc1fa60 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:02.562608 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b0b80-9015-4f4a-9aa6-051eab729400 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:02.563138 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b0b80-9015-4f4a-9aa6-051eab729400 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:02.563594 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b0b80-9015-4f4a-9aa6-051eab729400 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:02.565146 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 34/64] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:02.571627 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a007a14-ff68-4930-a249-2f897dc1fa60 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:02.577151 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab10e5-a55f-4cc5-80b6-d86c600f80b5 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:02.577703 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab10e5-a55f-4cc5-80b6-d86c600f80b5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:02.578206 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab10e5-a55f-4cc5-80b6-d86c600f80b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:02.610933 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cbb64-a5ae-4ff5-8c4d-94788bbf76bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:02.611811 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cbb64-a5ae-4ff5-8c4d-94788bbf76bb None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:02.612215 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-50ab10e5-a55f-4cc5-80b6-d86c600f80b5 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:02.612380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cbb64-a5ae-4ff5-8c4d-94788bbf76bb None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:02.612812 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cbb64-a5ae-4ff5-8c4d-94788bbf76bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:02.613756 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-50ab10e5-a55f-4cc5-80b6-d86c600f80b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:02.624912 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cbb64-a5ae-4ff5-8c4d-94788bbf76bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:02.630818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-d78cbb64-a5ae-4ff5-8c4d-94788bbf76bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:02.630818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:02.630818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:02.630818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:02.630818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:02.630818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:02.630818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:02.630818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:02.630818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:02.630818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:02.630818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:02.630818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:02.630818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:02.630818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:02.630818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:02.630818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:02.631674 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:02.631674 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:02.631674 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:02.631674 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:02.631674 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:02.631674 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:02.631674 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:02.631674 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:02.631674 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:02.631674 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:02.631674 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:02.631674 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:02.631674 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:02.631674 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:02.631674 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:02.631674 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:02.632414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:02.632414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:02.632414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:02.632414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:02.632414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:02.632414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:02.632414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:02.632414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:02.632414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:02.632414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:02.632414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:02.632414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:02.635136 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 31/65] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:02.640504 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cbb64-a5ae-4ff5-8c4d-94788bbf76bb None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:02.699411 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:02.737304 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 35/66] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 02:17:02.745038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ec4f4-47e1-421b-a45a-b00946c72caf None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:02.745532 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ec4f4-47e1-421b-a45a-b00946c72caf None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:02.745990 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ec4f4-47e1-421b-a45a-b00946c72caf None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:02.747456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 36/67] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:02.753280 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee684da-943c-4a8e-9163-344912915df3 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:02.753765 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee684da-943c-4a8e-9163-344912915df3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:02.754216 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee684da-943c-4a8e-9163-344912915df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:02.782566 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-bee684da-943c-4a8e-9163-344912915df3 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:02.784045 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bee684da-943c-4a8e-9163-344912915df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:02.787884 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cbb64-a5ae-4ff5-8c4d-94788bbf76bb None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:02.825120 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026320b-5816-4edd-befc-5d1e38ad84df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:02.826039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026320b-5816-4edd-befc-5d1e38ad84df None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:02.826460 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026320b-5816-4edd-befc-5d1e38ad84df None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:02.826887 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026320b-5816-4edd-befc-5d1e38ad84df None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:02.827697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026320b-5816-4edd-befc-5d1e38ad84df None admin] RBAC: Adding query filter params (name=member) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:02.828137 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026320b-5816-4edd-befc-5d1e38ad84df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:02.829747 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026320b-5816-4edd-befc-5d1e38ad84df None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:02.839429 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 32/68] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:17:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:02.840556 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026320b-5816-4edd-befc-5d1e38ad84df None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:02.854866 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:02.859900 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 37/69] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 02:17:02.861094 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee684da-943c-4a8e-9163-344912915df3 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:02.964871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:02.979140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026320b-5816-4edd-befc-5d1e38ad84df None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:02.993175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee684da-943c-4a8e-9163-344912915df3 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:03.013945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cf756-5e8b-4b23-a7c0-c2fa8968dc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:03.014576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cf756-5e8b-4b23-a7c0-c2fa8968dc15 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:03.014866 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cf756-5e8b-4b23-a7c0-c2fa8968dc15 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:03.015143 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cf756-5e8b-4b23-a7c0-c2fa8968dc15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:03.026123 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cf756-5e8b-4b23-a7c0-c2fa8968dc15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:03.030520 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b55636-a687-419f-a483-060522839ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:03.031159 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b55636-a687-419f-a483-060522839ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:03.031354 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-379cf756-5e8b-4b23-a7c0-c2fa8968dc15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:17:03.031354 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:03.031354 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:03.031354 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:03.031354 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:03.031354 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:03.031354 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:03.031354 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:03.031354 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:03.031354 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:03.031354 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:03.031354 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:03.031354 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:03.031354 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:03.031354 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:03.031354 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:03.032341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:03.032341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:03.032341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:03.032341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:03.032341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:03.032341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:03.032341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:03.032341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:03.032341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:03.032341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:03.032341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:03.032341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:03.032341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:03.032341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:03.032341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:03.032341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:03.033169 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:03.033169 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:03.033169 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:03.033169 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:03.033169 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:03.033169 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:03.033169 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:03.033169 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:03.033169 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:03.033169 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:03.033169 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:17:03.033169 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:03.033738 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b55636-a687-419f-a483-060522839ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:03.033738 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b55636-a687-419f-a483-060522839ad5 None admin] PATH_INFO: `/v3/users/c03490a890814d2db0a221cf0a15aed9` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:03.033851 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 33/70] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:17:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:03.033851 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cf756-5e8b-4b23-a7c0-c2fa8968dc15 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:03.047755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b55636-a687-419f-a483-060522839ad5 None admin] RBAC: Authorizing `identity:get_user(user_id=c03490a890814d2db0a221cf0a15aed9)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:03.049261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b55636-a687-419f-a483-060522839ad5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:03.051088 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 38/71] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:02 2022] GET /identity/v3/users/c03490a890814d2db0a221cf0a15aed9 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:03.052238 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e01cf-0980-49d0-b90d-eb2e5226e299 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:03.052537 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e01cf-0980-49d0-b90d-eb2e5226e299 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:03.052800 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e01cf-0980-49d0-b90d-eb2e5226e299 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:03.054052 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 39/72] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:03.057508 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a733c6-6864-4069-967e-e2c266f8cda3 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:03.057508 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a733c6-6864-4069-967e-e2c266f8cda3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:03.057508 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a733c6-6864-4069-967e-e2c266f8cda3 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:03.057508 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 40/73] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:03.057931 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a733c6-6864-4069-967e-e2c266f8cda3 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:03.115947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:03.142368 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cf756-5e8b-4b23-a7c0-c2fa8968dc15 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:03.158376 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a733c6-6864-4069-967e-e2c266f8cda3 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:03.174282 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db6086-cc8b-47f2-bb85-5f15c74d3de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:03.174909 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db6086-cc8b-47f2-bb85-5f15c74d3de8 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:03.175188 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db6086-cc8b-47f2-bb85-5f15c74d3de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:03.175459 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db6086-cc8b-47f2-bb85-5f15c74d3de8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:03.186245 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db6086-cc8b-47f2-bb85-5f15c74d3de8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:03.190973 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-57db6086-cc8b-47f2-bb85-5f15c74d3de8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 02:17:03.190973 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:03.190973 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:03.190973 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:03.190973 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:03.190973 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:03.190973 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:03.190973 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:03.190973 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:03.190973 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:03.190973 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:03.190973 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:03.190973 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:03.190973 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:03.190973 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:03.190973 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:03.191845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:03.191845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:03.191845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:03.191845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:03.191845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:03.191845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:03.191845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:03.191845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:03.191845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:03.191845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:03.191845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:03.191845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:03.191845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:03.191845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:03.191845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:03.191845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:03.192603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:03.192603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:03.192603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:03.192603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:03.192603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:03.192603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:03.192603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:03.192603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:03.192603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:03.192603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:03.192603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 02:17:03.192603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:03.193208 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99162e4a-c8a4-4012-aab6-fbbe82b75367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:03.193208 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99162e4a-c8a4-4012-aab6-fbbe82b75367 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:03.193208 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99162e4a-c8a4-4012-aab6-fbbe82b75367 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:03.193405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99162e4a-c8a4-4012-aab6-fbbe82b75367 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:03.194085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99162e4a-c8a4-4012-aab6-fbbe82b75367 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:03.194393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99162e4a-c8a4-4012-aab6-fbbe82b75367 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:03.196342 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99162e4a-c8a4-4012-aab6-fbbe82b75367 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:03.197158 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 34/74] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 9 02:17:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:03.197990 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db6086-cc8b-47f2-bb85-5f15c74d3de8 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:03.204814 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 41/75] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:03.209886 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:03.210547 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654f44f-0e7f-4fe7-b985-d3b7a7916173 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:03.210846 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654f44f-0e7f-4fe7-b985-d3b7a7916173 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:03.211206 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654f44f-0e7f-4fe7-b985-d3b7a7916173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:03.228342 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f654f44f-0e7f-4fe7-b985-d3b7a7916173 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:03.229568 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f654f44f-0e7f-4fe7-b985-d3b7a7916173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:03.295158 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 42/76] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:03.296243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db6086-cc8b-47f2-bb85-5f15c74d3de8 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:03.296625 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a63c1-8ff2-4f61-baba-06ff2b6d3992 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:03.296625 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a63c1-8ff2-4f61-baba-06ff2b6d3992 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:03.296913 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a63c1-8ff2-4f61-baba-06ff2b6d3992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:03.324378 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b29a63c1-8ff2-4f61-baba-06ff2b6d3992 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:03.325601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b29a63c1-8ff2-4f61-baba-06ff2b6d3992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:03.330192 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a46e91-f612-4d86-8396-f4d517ca4915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:03.330804 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a46e91-f612-4d86-8396-f4d517ca4915 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:03.331088 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a46e91-f612-4d86-8396-f4d517ca4915 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:03.331364 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a46e91-f612-4d86-8396-f4d517ca4915 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:03.374065 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:03.396088 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 43/77] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:03.401943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a63c1-8ff2-4f61-baba-06ff2b6d3992 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:03.407809 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a46e91-f612-4d86-8396-f4d517ca4915 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:03.409317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a46e91-f612-4d86-8396-f4d517ca4915 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:03.421037 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:03.500277 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a63c1-8ff2-4f61-baba-06ff2b6d3992 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:03.508331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 35/78] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:03.508331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a46e91-f612-4d86-8396-f4d517ca4915 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:03.537294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab67a2d-ff79-4bfd-8bb0-f642f8a6c9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:03.537908 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab67a2d-ff79-4bfd-8bb0-f642f8a6c9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:03.538191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab67a2d-ff79-4bfd-8bb0-f642f8a6c9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:03.538465 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab67a2d-ff79-4bfd-8bb0-f642f8a6c9c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:03.539665 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab67a2d-ff79-4bfd-8bb0-f642f8a6c9c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:03.539971 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab67a2d-ff79-4bfd-8bb0-f642f8a6c9c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:03.541389 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab67a2d-ff79-4bfd-8bb0-f642f8a6c9c4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:03.549088 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 44/79] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:17:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:03.549872 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab67a2d-ff79-4bfd-8bb0-f642f8a6c9c4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:03.592095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:03.610343 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a46e91-f612-4d86-8396-f4d517ca4915 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:03.621553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:03.645097 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378531c-bf91-4edf-9dc0-5c80bb8faa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:03.645689 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378531c-bf91-4edf-9dc0-5c80bb8faa57 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:03.645976 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378531c-bf91-4edf-9dc0-5c80bb8faa57 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:03.646254 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378531c-bf91-4edf-9dc0-5c80bb8faa57 None admin] PATH_INFO: `/v3/users/49d550c3e3b54e2aaebfc450900dd727` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:03.647622 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378531c-bf91-4edf-9dc0-5c80bb8faa57 None admin] RBAC: Authorizing `identity:get_user(user_id=49d550c3e3b54e2aaebfc450900dd727)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:03.649124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378531c-bf91-4edf-9dc0-5c80bb8faa57 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:03.650003 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab67a2d-ff79-4bfd-8bb0-f642f8a6c9c4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:03.650716 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 36/80] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:03 2022] GET /identity/v3/users/49d550c3e3b54e2aaebfc450900dd727 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:03.651561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378531c-bf91-4edf-9dc0-5c80bb8faa57 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:03.689210 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc95b04-abfc-43c2-b60e-d6119811f106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:03.689836 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc95b04-abfc-43c2-b60e-d6119811f106 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:03.690129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc95b04-abfc-43c2-b60e-d6119811f106 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:03.690406 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc95b04-abfc-43c2-b60e-d6119811f106 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:03.700374 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc95b04-abfc-43c2-b60e-d6119811f106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:03.705556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-0bc95b04-abfc-43c2-b60e-d6119811f106 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:03.705556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:03.705556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:03.705556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:03.705556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:03.705556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:03.705556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:03.705556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:03.705556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:03.705556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:03.705556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:03.705556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:03.705556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:03.705556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:03.705556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:03.705556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:03.706476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:03.706476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:03.706476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:03.706476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:03.706476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:03.706476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:03.706476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:03.706476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:03.706476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:03.706476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:03.706476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:03.706476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:03.706476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:03.706476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:03.706476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:03.706476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:03.707219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:03.707219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:03.707219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:03.707219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:03.707219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:03.707219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:03.707219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:03.707219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:03.707219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:03.707219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:03.707219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:03.707219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:03.707219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 45/81] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:03.707843 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc95b04-abfc-43c2-b60e-d6119811f106 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:03.753711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378531c-bf91-4edf-9dc0-5c80bb8faa57 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:03.786336 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbc1fb-3716-4222-950f-7b6213c65cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:03.786969 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbc1fb-3716-4222-950f-7b6213c65cfb None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:03.787255 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbc1fb-3716-4222-950f-7b6213c65cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:03.787533 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbc1fb-3716-4222-950f-7b6213c65cfb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:03.788664 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbc1fb-3716-4222-950f-7b6213c65cfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:03.790685 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbc1fb-3716-4222-950f-7b6213c65cfb None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:03.792261 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 37/82] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:17:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:03.794088 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbc1fb-3716-4222-950f-7b6213c65cfb None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:03.808532 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc95b04-abfc-43c2-b60e-d6119811f106 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:03.810080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:03.839975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:03.843406 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d6fa8-5df9-41ed-a094-5cde1ae8d3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:03.844036 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d6fa8-5df9-41ed-a094-5cde1ae8d3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:03.844321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d6fa8-5df9-41ed-a094-5cde1ae8d3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:03.844599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d6fa8-5df9-41ed-a094-5cde1ae8d3c3 None admin] PATH_INFO: `/v3/projects/01c75d368d814248b8ba862ee53b50dc` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:03.845755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d6fa8-5df9-41ed-a094-5cde1ae8d3c3 None admin] RBAC: Authorizing `identity:get_project(project_id=01c75d368d814248b8ba862ee53b50dc)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:03.847220 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d6fa8-5df9-41ed-a094-5cde1ae8d3c3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:03.848842 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 46/83] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:03 2022] GET /identity/v3/projects/01c75d368d814248b8ba862ee53b50dc => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:03.849711 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d6fa8-5df9-41ed-a094-5cde1ae8d3c3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:03.894306 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbc1fb-3716-4222-950f-7b6213c65cfb None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:03.927885 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee8e0b-1d5c-4e89-b194-e0cb5539f59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:03.928450 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee8e0b-1d5c-4e89-b194-e0cb5539f59f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:03.928736 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee8e0b-1d5c-4e89-b194-e0cb5539f59f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:03.929014 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee8e0b-1d5c-4e89-b194-e0cb5539f59f None admin] PATH_INFO: `/v3/users/c03490a890814d2db0a221cf0a15aed9` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:03.930246 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee8e0b-1d5c-4e89-b194-e0cb5539f59f None admin] RBAC: Authorizing `identity:get_user(user_id=c03490a890814d2db0a221cf0a15aed9)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:03.931695 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee8e0b-1d5c-4e89-b194-e0cb5539f59f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:03.933319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 38/84] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:03 2022] GET /identity/v3/users/c03490a890814d2db0a221cf0a15aed9 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:03.934084 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee8e0b-1d5c-4e89-b194-e0cb5539f59f None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:03.951517 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d6fa8-5df9-41ed-a094-5cde1ae8d3c3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:03.986401 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64346134-0961-49cb-9dd8-d5b89f19fc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:03.987012 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64346134-0961-49cb-9dd8-d5b89f19fc46 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:03.987289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64346134-0961-49cb-9dd8-d5b89f19fc46 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:03.987559 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64346134-0961-49cb-9dd8-d5b89f19fc46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:04.026069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:04.039769 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee8e0b-1d5c-4e89-b194-e0cb5539f59f None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:04.053297 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:04.055677 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64346134-0961-49cb-9dd8-d5b89f19fc46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:04.057305 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64346134-0961-49cb-9dd8-d5b89f19fc46 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:04.074156 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2fc70-e977-4504-8fd0-45a1f4bf9577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:04.074766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2fc70-e977-4504-8fd0-45a1f4bf9577 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:04.075051 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2fc70-e977-4504-8fd0-45a1f4bf9577 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:04.075326 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2fc70-e977-4504-8fd0-45a1f4bf9577 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:04.075992 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2fc70-e977-4504-8fd0-45a1f4bf9577 None admin] RBAC: Adding query filter params (name=member) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:04.076303 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2fc70-e977-4504-8fd0-45a1f4bf9577 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:04.077710 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2fc70-e977-4504-8fd0-45a1f4bf9577 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:04.086553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 39/85] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:17:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:04.087467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2fc70-e977-4504-8fd0-45a1f4bf9577 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:04.160454 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 47/86] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:04.161306 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64346134-0961-49cb-9dd8-d5b89f19fc46 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:04.188721 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2fc70-e977-4504-8fd0-45a1f4bf9577 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:04.222111 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9af2c7-8802-4daa-b753-f22d9e3b283f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:04.222715 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9af2c7-8802-4daa-b753-f22d9e3b283f None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:04.223000 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9af2c7-8802-4daa-b753-f22d9e3b283f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:04.223274 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9af2c7-8802-4daa-b753-f22d9e3b283f None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:04.223923 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9af2c7-8802-4daa-b753-f22d9e3b283f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:04.225409 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9af2c7-8802-4daa-b753-f22d9e3b283f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:04.229241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:04.253114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 40/87] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 9 02:17:04 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:17:04.253949 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9af2c7-8802-4daa-b753-f22d9e3b283f None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:04.279278 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64346134-0961-49cb-9dd8-d5b89f19fc46 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:04.297840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:04.317709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e77b47-e1d6-4761-b1d0-0dbd6a56f573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:04.318346 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e77b47-e1d6-4761-b1d0-0dbd6a56f573 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:04.318633 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e77b47-e1d6-4761-b1d0-0dbd6a56f573 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:04.318906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e77b47-e1d6-4761-b1d0-0dbd6a56f573 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:04.319651 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e77b47-e1d6-4761-b1d0-0dbd6a56f573 None admin] RBAC: Adding query filter params (role.id=a463f0ebb5cf4516b0bec345d25071cb, scope.project.id=01c75d368d814248b8ba862ee53b50dc, user.id=c03490a890814d2db0a221cf0a15aed9) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:04.319967 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e77b47-e1d6-4761-b1d0-0dbd6a56f573 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:04.322016 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e77b47-e1d6-4761-b1d0-0dbd6a56f573 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:04.327983 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 48/88] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:17:04 2022] GET /identity/v3/role_assignments?user.id=c03490a890814d2db0a221cf0a15aed9&scope.project.id=01c75d368d814248b8ba862ee53b50dc&role.id=a463f0ebb5cf4516b0bec345d25071cb => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:04.328852 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e77b47-e1d6-4761-b1d0-0dbd6a56f573 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:04.392165 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9af2c7-8802-4daa-b753-f22d9e3b283f None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:04.432047 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b694d-9c63-450a-be40-3a8e840069c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:04.432802 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b694d-9c63-450a-be40-3a8e840069c3 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:04.433207 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b694d-9c63-450a-be40-3a8e840069c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:04.433479 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b694d-9c63-450a-be40-3a8e840069c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:04.467671 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e77b47-e1d6-4761-b1d0-0dbd6a56f573 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:04.519238 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edb01e-a9fb-41d4-b9e5-f23a234515fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:04.519876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edb01e-a9fb-41d4-b9e5-f23a234515fa None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:04.520171 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edb01e-a9fb-41d4-b9e5-f23a234515fa None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:04.520432 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edb01e-a9fb-41d4-b9e5-f23a234515fa None admin] PATH_INFO: `/v3/users/c03490a890814d2db0a221cf0a15aed9` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:04.521699 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edb01e-a9fb-41d4-b9e5-f23a234515fa None admin] RBAC: Authorizing `identity:get_user(user_id=c03490a890814d2db0a221cf0a15aed9)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:04.523146 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edb01e-a9fb-41d4-b9e5-f23a234515fa None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:04.525559 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 49/89] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:04 2022] GET /identity/v3/users/c03490a890814d2db0a221cf0a15aed9 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:04.526140 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edb01e-a9fb-41d4-b9e5-f23a234515fa None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:04.528859 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:04.530968 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b694d-9c63-450a-be40-3a8e840069c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:04.532099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b694d-9c63-450a-be40-3a8e840069c3 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:04.570105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:04.664844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edb01e-a9fb-41d4-b9e5-f23a234515fa None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:04.665489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 41/90] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:04.666253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b694d-9c63-450a-be40-3a8e840069c3 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:04.716455 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15f100-bcc1-437c-8b77-63bddd3d4019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:04.717802 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15f100-bcc1-437c-8b77-63bddd3d4019 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:04.718541 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15f100-bcc1-437c-8b77-63bddd3d4019 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:04.719026 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15f100-bcc1-437c-8b77-63bddd3d4019 None admin] PATH_INFO: `/v3/projects/01c75d368d814248b8ba862ee53b50dc` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:04.720779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15f100-bcc1-437c-8b77-63bddd3d4019 None admin] RBAC: Authorizing `identity:get_project(project_id=01c75d368d814248b8ba862ee53b50dc)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:04.723082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15f100-bcc1-437c-8b77-63bddd3d4019 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:04.725539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 50/91] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:04 2022] GET /identity/v3/projects/01c75d368d814248b8ba862ee53b50dc => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:04.727261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15f100-bcc1-437c-8b77-63bddd3d4019 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:04.779047 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b694d-9c63-450a-be40-3a8e840069c3 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:04.810993 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:04.821815 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4b48f-5ea9-4c2b-adcd-70d9cf7ab129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:04.822402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4b48f-5ea9-4c2b-adcd-70d9cf7ab129 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:04.822685 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4b48f-5ea9-4c2b-adcd-70d9cf7ab129 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:04.822959 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4b48f-5ea9-4c2b-adcd-70d9cf7ab129 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:04.825738 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:04.861086 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15f100-bcc1-437c-8b77-63bddd3d4019 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:04.903791 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c4adc-ca14-46bf-ba14-59c3db927f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:04.904809 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c4adc-ca14-46bf-ba14-59c3db927f69 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:04.905338 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c4adc-ca14-46bf-ba14-59c3db927f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:04.905815 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c4adc-ca14-46bf-ba14-59c3db927f69 None admin] PATH_INFO: `/v3/projects/01c75d368d814248b8ba862ee53b50dc` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:04.907705 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c4adc-ca14-46bf-ba14-59c3db927f69 None admin] RBAC: Authorizing `identity:get_project(project_id=01c75d368d814248b8ba862ee53b50dc)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:04.909864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c4adc-ca14-46bf-ba14-59c3db927f69 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:04.911829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 51/92] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:04 2022] GET /identity/v3/projects/01c75d368d814248b8ba862ee53b50dc => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:04.912842 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c4adc-ca14-46bf-ba14-59c3db927f69 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:04.972849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4b48f-5ea9-4c2b-adcd-70d9cf7ab129 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:04.974117 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4b48f-5ea9-4c2b-adcd-70d9cf7ab129 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:05.033104 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c4adc-ca14-46bf-ba14-59c3db927f69 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:05.075522 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363edbf-fbd3-438a-a5b2-feaa7230e9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:05.076587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363edbf-fbd3-438a-a5b2-feaa7230e9bf None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:05.077121 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363edbf-fbd3-438a-a5b2-feaa7230e9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:05.077791 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363edbf-fbd3-438a-a5b2-feaa7230e9bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:05.078727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363edbf-fbd3-438a-a5b2-feaa7230e9bf None admin] RBAC: Adding query filter params (role.id=e2095c5a29d74c33b9dcb16f8e5343bf, scope.project.id=01c75d368d814248b8ba862ee53b50dc, user.id=49d550c3e3b54e2aaebfc450900dd727) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:05.079238 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363edbf-fbd3-438a-a5b2-feaa7230e9bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:05.080913 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363edbf-fbd3-438a-a5b2-feaa7230e9bf None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:05.087693 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 52/93] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:17:04 2022] GET /identity/v3/role_assignments?user.id=49d550c3e3b54e2aaebfc450900dd727&scope.project.id=01c75d368d814248b8ba862ee53b50dc&role.id=e2095c5a29d74c33b9dcb16f8e5343bf => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:05.088755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363edbf-fbd3-438a-a5b2-feaa7230e9bf None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:05.105410 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:05.212682 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363edbf-fbd3-438a-a5b2-feaa7230e9bf None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:05.254174 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219914b3-7d3a-4e88-b609-d671e658578d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:05.255144 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219914b3-7d3a-4e88-b609-d671e658578d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:05.256134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219914b3-7d3a-4e88-b609-d671e658578d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:05.256616 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219914b3-7d3a-4e88-b609-d671e658578d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:05.257715 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219914b3-7d3a-4e88-b609-d671e658578d None admin] RBAC: Adding query filter params (role.id=680e2c06ab714158b756dc317a3f4e2e, scope.project.id=01c75d368d814248b8ba862ee53b50dc, user.id=c03490a890814d2db0a221cf0a15aed9) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:05.258264 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219914b3-7d3a-4e88-b609-d671e658578d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:05.260270 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219914b3-7d3a-4e88-b609-d671e658578d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:05.267210 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 53/94] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:17:05 2022] GET /identity/v3/role_assignments?user.id=c03490a890814d2db0a221cf0a15aed9&scope.project.id=01c75d368d814248b8ba862ee53b50dc&role.id=680e2c06ab714158b756dc317a3f4e2e => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:05.273138 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 42/95] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:05.276667 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219914b3-7d3a-4e88-b609-d671e658578d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:05.381527 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:05.416024 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219914b3-7d3a-4e88-b609-d671e658578d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:05.454539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d10ca7-2b98-4b4f-adb3-4bb6c9f19f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:05.455655 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d10ca7-2b98-4b4f-adb3-4bb6c9f19f62 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:05.456142 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d10ca7-2b98-4b4f-adb3-4bb6c9f19f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:05.456661 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d10ca7-2b98-4b4f-adb3-4bb6c9f19f62 None admin] PATH_INFO: `/v3/projects/305d4f01062545a28720e3b6b916af99` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:05.458082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d10ca7-2b98-4b4f-adb3-4bb6c9f19f62 None admin] RBAC: Authorizing `identity:get_project(project_id=305d4f01062545a28720e3b6b916af99)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:05.459845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d10ca7-2b98-4b4f-adb3-4bb6c9f19f62 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:05.461811 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 54/96] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:05 2022] GET /identity/v3/projects/305d4f01062545a28720e3b6b916af99 => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:05.468062 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4b48f-5ea9-4c2b-adcd-70d9cf7ab129 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:05.523966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:05.615822 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4b48f-5ea9-4c2b-adcd-70d9cf7ab129 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:05.651387 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ad4f8-55bf-4cf9-80ee-fc182f64e7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:05.651999 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ad4f8-55bf-4cf9-80ee-fc182f64e7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:05.652282 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ad4f8-55bf-4cf9-80ee-fc182f64e7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:05.652560 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ad4f8-55bf-4cf9-80ee-fc182f64e7d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:05.653320 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ad4f8-55bf-4cf9-80ee-fc182f64e7d1 None admin] RBAC: Adding query filter params (role.id=a463f0ebb5cf4516b0bec345d25071cb, scope.project.id=305d4f01062545a28720e3b6b916af99, user.id=c03490a890814d2db0a221cf0a15aed9) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:05.653694 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ad4f8-55bf-4cf9-80ee-fc182f64e7d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:05.655149 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ad4f8-55bf-4cf9-80ee-fc182f64e7d1 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:05.663615 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 43/97] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:17:05 2022] GET /identity/v3/role_assignments?user.id=c03490a890814d2db0a221cf0a15aed9&scope.project.id=305d4f01062545a28720e3b6b916af99&role.id=a463f0ebb5cf4516b0bec345d25071cb => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:06.786296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c123fee-d43f-485a-9ab4-d4dbe932fa9a None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:06.786296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c123fee-d43f-485a-9ab4-d4dbe932fa9a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:06.786296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c123fee-d43f-485a-9ab4-d4dbe932fa9a None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:06.786296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 55/98] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:06.792115 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d59e0-c25c-4029-9466-a13fe2f6f3ca None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:06.792924 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d59e0-c25c-4029-9466-a13fe2f6f3ca None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:06.793429 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d59e0-c25c-4029-9466-a13fe2f6f3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:06.815186 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-107d59e0-c25c-4029-9466-a13fe2f6f3ca None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:06.816706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-107d59e0-c25c-4029-9466-a13fe2f6f3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:06.886993 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 44/99] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:06.924919 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c123fee-d43f-485a-9ab4-d4dbe932fa9a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:06.964777 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e2186-4166-42f1-a900-bad5a27bc277 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:06.965126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e2186-4166-42f1-a900-bad5a27bc277 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:06.965374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e2186-4166-42f1-a900-bad5a27bc277 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:06.966855 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 45/100] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:06.980744 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28a6b3-bd43-49e6-869f-935da021bc74 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:06.981062 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28a6b3-bd43-49e6-869f-935da021bc74 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:06.981352 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28a6b3-bd43-49e6-869f-935da021bc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:07.012101 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-cb28a6b3-bd43-49e6-869f-935da021bc74 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:07.013348 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-cb28a6b3-bd43-49e6-869f-935da021bc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:07.060934 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:07.135848 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c123fee-d43f-485a-9ab4-d4dbe932fa9a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:07.156606 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 46/101] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 02:17:07.184527 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a5601-15f2-46c8-bcb3-1a4f5bdbf612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:07.185211 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a5601-15f2-46c8-bcb3-1a4f5bdbf612 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:07.185494 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a5601-15f2-46c8-bcb3-1a4f5bdbf612 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:07.185769 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a5601-15f2-46c8-bcb3-1a4f5bdbf612 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:07.189156 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:07.194295 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28a6b3-bd43-49e6-869f-935da021bc74 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:07.202911 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a5601-15f2-46c8-bcb3-1a4f5bdbf612 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:07.208248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-722a5601-15f2-46c8-bcb3-1a4f5bdbf612 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:07.208248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:07.208248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:07.208248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:07.208248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:07.208248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:07.208248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:07.208248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:07.208248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:07.208248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:07.208248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:07.208248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:07.208248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:07.208248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:07.208248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:07.208248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:07.209102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:07.209102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:07.209102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:07.209102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:07.209102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:07.209102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:07.209102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:07.209102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:07.209102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:07.209102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:07.209102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:07.209102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:07.209102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:07.209102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:07.209102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:07.209102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:07.209839 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:07.209839 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:07.209839 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:07.209839 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:07.209839 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:07.209839 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:07.209839 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:07.209839 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:07.209839 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:07.209839 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:07.209839 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:07.209839 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:07.209839 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 56/102] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:07.216932 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a5601-15f2-46c8-bcb3-1a4f5bdbf612 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:07.335758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a5601-15f2-46c8-bcb3-1a4f5bdbf612 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:07.380978 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4b954-4246-4bf6-9f4f-e996223ee5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:07.381614 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4b954-4246-4bf6-9f4f-e996223ee5ba None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:07.381899 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4b954-4246-4bf6-9f4f-e996223ee5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:07.382177 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4b954-4246-4bf6-9f4f-e996223ee5ba None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:07.383484 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4b954-4246-4bf6-9f4f-e996223ee5ba None admin] RBAC: Adding query filter params (name=member) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:07.383796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4b954-4246-4bf6-9f4f-e996223ee5ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:07.387545 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4b954-4246-4bf6-9f4f-e996223ee5ba None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:07.404480 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 57/103] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:17:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:07.411975 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4b954-4246-4bf6-9f4f-e996223ee5ba None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:07.431186 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28a6b3-bd43-49e6-869f-935da021bc74 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:07.519263 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a14279-2d99-40bf-a117-bfb8f011bc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:07.520273 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a14279-2d99-40bf-a117-bfb8f011bc99 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:07.520562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a14279-2d99-40bf-a117-bfb8f011bc99 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:07.521003 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a14279-2d99-40bf-a117-bfb8f011bc99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:07.524666 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a14279-2d99-40bf-a117-bfb8f011bc99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:07.526384 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a14279-2d99-40bf-a117-bfb8f011bc99 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:07.528225 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 47/104] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:17:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:07.534732 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a14279-2d99-40bf-a117-bfb8f011bc99 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:07.545390 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:07.562146 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:07.644213 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a14279-2d99-40bf-a117-bfb8f011bc99 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:07.667910 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4b954-4246-4bf6-9f4f-e996223ee5ba None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:07.678763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372a793-fc40-4cb1-b72d-746429de20da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:07.679915 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372a793-fc40-4cb1-b72d-746429de20da None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:07.680210 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372a793-fc40-4cb1-b72d-746429de20da None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:07.680492 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372a793-fc40-4cb1-b72d-746429de20da None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:07.681191 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372a793-fc40-4cb1-b72d-746429de20da None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:07.682808 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372a793-fc40-4cb1-b72d-746429de20da None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:07.725453 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 48/105] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 9 02:17:07 2022] POST /identity/v3/projects => generated 302 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:17:07.727534 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f538cc5-6d95-4342-8476-0d90f460d2e1 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:07.727831 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f538cc5-6d95-4342-8476-0d90f460d2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:07.728105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f538cc5-6d95-4342-8476-0d90f460d2e1 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:07.729495 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 49/106] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:07.734289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5633c1a-fba2-4f16-be97-7f40cad0c9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:07.734940 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5633c1a-fba2-4f16-be97-7f40cad0c9be None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:07.735222 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5633c1a-fba2-4f16-be97-7f40cad0c9be None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:07.735597 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5633c1a-fba2-4f16-be97-7f40cad0c9be None admin] PATH_INFO: `/v3/users/c03490a890814d2db0a221cf0a15aed9` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:07.736994 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5633c1a-fba2-4f16-be97-7f40cad0c9be None admin] RBAC: Authorizing `identity:get_user(user_id=c03490a890814d2db0a221cf0a15aed9)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:07.738415 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476153cd-b1f9-4aa9-8ae3-eb0907a62bd4 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:07.738690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476153cd-b1f9-4aa9-8ae3-eb0907a62bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:07.739049 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476153cd-b1f9-4aa9-8ae3-eb0907a62bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:07.745451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5633c1a-fba2-4f16-be97-7f40cad0c9be None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:07.748605 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 58/107] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:07 2022] GET /identity/v3/users/c03490a890814d2db0a221cf0a15aed9 => generated 275 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:07.754819 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5633c1a-fba2-4f16-be97-7f40cad0c9be None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:07.774563 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-476153cd-b1f9-4aa9-8ae3-eb0907a62bd4 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:07.775802 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-476153cd-b1f9-4aa9-8ae3-eb0907a62bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:07.935334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 50/108] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 02:17:07.953556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5633c1a-fba2-4f16-be97-7f40cad0c9be None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:07.986717 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476153cd-b1f9-4aa9-8ae3-eb0907a62bd4 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:08.001403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:08.005348 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:08.028242 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5187296-b7d8-4567-9fbb-c76e071d8804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:08.030464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5187296-b7d8-4567-9fbb-c76e071d8804 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:08.030950 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5187296-b7d8-4567-9fbb-c76e071d8804 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:08.032401 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5187296-b7d8-4567-9fbb-c76e071d8804 None admin] PATH_INFO: `/v3/projects/01c75d368d814248b8ba862ee53b50dc` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:08.034491 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5187296-b7d8-4567-9fbb-c76e071d8804 None admin] RBAC: Authorizing `identity:get_project(project_id=01c75d368d814248b8ba862ee53b50dc)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:08.039290 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5187296-b7d8-4567-9fbb-c76e071d8804 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:08.041978 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 59/109] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:07 2022] GET /identity/v3/projects/01c75d368d814248b8ba862ee53b50dc => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:08.048434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5187296-b7d8-4567-9fbb-c76e071d8804 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:08.136902 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476153cd-b1f9-4aa9-8ae3-eb0907a62bd4 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:08.169304 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5187296-b7d8-4567-9fbb-c76e071d8804 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:08.180578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca79023-a165-4caf-88e7-ec860f02b7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:08.181259 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca79023-a165-4caf-88e7-ec860f02b7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:08.181544 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca79023-a165-4caf-88e7-ec860f02b7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:08.182246 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca79023-a165-4caf-88e7-ec860f02b7a6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:08.195760 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca79023-a165-4caf-88e7-ec860f02b7a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:08.202164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-cca79023-a165-4caf-88e7-ec860f02b7a6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 02:17:08.202164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:08.202164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:08.202164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:08.202164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:08.202164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:08.202164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:08.202164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:08.202164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:08.202164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:08.202164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:08.202164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:08.202164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:08.202164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:08.202164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:08.202164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:08.203228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:08.203228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:08.203228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:08.203228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:08.203228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:08.203228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:08.203228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:08.203228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:08.203228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:08.203228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:08.203228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:08.203228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:08.203228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:08.203228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:08.203228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:08.203228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:08.204163 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:08.204163 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:08.204163 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:08.204163 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:08.204163 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:08.204163 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:08.204163 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:08.204163 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:08.204163 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:08.204163 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:08.204163 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 02:17:08.204163 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:08.207239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 51/110] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:08.209186 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3bda0-63b8-4079-af2f-fde1e323042c None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:08.209661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3bda0-63b8-4079-af2f-fde1e323042c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:08.210121 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3bda0-63b8-4079-af2f-fde1e323042c None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:08.211072 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae414aa-1b4d-4a13-bf77-6f8260250e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:08.211830 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae414aa-1b4d-4a13-bf77-6f8260250e4c None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:08.212114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 52/111] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:08.212552 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae414aa-1b4d-4a13-bf77-6f8260250e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:08.212931 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae414aa-1b4d-4a13-bf77-6f8260250e4c None admin] PATH_INFO: `/v3/projects/01c75d368d814248b8ba862ee53b50dc/users/c03490a890814d2db0a221cf0a15aed9/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:08.213443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3bda0-63b8-4079-af2f-fde1e323042c None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:08.220072 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae414aa-1b4d-4a13-bf77-6f8260250e4c None admin] RBAC: Authorizing `identity:create_grant(project_id=01c75d368d814248b8ba862ee53b50dc, user_id=c03490a890814d2db0a221cf0a15aed9, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:08.221777 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae414aa-1b4d-4a13-bf77-6f8260250e4c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:08.239559 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 60/112] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 9 02:17:08 2022] PUT /identity/v3/projects/01c75d368d814248b8ba862ee53b50dc/users/c03490a890814d2db0a221cf0a15aed9/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:17:08.244740 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068618d-a695-49df-b2ca-29905a4a1c5a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:08.245212 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068618d-a695-49df-b2ca-29905a4a1c5a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:08.245574 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068618d-a695-49df-b2ca-29905a4a1c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:08.282331 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-1068618d-a695-49df-b2ca-29905a4a1c5a None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:08.283699 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1068618d-a695-49df-b2ca-29905a4a1c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:08.301486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:08.350801 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3bda0-63b8-4079-af2f-fde1e323042c None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:08.367596 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:08.406316 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb34a60-a01e-4a50-a345-886f33b35f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:08.406949 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb34a60-a01e-4a50-a345-886f33b35f12 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:08.407233 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb34a60-a01e-4a50-a345-886f33b35f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:08.407601 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb34a60-a01e-4a50-a345-886f33b35f12 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:08.408303 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb34a60-a01e-4a50-a345-886f33b35f12 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:08.408678 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb34a60-a01e-4a50-a345-886f33b35f12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:08.410177 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb34a60-a01e-4a50-a345-886f33b35f12 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:08.410663 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 61/113] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:08.419636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 53/114] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:17:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:08.424872 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068618d-a695-49df-b2ca-29905a4a1c5a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:08.453077 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb34a60-a01e-4a50-a345-886f33b35f12 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:08.607371 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068618d-a695-49df-b2ca-29905a4a1c5a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:08.647829 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb34a60-a01e-4a50-a345-886f33b35f12 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:08.679902 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:08.689223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add3dea-ec61-407c-a450-0618445cc897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:08.689863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add3dea-ec61-407c-a450-0618445cc897 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:08.690148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add3dea-ec61-407c-a450-0618445cc897 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:08.690442 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add3dea-ec61-407c-a450-0618445cc897 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:08.702344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add3dea-ec61-407c-a450-0618445cc897 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:08.703346 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c601784-074d-46eb-a729-a12f8d0bb9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:08.704236 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c601784-074d-46eb-a729-a12f8d0bb9db None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:08.704711 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c601784-074d-46eb-a729-a12f8d0bb9db None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:08.705205 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c601784-074d-46eb-a729-a12f8d0bb9db None admin] PATH_INFO: `/v3/users/047b78a23d3c4a288698b9f5c35996a5` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:08.707608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-5add3dea-ec61-407c-a450-0618445cc897 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 02:17:08.707608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:08.707608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:08.707608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:08.707608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:08.707608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:08.707608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:08.707608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:08.707608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:08.707608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:08.707608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:08.707608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:08.707608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:08.707608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:08.707608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:08.707608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:08.708414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:08.708414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:08.708414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:08.708414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:08.708414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:08.708414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:08.708414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:08.708414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:08.708414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:08.708414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:08.708414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:08.708414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:08.708414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:08.708414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:08.708414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:08.708414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:08.709577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:08.709577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:08.709577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:08.709577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:08.709577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:08.709577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:08.709577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:08.709577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:08.709577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:08.709577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:08.709577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 02:17:08.709577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:08.709577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 54/115] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 9 02:17:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:17:08.714802 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add3dea-ec61-407c-a450-0618445cc897 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:08.728871 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c601784-074d-46eb-a729-a12f8d0bb9db None admin] RBAC: Authorizing `identity:get_user(user_id=047b78a23d3c4a288698b9f5c35996a5)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:08.730693 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c601784-074d-46eb-a729-a12f8d0bb9db None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:08.732575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 62/116] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:08 2022] GET /identity/v3/users/047b78a23d3c4a288698b9f5c35996a5 => generated 289 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:08.737389 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7faf70-24db-43c9-bc7c-21dff104e0ce None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:08.737981 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7faf70-24db-43c9-bc7c-21dff104e0ce None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:08.738481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7faf70-24db-43c9-bc7c-21dff104e0ce None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:08.739955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 63/117] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:08.740915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7faf70-24db-43c9-bc7c-21dff104e0ce None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:08.822579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add3dea-ec61-407c-a450-0618445cc897 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:08.847086 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:08.860199 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fa9d8-60dd-45d5-9b02-15433aa05a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:08.860828 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fa9d8-60dd-45d5-9b02-15433aa05a88 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:08.861138 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fa9d8-60dd-45d5-9b02-15433aa05a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:08.861415 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fa9d8-60dd-45d5-9b02-15433aa05a88 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:08.862145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84fa9d8-60dd-45d5-9b02-15433aa05a88 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:08.862461 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84fa9d8-60dd-45d5-9b02-15433aa05a88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:08.864094 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84fa9d8-60dd-45d5-9b02-15433aa05a88 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:08.874444 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 55/118] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:17:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:08.875889 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81ca2b-d63f-45e7-9630-206f31ac39f6 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:08.876181 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81ca2b-d63f-45e7-9630-206f31ac39f6 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:08.876459 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81ca2b-d63f-45e7-9630-206f31ac39f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:08.898877 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-1b81ca2b-d63f-45e7-9630-206f31ac39f6 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:08.900083 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1b81ca2b-d63f-45e7-9630-206f31ac39f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:08.914176 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7faf70-24db-43c9-bc7c-21dff104e0ce None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:08.954000 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:08.961193 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30afd7c-da2f-441f-bfb0-7d92a8c805c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:08.962365 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30afd7c-da2f-441f-bfb0-7d92a8c805c1 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:08.963367 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30afd7c-da2f-441f-bfb0-7d92a8c805c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:08.963862 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30afd7c-da2f-441f-bfb0-7d92a8c805c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:08.982254 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 56/119] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:08.983065 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cab81c-c2a5-4b6c-9b54-5da5a95e14c9 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:08.983352 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cab81c-c2a5-4b6c-9b54-5da5a95e14c9 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:08.983681 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cab81c-c2a5-4b6c-9b54-5da5a95e14c9 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:08.985421 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 57/120] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:08.986383 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cab81c-c2a5-4b6c-9b54-5da5a95e14c9 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:09.061193 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30afd7c-da2f-441f-bfb0-7d92a8c805c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:09.062958 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30afd7c-da2f-441f-bfb0-7d92a8c805c1 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:09.117169 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:09.132823 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cab81c-c2a5-4b6c-9b54-5da5a95e14c9 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:09.170874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158be7d1-0e83-4d9a-a049-68d81ad93303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:09.171583 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158be7d1-0e83-4d9a-a049-68d81ad93303 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:09.171792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158be7d1-0e83-4d9a-a049-68d81ad93303 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:09.172069 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158be7d1-0e83-4d9a-a049-68d81ad93303 None admin] PATH_INFO: `/v3/users/c03490a890814d2db0a221cf0a15aed9` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:09.173288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158be7d1-0e83-4d9a-a049-68d81ad93303 None admin] RBAC: Authorizing `identity:get_user(user_id=c03490a890814d2db0a221cf0a15aed9)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:09.175049 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158be7d1-0e83-4d9a-a049-68d81ad93303 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:09.177083 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 58/121] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:08 2022] GET /identity/v3/users/c03490a890814d2db0a221cf0a15aed9 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:09.182792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaaa5a-c914-4fae-92ae-f32adc657756 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:09.183081 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaaa5a-c914-4fae-92ae-f32adc657756 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:09.183359 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aaaa5a-c914-4fae-92ae-f32adc657756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:09.185786 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 64/122] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:09.190847 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30afd7c-da2f-441f-bfb0-7d92a8c805c1 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:09.207114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-75aaaa5a-c914-4fae-92ae-f32adc657756 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:09.208174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-75aaaa5a-c914-4fae-92ae-f32adc657756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:09.255496 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:09.283436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 59/123] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:09.284414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aaaa5a-c914-4fae-92ae-f32adc657756 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:09.304543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30afd7c-da2f-441f-bfb0-7d92a8c805c1 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:09.344681 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1506b-0daa-45b2-be35-9646fc02b68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:09.345794 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1506b-0daa-45b2-be35-9646fc02b68f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:09.346318 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1506b-0daa-45b2-be35-9646fc02b68f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:09.346843 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1506b-0daa-45b2-be35-9646fc02b68f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:09.356381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:09.360035 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1506b-0daa-45b2-be35-9646fc02b68f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:09.365751 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-3fd1506b-0daa-45b2-be35-9646fc02b68f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:09.365751 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:09.365751 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:09.365751 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:09.365751 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:09.365751 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:09.365751 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:09.365751 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:09.365751 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:09.365751 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:09.365751 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:09.365751 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:09.365751 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:09.365751 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:09.365751 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:09.365751 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:09.366595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:09.366595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:09.366595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:09.366595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:09.366595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:09.366595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:09.366595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:09.366595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:09.366595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:09.366595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:09.366595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:09.366595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:09.366595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:09.366595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:09.366595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:09.366595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:09.367567 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:09.367567 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:09.367567 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:09.367567 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:09.367567 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:09.367567 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:09.367567 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:09.367567 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:09.367567 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:09.367567 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:09.367567 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:09.367567 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:09.370188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 65/124] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:09.376341 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1506b-0daa-45b2-be35-9646fc02b68f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:09.402606 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aaaa5a-c914-4fae-92ae-f32adc657756 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:09.439800 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5025d51-616b-4f35-89ef-b18046454ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:09.441000 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5025d51-616b-4f35-89ef-b18046454ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:09.441329 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5025d51-616b-4f35-89ef-b18046454ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:09.441819 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5025d51-616b-4f35-89ef-b18046454ea3 None admin] PATH_INFO: `/v3/projects/01c75d368d814248b8ba862ee53b50dc` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:09.443144 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5025d51-616b-4f35-89ef-b18046454ea3 None admin] RBAC: Authorizing `identity:get_project(project_id=01c75d368d814248b8ba862ee53b50dc)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:09.444813 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5025d51-616b-4f35-89ef-b18046454ea3 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:09.446669 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 60/125] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:09 2022] GET /identity/v3/projects/01c75d368d814248b8ba862ee53b50dc => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:09.451962 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5025d51-616b-4f35-89ef-b18046454ea3 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:09.497054 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1506b-0daa-45b2-be35-9646fc02b68f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:09.504911 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:09.541383 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6672f-16f5-4e16-ab34-6f834f9175a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:09.542550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6672f-16f5-4e16-ab34-6f834f9175a6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:09.542842 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6672f-16f5-4e16-ab34-6f834f9175a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:09.543117 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6672f-16f5-4e16-ab34-6f834f9175a6 None admin] PATH_INFO: `/v3/projects/01c75d368d814248b8ba862ee53b50dc` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:09.544314 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6672f-16f5-4e16-ab34-6f834f9175a6 None admin] RBAC: Authorizing `identity:get_project(project_id=01c75d368d814248b8ba862ee53b50dc)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:09.546258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6672f-16f5-4e16-ab34-6f834f9175a6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:09.548547 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 66/126] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:09 2022] GET /identity/v3/projects/01c75d368d814248b8ba862ee53b50dc => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:09.549517 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6672f-16f5-4e16-ab34-6f834f9175a6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:09.576557 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5025d51-616b-4f35-89ef-b18046454ea3 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:09.613841 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ee50b-d467-43f4-a806-b573e1b40e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:09.614505 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ee50b-d467-43f4-a806-b573e1b40e89 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:09.614788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ee50b-d467-43f4-a806-b573e1b40e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:09.615059 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ee50b-d467-43f4-a806-b573e1b40e89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:09.626925 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ee50b-d467-43f4-a806-b573e1b40e89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:09.631619 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-194ee50b-d467-43f4-a806-b573e1b40e89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:17:09.631619 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:09.631619 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:09.631619 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:09.631619 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:09.631619 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:09.631619 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:09.631619 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:09.631619 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:09.631619 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:09.631619 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:09.631619 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:09.631619 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:09.631619 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:09.631619 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:09.631619 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:09.632996 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:09.632996 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:09.632996 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:09.632996 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:09.632996 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:09.632996 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:09.632996 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:09.632996 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:09.632996 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:09.632996 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:09.632996 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:09.632996 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:09.632996 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:09.632996 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:09.632996 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:09.632996 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:09.634223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:09.634223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:09.634223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:09.634223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:09.634223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:09.634223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:09.634223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:09.634223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:09.634223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:09.634223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:09.634223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:17:09.634223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:09.634223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 61/127] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:17:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:09.637382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:09.638789 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ee50b-d467-43f4-a806-b573e1b40e89 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:09.681324 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6672f-16f5-4e16-ab34-6f834f9175a6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:09.726226 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab97694-6c72-4680-8929-0dedfa3abecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:09.726849 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab97694-6c72-4680-8929-0dedfa3abecc None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:09.727133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab97694-6c72-4680-8929-0dedfa3abecc None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:09.727410 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab97694-6c72-4680-8929-0dedfa3abecc None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:09.728448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab97694-6c72-4680-8929-0dedfa3abecc None admin] RBAC: Adding query filter params (name=member) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:09.728760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab97694-6c72-4680-8929-0dedfa3abecc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:09.730785 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab97694-6c72-4680-8929-0dedfa3abecc None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:09.742689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 67/128] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:17:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:09.743888 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab97694-6c72-4680-8929-0dedfa3abecc None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:09.753546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ee50b-d467-43f4-a806-b573e1b40e89 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:09.792206 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:09.796732 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510a88c-4724-4691-b915-d9ef53ba0ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:09.797845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510a88c-4724-4691-b915-d9ef53ba0ad8 None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:09.798225 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510a88c-4724-4691-b915-d9ef53ba0ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:09.798578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510a88c-4724-4691-b915-d9ef53ba0ad8 None admin] PATH_INFO: `/v3/projects/01c75d368d814248b8ba862ee53b50dc/users/c03490a890814d2db0a221cf0a15aed9/roles/680e2c06ab714158b756dc317a3f4e2e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:09.801509 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510a88c-4724-4691-b915-d9ef53ba0ad8 None admin] RBAC: Authorizing `identity:create_grant(project_id=01c75d368d814248b8ba862ee53b50dc, user_id=c03490a890814d2db0a221cf0a15aed9, role_id=680e2c06ab714158b756dc317a3f4e2e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:09.803512 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510a88c-4724-4691-b915-d9ef53ba0ad8 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:09.824761 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 62/129] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 9 02:17:09 2022] PUT /identity/v3/projects/01c75d368d814248b8ba862ee53b50dc/users/c03490a890814d2db0a221cf0a15aed9/roles/680e2c06ab714158b756dc317a3f4e2e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:17:09.826260 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510a88c-4724-4691-b915-d9ef53ba0ad8 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:09.911808 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab97694-6c72-4680-8929-0dedfa3abecc None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:09.984216 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:09.996987 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e858ba7-03ea-4a6a-8069-831342f867bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:09.997672 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e858ba7-03ea-4a6a-8069-831342f867bc None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:09.997957 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e858ba7-03ea-4a6a-8069-831342f867bc None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:09.998229 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e858ba7-03ea-4a6a-8069-831342f867bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:09.999058 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e858ba7-03ea-4a6a-8069-831342f867bc None admin] RBAC: Adding query filter params (role.id=61e3cf9f4de64b22b7254b339eab813b, scope.project.id=01c75d368d814248b8ba862ee53b50dc, user.id=047b78a23d3c4a288698b9f5c35996a5) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:09.999372 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e858ba7-03ea-4a6a-8069-831342f867bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:10.000845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e858ba7-03ea-4a6a-8069-831342f867bc None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:10.010266 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 68/130] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:17:09 2022] GET /identity/v3/role_assignments?user.id=047b78a23d3c4a288698b9f5c35996a5&scope.project.id=01c75d368d814248b8ba862ee53b50dc&role.id=61e3cf9f4de64b22b7254b339eab813b => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:10.010907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e858ba7-03ea-4a6a-8069-831342f867bc None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:10.027205 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510a88c-4724-4691-b915-d9ef53ba0ad8 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:10.070727 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb52da-0486-47b8-a9ad-ab4c9050fa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:10.071412 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb52da-0486-47b8-a9ad-ab4c9050fa60 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:10.071699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb52da-0486-47b8-a9ad-ab4c9050fa60 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:10.071976 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb52da-0486-47b8-a9ad-ab4c9050fa60 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:10.072760 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb52da-0486-47b8-a9ad-ab4c9050fa60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:10.073095 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb52da-0486-47b8-a9ad-ab4c9050fa60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:10.074507 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb52da-0486-47b8-a9ad-ab4c9050fa60 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:10.084540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 63/131] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:10.095304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb52da-0486-47b8-a9ad-ab4c9050fa60 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:10.162106 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:10.179723 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e858ba7-03ea-4a6a-8069-831342f867bc None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:10.273453 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b8a6b-e95e-4269-a281-3ee02334c25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:10.274021 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b8a6b-e95e-4269-a281-3ee02334c25f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:10.274300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b8a6b-e95e-4269-a281-3ee02334c25f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:10.274572 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b8a6b-e95e-4269-a281-3ee02334c25f None admin] PATH_INFO: `/v3/users/c03490a890814d2db0a221cf0a15aed9` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:10.275840 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b8a6b-e95e-4269-a281-3ee02334c25f None admin] RBAC: Authorizing `identity:get_user(user_id=c03490a890814d2db0a221cf0a15aed9)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:10.277325 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b8a6b-e95e-4269-a281-3ee02334c25f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:10.278912 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 69/132] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:10 2022] GET /identity/v3/users/c03490a890814d2db0a221cf0a15aed9 => generated 275 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:10.284606 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b8a6b-e95e-4269-a281-3ee02334c25f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:10.309320 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb52da-0486-47b8-a9ad-ab4c9050fa60 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:10.387330 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:10.387651 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87e16d-e0c2-4124-8fd1-268b7ad11724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:10.388009 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87e16d-e0c2-4124-8fd1-268b7ad11724 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:10.388301 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87e16d-e0c2-4124-8fd1-268b7ad11724 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:10.388572 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87e16d-e0c2-4124-8fd1-268b7ad11724 None admin] PATH_INFO: `/v3/users/49d550c3e3b54e2aaebfc450900dd727` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:10.392644 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87e16d-e0c2-4124-8fd1-268b7ad11724 None admin] RBAC: Authorizing `identity:get_user(user_id=49d550c3e3b54e2aaebfc450900dd727)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:10.394146 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87e16d-e0c2-4124-8fd1-268b7ad11724 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:10.396056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 64/133] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:10 2022] GET /identity/v3/users/49d550c3e3b54e2aaebfc450900dd727 => generated 247 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:10.403373 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87e16d-e0c2-4124-8fd1-268b7ad11724 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:10.433191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b8a6b-e95e-4269-a281-3ee02334c25f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:10.467778 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c9c02-b8db-4e3c-a6b7-b5faaf38b4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:10.468425 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c9c02-b8db-4e3c-a6b7-b5faaf38b4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:10.468714 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c9c02-b8db-4e3c-a6b7-b5faaf38b4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:10.468999 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c9c02-b8db-4e3c-a6b7-b5faaf38b4e7 None admin] PATH_INFO: `/v3/projects/305d4f01062545a28720e3b6b916af99` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:10.470192 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c9c02-b8db-4e3c-a6b7-b5faaf38b4e7 None admin] RBAC: Authorizing `identity:get_project(project_id=305d4f01062545a28720e3b6b916af99)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:10.471666 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c9c02-b8db-4e3c-a6b7-b5faaf38b4e7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:10.473341 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 70/134] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:10 2022] GET /identity/v3/projects/305d4f01062545a28720e3b6b916af99 => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:10.479786 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c9c02-b8db-4e3c-a6b7-b5faaf38b4e7 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:10.593918 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c9c02-b8db-4e3c-a6b7-b5faaf38b4e7 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:10.608980 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:10.625135 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87e16d-e0c2-4124-8fd1-268b7ad11724 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:10.629370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:10.633684 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb6816-af74-4a2c-85ec-28f64ff262a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:10.634373 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb6816-af74-4a2c-85ec-28f64ff262a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:10.634660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb6816-af74-4a2c-85ec-28f64ff262a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:10.634943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb6816-af74-4a2c-85ec-28f64ff262a8 None admin] PATH_INFO: `/v3/projects/305d4f01062545a28720e3b6b916af99/users/c03490a890814d2db0a221cf0a15aed9/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:10.636912 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb6816-af74-4a2c-85ec-28f64ff262a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=305d4f01062545a28720e3b6b916af99, user_id=c03490a890814d2db0a221cf0a15aed9, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:10.638423 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb6816-af74-4a2c-85ec-28f64ff262a8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:10.659869 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 71/135] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 9 02:17:10 2022] PUT /identity/v3/projects/305d4f01062545a28720e3b6b916af99/users/c03490a890814d2db0a221cf0a15aed9/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:17:10.661629 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6c8ba-430c-4449-b0e0-332f7fc52f38 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:10.661790 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6c8ba-430c-4449-b0e0-332f7fc52f38 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:10.662130 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6c8ba-430c-4449-b0e0-332f7fc52f38 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:10.663465 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 72/136] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:10.669537 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc0bc0-3f8d-4927-9680-a0cb2e9eeb73 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:10.669822 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc0bc0-3f8d-4927-9680-a0cb2e9eeb73 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:10.670157 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc0bc0-3f8d-4927-9680-a0cb2e9eeb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:10.693461 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-bedc0bc0-3f8d-4927-9680-a0cb2e9eeb73 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:10.695387 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bedc0bc0-3f8d-4927-9680-a0cb2e9eeb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:10.710966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b6b56-48ff-4b13-a860-6f34b3a3a0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:10.711691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b6b56-48ff-4b13-a860-6f34b3a3a0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:10.711974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b6b56-48ff-4b13-a860-6f34b3a3a0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:10.712248 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b6b56-48ff-4b13-a860-6f34b3a3a0b4 None admin] PATH_INFO: `/v3/projects/01c75d368d814248b8ba862ee53b50dc` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:10.713586 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b6b56-48ff-4b13-a860-6f34b3a3a0b4 None admin] RBAC: Authorizing `identity:get_project(project_id=01c75d368d814248b8ba862ee53b50dc)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:10.715263 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b6b56-48ff-4b13-a860-6f34b3a3a0b4 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:10.717101 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 65/137] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:10 2022] GET /identity/v3/projects/01c75d368d814248b8ba862ee53b50dc => generated 298 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:10.718390 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87f546-a6df-46e0-85fc-444dc682ecb0 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:10.718674 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87f546-a6df-46e0-85fc-444dc682ecb0 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:10.718950 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87f546-a6df-46e0-85fc-444dc682ecb0 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:10.720889 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 66/138] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:10.727604 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87f546-a6df-46e0-85fc-444dc682ecb0 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:10.862619 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87f546-a6df-46e0-85fc-444dc682ecb0 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:10.872342 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 73/139] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 02:17:10.874552 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a051b-0dd0-45c7-802e-6ad249578681 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:10.875062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a051b-0dd0-45c7-802e-6ad249578681 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:10.875985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a051b-0dd0-45c7-802e-6ad249578681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:10.899177 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-0d2a051b-0dd0-45c7-802e-6ad249578681 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:10.900778 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0d2a051b-0dd0-45c7-802e-6ad249578681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:10.906815 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e990b6-c22d-4a2a-aef0-5ec482a136a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:10.906815 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e990b6-c22d-4a2a-aef0-5ec482a136a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:10.906815 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e990b6-c22d-4a2a-aef0-5ec482a136a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:10.906815 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e990b6-c22d-4a2a-aef0-5ec482a136a8 None admin] PATH_INFO: `/v3/projects/01c75d368d814248b8ba862ee53b50dc/users/49d550c3e3b54e2aaebfc450900dd727/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:10.909046 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e990b6-c22d-4a2a-aef0-5ec482a136a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=01c75d368d814248b8ba862ee53b50dc, user_id=49d550c3e3b54e2aaebfc450900dd727, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:10.910522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e990b6-c22d-4a2a-aef0-5ec482a136a8 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:10.932395 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 67/140] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 9 02:17:10 2022] PUT /identity/v3/projects/01c75d368d814248b8ba862ee53b50dc/users/49d550c3e3b54e2aaebfc450900dd727/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:17:10.941055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e990b6-c22d-4a2a-aef0-5ec482a136a8 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:10.981749 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:11.025271 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 74/141] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:11.063174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e990b6-c22d-4a2a-aef0-5ec482a136a8 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:11.069046 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a051b-0dd0-45c7-802e-6ad249578681 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:11.107628 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef1ac3-3eb1-4c90-9d3e-6e303cd0ca44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:11.108291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef1ac3-3eb1-4c90-9d3e-6e303cd0ca44 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:11.108578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef1ac3-3eb1-4c90-9d3e-6e303cd0ca44 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:11.108860 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef1ac3-3eb1-4c90-9d3e-6e303cd0ca44 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:11.112173 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef1ac3-3eb1-4c90-9d3e-6e303cd0ca44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:11.114628 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef1ac3-3eb1-4c90-9d3e-6e303cd0ca44 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:11.116259 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 68/142] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:17:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:11.122643 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef1ac3-3eb1-4c90-9d3e-6e303cd0ca44 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:11.178789 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:11.241817 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a051b-0dd0-45c7-802e-6ad249578681 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:11.261591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:11.267550 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef1ac3-3eb1-4c90-9d3e-6e303cd0ca44 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:11.301718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900fe2a-00ae-48ba-b3eb-5e8a52367746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:11.302724 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900fe2a-00ae-48ba-b3eb-5e8a52367746 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:11.303204 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900fe2a-00ae-48ba-b3eb-5e8a52367746 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:11.303751 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900fe2a-00ae-48ba-b3eb-5e8a52367746 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:11.304189 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc58bb6-0d2e-4e55-b1ef-bbc5f664a1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:11.305046 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc58bb6-0d2e-4e55-b1ef-bbc5f664a1cf None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:11.305510 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc58bb6-0d2e-4e55-b1ef-bbc5f664a1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:11.305868 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc58bb6-0d2e-4e55-b1ef-bbc5f664a1cf None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:11.306604 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc58bb6-0d2e-4e55-b1ef-bbc5f664a1cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:11.308371 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc58bb6-0d2e-4e55-b1ef-bbc5f664a1cf None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:11.325708 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4900fe2a-00ae-48ba-b3eb-5e8a52367746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:11.337158 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 69/143] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 9 02:17:11 2022] POST /identity/v3/users => generated 283 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:17:11.339405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-4900fe2a-00ae-48ba-b3eb-5e8a52367746 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:11.339405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:11.339405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:11.339405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:11.339405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:11.339405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:11.339405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:11.339405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:11.339405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:11.339405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:11.339405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:11.339405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:11.339405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:11.339405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:11.339405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:11.339405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:11.340267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:11.340267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:11.340267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:11.340267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:11.340267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:11.340267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:11.340267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:11.340267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:11.340267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:11.340267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:11.340267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:11.340267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:11.340267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:11.340267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:11.340267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:11.340267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:11.341064 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:11.341064 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:11.341064 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:11.341064 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:11.341064 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:11.341064 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:11.341064 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:11.341064 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:11.341064 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:11.341064 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:11.341064 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:11.341064 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:11.341064 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 75/144] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:17:11.347099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc58bb6-0d2e-4e55-b1ef-bbc5f664a1cf None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:11.458249 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc58bb6-0d2e-4e55-b1ef-bbc5f664a1cf None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:11.497202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538740e-c676-4904-b006-1ea708a173ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:11.497990 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538740e-c676-4904-b006-1ea708a173ba None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:11.498280 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538740e-c676-4904-b006-1ea708a173ba None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:11.498562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538740e-c676-4904-b006-1ea708a173ba None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:11.499316 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538740e-c676-4904-b006-1ea708a173ba None admin] RBAC: Adding query filter params (name=member) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:11.499680 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538740e-c676-4904-b006-1ea708a173ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:11.501163 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538740e-c676-4904-b006-1ea708a173ba None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:11.511519 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 70/145] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:17:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:11.517460 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900fe2a-00ae-48ba-b3eb-5e8a52367746 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:11.629290 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900fe2a-00ae-48ba-b3eb-5e8a52367746 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:11.645875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:11.673423 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a01c10-729e-494f-9f52-7d0def0f3ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:11.674065 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a01c10-729e-494f-9f52-7d0def0f3ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:11.674344 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a01c10-729e-494f-9f52-7d0def0f3ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:11.674671 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a01c10-729e-494f-9f52-7d0def0f3ff5 None admin] PATH_INFO: `/v3/users/c03490a890814d2db0a221cf0a15aed9` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:11.675867 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a01c10-729e-494f-9f52-7d0def0f3ff5 None admin] RBAC: Authorizing `identity:get_user(user_id=c03490a890814d2db0a221cf0a15aed9)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:11.677418 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a01c10-729e-494f-9f52-7d0def0f3ff5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:11.679058 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 76/146] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:11 2022] GET /identity/v3/users/c03490a890814d2db0a221cf0a15aed9 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:11.685218 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538740e-c676-4904-b006-1ea708a173ba None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:11.711131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:11.790482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538740e-c676-4904-b006-1ea708a173ba None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:11.827162 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd157a6-31bb-4b13-aafd-e161abe15849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:11.827774 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd157a6-31bb-4b13-aafd-e161abe15849 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:11.828059 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd157a6-31bb-4b13-aafd-e161abe15849 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:11.828329 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd157a6-31bb-4b13-aafd-e161abe15849 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:11.899473 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd157a6-31bb-4b13-aafd-e161abe15849 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:11.901010 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd157a6-31bb-4b13-aafd-e161abe15849 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:11.912758 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:12.007987 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 71/147] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:12.013727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a01c10-729e-494f-9f52-7d0def0f3ff5 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:12.120169 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a01c10-729e-494f-9f52-7d0def0f3ff5 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:12.155561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0b607-361e-4718-b75a-7365d1c5bf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:12.156200 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0b607-361e-4718-b75a-7365d1c5bf06 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:12.156478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0b607-361e-4718-b75a-7365d1c5bf06 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:12.156750 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0b607-361e-4718-b75a-7365d1c5bf06 None admin] PATH_INFO: `/v3/projects/01c75d368d814248b8ba862ee53b50dc` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:12.157914 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0b607-361e-4718-b75a-7365d1c5bf06 None admin] RBAC: Authorizing `identity:get_project(project_id=01c75d368d814248b8ba862ee53b50dc)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:12.159475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf0b607-361e-4718-b75a-7365d1c5bf06 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:12.163144 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 77/148] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:12 2022] GET /identity/v3/projects/01c75d368d814248b8ba862ee53b50dc => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:12.169148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd157a6-31bb-4b13-aafd-e161abe15849 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:12.272045 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd157a6-31bb-4b13-aafd-e161abe15849 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:12.293012 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:12.308207 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5b51e-c004-45d6-bd5a-6dcff62ffe55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:12.308812 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5b51e-c004-45d6-bd5a-6dcff62ffe55 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:12.309129 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5b51e-c004-45d6-bd5a-6dcff62ffe55 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:12.309702 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5b51e-c004-45d6-bd5a-6dcff62ffe55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:12.310441 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5b51e-c004-45d6-bd5a-6dcff62ffe55 None admin] RBAC: Adding query filter params (role.id=a463f0ebb5cf4516b0bec345d25071cb, scope.project.id=01c75d368d814248b8ba862ee53b50dc, user.id=c03490a890814d2db0a221cf0a15aed9) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:12.310747 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5b51e-c004-45d6-bd5a-6dcff62ffe55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:12.312185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5b51e-c004-45d6-bd5a-6dcff62ffe55 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:12.318586 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 72/149] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:17:12 2022] GET /identity/v3/role_assignments?user.id=c03490a890814d2db0a221cf0a15aed9&scope.project.id=01c75d368d814248b8ba862ee53b50dc&role.id=a463f0ebb5cf4516b0bec345d25071cb => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:12.712745 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8273f78-f67b-4ac6-9bdd-35bf65fac717 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:12.713147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8273f78-f67b-4ac6-9bdd-35bf65fac717 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:12.713324 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8273f78-f67b-4ac6-9bdd-35bf65fac717 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:12.714661 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 78/150] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:12.723167 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5b840-0f75-4d0b-aa33-579468269bc5 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:12.723457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5b840-0f75-4d0b-aa33-579468269bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:12.723727 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5b840-0f75-4d0b-aa33-579468269bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:12.745104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-11c5b840-0f75-4d0b-aa33-579468269bc5 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:12.746306 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-11c5b840-0f75-4d0b-aa33-579468269bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:12.826317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 73/151] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:12.854018 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8273f78-f67b-4ac6-9bdd-35bf65fac717 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:12.907500 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:12.970317 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8273f78-f67b-4ac6-9bdd-35bf65fac717 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:13.014617 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3d2f5-79ed-4198-b4c6-bc9744d8c16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:13.015261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3d2f5-79ed-4198-b4c6-bc9744d8c16f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:13.015540 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3d2f5-79ed-4198-b4c6-bc9744d8c16f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:13.015808 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3d2f5-79ed-4198-b4c6-bc9744d8c16f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:13.026621 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3d2f5-79ed-4198-b4c6-bc9744d8c16f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:13.035512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-8da3d2f5-79ed-4198-b4c6-bc9744d8c16f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 02:17:13.035512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:13.035512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:13.035512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:13.035512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:13.035512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:13.035512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:13.035512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:13.035512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:13.035512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:13.035512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:13.035512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:13.035512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:13.035512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:13.035512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:13.035512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:13.036350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:13.036350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:13.036350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:13.036350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:13.036350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:13.036350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:13.036350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:13.036350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:13.036350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:13.036350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:13.036350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:13.036350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:13.036350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:13.036350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:13.036350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:13.036350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:13.037134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:13.037134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:13.037134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:13.037134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:13.037134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:13.037134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:13.037134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:13.037134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:13.037134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:13.037134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:13.037134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 02:17:13.037134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:13.037134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 79/152] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 9 02:17:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:13.042989 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5b840-0f75-4d0b-aa33-579468269bc5 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:13.154269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5b840-0f75-4d0b-aa33-579468269bc5 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:13.156750 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:13.201512 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731b9e6-de4d-4cb1-962d-1b038ba81786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:13.202204 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731b9e6-de4d-4cb1-962d-1b038ba81786 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:13.202460 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731b9e6-de4d-4cb1-962d-1b038ba81786 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:13.202729 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731b9e6-de4d-4cb1-962d-1b038ba81786 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:13.203409 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731b9e6-de4d-4cb1-962d-1b038ba81786 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:13.203692 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731b9e6-de4d-4cb1-962d-1b038ba81786 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:13.205198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731b9e6-de4d-4cb1-962d-1b038ba81786 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:13.213770 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 74/153] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:17:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:13.219326 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3d2f5-79ed-4198-b4c6-bc9744d8c16f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:13.322447 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3d2f5-79ed-4198-b4c6-bc9744d8c16f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:13.330180 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:13.364569 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08285275-c769-4bd9-b4a1-fc6145416fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:13.365242 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08285275-c769-4bd9-b4a1-fc6145416fac None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:13.365529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08285275-c769-4bd9-b4a1-fc6145416fac None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:13.365805 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08285275-c769-4bd9-b4a1-fc6145416fac None admin] PATH_INFO: `/v3/users/c03490a890814d2db0a221cf0a15aed9` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:13.369969 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08285275-c769-4bd9-b4a1-fc6145416fac None admin] RBAC: Authorizing `identity:get_user(user_id=c03490a890814d2db0a221cf0a15aed9)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:13.371439 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08285275-c769-4bd9-b4a1-fc6145416fac None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:13.373253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 80/154] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:13 2022] GET /identity/v3/users/c03490a890814d2db0a221cf0a15aed9 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:13.378601 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731b9e6-de4d-4cb1-962d-1b038ba81786 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:13.382997 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559a4e1-67e6-4c0d-98a7-85b6804bc847 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:13.383282 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559a4e1-67e6-4c0d-98a7-85b6804bc847 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:13.383559 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559a4e1-67e6-4c0d-98a7-85b6804bc847 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:13.385913 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 81/155] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:17:13.390077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3be80-2a78-4acc-b5b2-16451f448791 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:13.390368 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3be80-2a78-4acc-b5b2-16451f448791 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:13.390648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3be80-2a78-4acc-b5b2-16451f448791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:13.430549 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7dd3be80-2a78-4acc-b5b2-16451f448791 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:13.431769 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7dd3be80-2a78-4acc-b5b2-16451f448791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:13.540062 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731b9e6-de4d-4cb1-962d-1b038ba81786 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:13.570396 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 82/156] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 02:17:13.602319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d3c05-5a44-40d5-bd98-f3087aaa8025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:13.603194 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d3c05-5a44-40d5-bd98-f3087aaa8025 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:13.603627 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d3c05-5a44-40d5-bd98-f3087aaa8025 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:13.604048 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d3c05-5a44-40d5-bd98-f3087aaa8025 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:13.605651 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3be80-2a78-4acc-b5b2-16451f448791 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:13.657048 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:13.725050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d3c05-5a44-40d5-bd98-f3087aaa8025 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:13.725050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d3c05-5a44-40d5-bd98-f3087aaa8025 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:13.754976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3be80-2a78-4acc-b5b2-16451f448791 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:13.758265 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:13.805777 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85f9e0-237a-470e-af50-f8d6aec48553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:13.806719 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85f9e0-237a-470e-af50-f8d6aec48553 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:13.807158 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85f9e0-237a-470e-af50-f8d6aec48553 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:13.807588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85f9e0-237a-470e-af50-f8d6aec48553 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:13.822518 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85f9e0-237a-470e-af50-f8d6aec48553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:13.827796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-7f85f9e0-237a-470e-af50-f8d6aec48553 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 02:17:13.827796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:13.827796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:13.827796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:13.827796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:13.827796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:13.827796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:13.827796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:13.827796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:13.827796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:13.827796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:13.827796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:13.827796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:13.827796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:13.827796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:13.827796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:13.829087 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:13.829087 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:13.829087 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:13.829087 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:13.829087 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:13.829087 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:13.829087 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:13.829087 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:13.829087 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:13.829087 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:13.829087 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:13.829087 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:13.829087 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:13.829087 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:13.829087 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:13.829087 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:13.830004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:13.830004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:13.830004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:13.830004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:13.830004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:13.830004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:13.830004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:13.830004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:13.830004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:13.830004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:13.830004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 02:17:13.830004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:13.831904 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 83/157] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:17:13.838571 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85f9e0-237a-470e-af50-f8d6aec48553 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:13.928207 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 75/158] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:13.933682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d3c05-5a44-40d5-bd98-f3087aaa8025 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:13.946944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85f9e0-237a-470e-af50-f8d6aec48553 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:14.028143 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a56a5f-de9a-4db6-9bb1-5b8d3d1c77d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:14.029181 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a56a5f-de9a-4db6-9bb1-5b8d3d1c77d0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:14.029682 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a56a5f-de9a-4db6-9bb1-5b8d3d1c77d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:14.030168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a56a5f-de9a-4db6-9bb1-5b8d3d1c77d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:14.031074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a56a5f-de9a-4db6-9bb1-5b8d3d1c77d0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:14.031591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a56a5f-de9a-4db6-9bb1-5b8d3d1c77d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:14.033228 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a56a5f-de9a-4db6-9bb1-5b8d3d1c77d0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:14.042819 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 84/159] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:17:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:14.048476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a56a5f-de9a-4db6-9bb1-5b8d3d1c77d0 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:14.077379 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:14.085914 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:14.151310 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d3c05-5a44-40d5-bd98-f3087aaa8025 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:14.155972 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a56a5f-de9a-4db6-9bb1-5b8d3d1c77d0 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:14.200599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad182968-d940-4b6e-9f5d-88cf977bdee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:14.201626 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad182968-d940-4b6e-9f5d-88cf977bdee7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:14.202126 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad182968-d940-4b6e-9f5d-88cf977bdee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:14.202612 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad182968-d940-4b6e-9f5d-88cf977bdee7 None admin] PATH_INFO: `/v3/users/047b78a23d3c4a288698b9f5c35996a5` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:14.204069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad182968-d940-4b6e-9f5d-88cf977bdee7 None admin] RBAC: Authorizing `identity:get_user(user_id=047b78a23d3c4a288698b9f5c35996a5)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:14.205873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad182968-d940-4b6e-9f5d-88cf977bdee7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:14.213955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 85/160] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:14 2022] GET /identity/v3/users/047b78a23d3c4a288698b9f5c35996a5 => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:14.217276 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc60991-6507-4740-b3da-d23336866877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:14.218454 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc60991-6507-4740-b3da-d23336866877 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:14.218901 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc60991-6507-4740-b3da-d23336866877 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:14.219402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc60991-6507-4740-b3da-d23336866877 None admin] PATH_INFO: `/v3/projects/01c75d368d814248b8ba862ee53b50dc` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:14.221056 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad182968-d940-4b6e-9f5d-88cf977bdee7 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:14.222273 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc60991-6507-4740-b3da-d23336866877 None admin] RBAC: Authorizing `identity:get_project(project_id=01c75d368d814248b8ba862ee53b50dc)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:14.223942 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc60991-6507-4740-b3da-d23336866877 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:14.225946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 76/161] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:13 2022] GET /identity/v3/projects/01c75d368d814248b8ba862ee53b50dc => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:14.232078 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc60991-6507-4740-b3da-d23336866877 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:14.345590 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc60991-6507-4740-b3da-d23336866877 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:14.378997 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad182968-d940-4b6e-9f5d-88cf977bdee7 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:14.382724 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e6d1e-7ac3-4882-a66a-3fc93abc479f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:14.383563 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e6d1e-7ac3-4882-a66a-3fc93abc479f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:14.384063 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e6d1e-7ac3-4882-a66a-3fc93abc479f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:14.384539 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e6d1e-7ac3-4882-a66a-3fc93abc479f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:14.385514 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e6d1e-7ac3-4882-a66a-3fc93abc479f None admin] RBAC: Adding query filter params (role.id=680e2c06ab714158b756dc317a3f4e2e, scope.project.id=01c75d368d814248b8ba862ee53b50dc, user.id=c03490a890814d2db0a221cf0a15aed9) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:14.386028 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e6d1e-7ac3-4882-a66a-3fc93abc479f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:14.387685 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e6d1e-7ac3-4882-a66a-3fc93abc479f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:14.389821 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:14.393367 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:14.399739 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 77/162] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:17:14 2022] GET /identity/v3/role_assignments?user.id=c03490a890814d2db0a221cf0a15aed9&scope.project.id=01c75d368d814248b8ba862ee53b50dc&role.id=680e2c06ab714158b756dc317a3f4e2e => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:14.440792 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f304ff-c167-4b96-be21-4af73534f3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:14.441483 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f304ff-c167-4b96-be21-4af73534f3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:14.441767 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f304ff-c167-4b96-be21-4af73534f3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:14.442039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f304ff-c167-4b96-be21-4af73534f3e4 None admin] PATH_INFO: `/v3/projects/01c75d368d814248b8ba862ee53b50dc` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:14.443211 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f304ff-c167-4b96-be21-4af73534f3e4 None admin] RBAC: Authorizing `identity:get_project(project_id=01c75d368d814248b8ba862ee53b50dc)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:14.445367 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f304ff-c167-4b96-be21-4af73534f3e4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:14.447417 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 86/163] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:14 2022] GET /identity/v3/projects/01c75d368d814248b8ba862ee53b50dc => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:14.453498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e6d1e-7ac3-4882-a66a-3fc93abc479f None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:14.584020 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecd5c4-630c-4d91-a8a3-43b84029e600 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:14.584358 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecd5c4-630c-4d91-a8a3-43b84029e600 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:14.584577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecd5c4-630c-4d91-a8a3-43b84029e600 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:14.586236 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 87/164] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:14.594463 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c256f-1d68-49be-afd9-2ffd99e8232e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:14.594772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c256f-1d68-49be-afd9-2ffd99e8232e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:14.595022 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c256f-1d68-49be-afd9-2ffd99e8232e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:14.606849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e6d1e-7ac3-4882-a66a-3fc93abc479f None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:14.629881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-173c256f-1d68-49be-afd9-2ffd99e8232e None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:14.631110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-173c256f-1d68-49be-afd9-2ffd99e8232e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:14.689519 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9b084-d956-4699-8847-e90604255252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:14.690555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9b084-d956-4699-8847-e90604255252 None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:14.691038 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9b084-d956-4699-8847-e90604255252 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:14.691508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9b084-d956-4699-8847-e90604255252 None admin] PATH_INFO: `/v3/projects/01c75d368d814248b8ba862ee53b50dc/users/047b78a23d3c4a288698b9f5c35996a5/roles/61e3cf9f4de64b22b7254b339eab813b` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:14.693801 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9b084-d956-4699-8847-e90604255252 None admin] RBAC: Authorizing `identity:create_grant(project_id=01c75d368d814248b8ba862ee53b50dc, user_id=047b78a23d3c4a288698b9f5c35996a5, role_id=61e3cf9f4de64b22b7254b339eab813b)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:14.697596 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9b084-d956-4699-8847-e90604255252 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:14.723165 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 78/165] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 9 02:17:14 2022] PUT /identity/v3/projects/01c75d368d814248b8ba862ee53b50dc/users/047b78a23d3c4a288698b9f5c35996a5/roles/61e3cf9f4de64b22b7254b339eab813b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:17:14.769969 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 88/166] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:14.812482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b46ee-783e-4e11-a33d-1da29c017247 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:14.812666 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c256f-1d68-49be-afd9-2ffd99e8232e None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:14.813235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b46ee-783e-4e11-a33d-1da29c017247 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:14.813710 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b46ee-783e-4e11-a33d-1da29c017247 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:14.815366 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 79/167] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:14.821277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e35e8-c66a-482a-b149-219f7d5974ab None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:14.821912 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e35e8-c66a-482a-b149-219f7d5974ab None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:14.822398 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e35e8-c66a-482a-b149-219f7d5974ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:14.855623 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-455e35e8-c66a-482a-b149-219f7d5974ab None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:14.857271 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-455e35e8-c66a-482a-b149-219f7d5974ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:14.924165 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:14.947514 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 80/168] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:14.969476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:14.985058 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e35e8-c66a-482a-b149-219f7d5974ab None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:14.986660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c256f-1d68-49be-afd9-2ffd99e8232e None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:15.028624 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a6da9-2bcd-4656-91a3-9def52307ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:15.029412 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a6da9-2bcd-4656-91a3-9def52307ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:15.029636 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a6da9-2bcd-4656-91a3-9def52307ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:15.029853 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a6da9-2bcd-4656-91a3-9def52307ce0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:15.061094 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a6da9-2bcd-4656-91a3-9def52307ce0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:15.062942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-e88a6da9-2bcd-4656-91a3-9def52307ce0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:17:15.062942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:15.062942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:15.062942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:15.062942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:15.062942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:15.062942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:15.062942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:15.062942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:15.062942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:15.062942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:15.062942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:15.062942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:15.062942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:15.062942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:15.062942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:15.064051 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:15.064051 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:15.064051 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:15.064051 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:15.064051 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:15.064051 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:15.064051 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:15.064051 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:15.064051 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:15.064051 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:15.064051 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:15.064051 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:15.064051 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:15.064051 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:15.064051 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:15.064051 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:15.065234 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:15.065234 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:15.065234 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:15.065234 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:15.065234 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:15.065234 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:15.065234 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:15.065234 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:15.065234 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:15.065234 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:15.065234 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:17:15.065234 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:15.065234 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 89/169] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:17:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:17:15.074002 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a6da9-2bcd-4656-91a3-9def52307ce0 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:15.156757 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e35e8-c66a-482a-b149-219f7d5974ab None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:15.203815 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a6da9-2bcd-4656-91a3-9def52307ce0 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:15.230649 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1c51f-54fc-4d2e-ad8c-5e29d224fbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:15.232048 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1c51f-54fc-4d2e-ad8c-5e29d224fbf4 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:15.232551 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1c51f-54fc-4d2e-ad8c-5e29d224fbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:15.233050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1c51f-54fc-4d2e-ad8c-5e29d224fbf4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:15.249692 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba48f4-e6db-40e9-af61-b98e1014feaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:15.250312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba48f4-e6db-40e9-af61-b98e1014feaa None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:15.250597 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba48f4-e6db-40e9-af61-b98e1014feaa None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:15.250871 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba48f4-e6db-40e9-af61-b98e1014feaa None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:15.251549 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba48f4-e6db-40e9-af61-b98e1014feaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:15.251856 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba48f4-e6db-40e9-af61-b98e1014feaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:15.256501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba48f4-e6db-40e9-af61-b98e1014feaa None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:15.259399 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1c51f-54fc-4d2e-ad8c-5e29d224fbf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:15.271690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-5ff1c51f-54fc-4d2e-ad8c-5e29d224fbf4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:15.271690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:15.271690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:15.271690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:15.271690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:15.271690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:15.271690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:15.271690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:15.271690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:15.271690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:15.271690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:15.271690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:15.271690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:15.271690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:15.271690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:15.271690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:15.272706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:15.272706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:15.272706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:15.272706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:15.272706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:15.272706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:15.272706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:15.272706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:15.272706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:15.272706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:15.272706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:15.272706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:15.272706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:15.272706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:15.272706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:15.272706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:15.273938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:15.273938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:15.273938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:15.273938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:15.273938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:15.273938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:15.273938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:15.273938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:15.273938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:15.273938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:15.273938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:15.273938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:15.273938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 81/170] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:15.283081 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1c51f-54fc-4d2e-ad8c-5e29d224fbf4 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:15.284135 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 90/171] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:15.289782 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba48f4-e6db-40e9-af61-b98e1014feaa None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:15.356593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:15.365422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:15.430815 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1c51f-54fc-4d2e-ad8c-5e29d224fbf4 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:15.467967 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4511f4-c4d5-4b43-b588-780c93fc7df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:15.468586 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4511f4-c4d5-4b43-b588-780c93fc7df4 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:15.468871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4511f4-c4d5-4b43-b588-780c93fc7df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:15.469178 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4511f4-c4d5-4b43-b588-780c93fc7df4 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:15.470683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4511f4-c4d5-4b43-b588-780c93fc7df4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:15.471225 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4511f4-c4d5-4b43-b588-780c93fc7df4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:15.473461 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4511f4-c4d5-4b43-b588-780c93fc7df4 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:15.483505 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 82/172] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:17:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:15.485217 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bbabb-54ed-4af5-bef8-85f51e5b70fc None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:15.485507 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bbabb-54ed-4af5-bef8-85f51e5b70fc None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:15.489921 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bbabb-54ed-4af5-bef8-85f51e5b70fc None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:15.491318 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 83/173] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:15.492612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bbabb-54ed-4af5-bef8-85f51e5b70fc None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:15.550409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba48f4-e6db-40e9-af61-b98e1014feaa None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:15.615703 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44326079-639a-4859-9222-6d58aa5c9814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:15.616956 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44326079-639a-4859-9222-6d58aa5c9814 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:15.617278 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44326079-639a-4859-9222-6d58aa5c9814 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:15.617539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44326079-639a-4859-9222-6d58aa5c9814 None admin] PATH_INFO: `/v3/users/49d550c3e3b54e2aaebfc450900dd727` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:15.619889 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44326079-639a-4859-9222-6d58aa5c9814 None admin] RBAC: Authorizing `identity:get_user(user_id=49d550c3e3b54e2aaebfc450900dd727)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:15.621356 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44326079-639a-4859-9222-6d58aa5c9814 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:15.624387 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 91/174] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:15 2022] GET /identity/v3/users/49d550c3e3b54e2aaebfc450900dd727 => generated 247 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:15.625549 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab9bcd-d286-4a4c-ad16-75e941520d6c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:15.625828 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab9bcd-d286-4a4c-ad16-75e941520d6c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:15.626098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab9bcd-d286-4a4c-ad16-75e941520d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:15.665226 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-23ab9bcd-d286-4a4c-ad16-75e941520d6c None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:15.666442 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-23ab9bcd-d286-4a4c-ad16-75e941520d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:15.690176 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154bbabb-54ed-4af5-bef8-85f51e5b70fc None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:15.711168 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:15.750765 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e16c2-1032-44e7-86d5-678dfdf2a688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:15.751400 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e16c2-1032-44e7-86d5-678dfdf2a688 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:15.751687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e16c2-1032-44e7-86d5-678dfdf2a688 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:15.751964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e16c2-1032-44e7-86d5-678dfdf2a688 None admin] PATH_INFO: `/v3/users/c03490a890814d2db0a221cf0a15aed9` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:15.753170 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e16c2-1032-44e7-86d5-678dfdf2a688 None admin] RBAC: Authorizing `identity:get_user(user_id=c03490a890814d2db0a221cf0a15aed9)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:15.755133 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e16c2-1032-44e7-86d5-678dfdf2a688 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:15.756955 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 84/175] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:15 2022] GET /identity/v3/users/c03490a890814d2db0a221cf0a15aed9 => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:15.757593 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e16c2-1032-44e7-86d5-678dfdf2a688 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:15.814366 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 92/176] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:15.815592 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab9bcd-d286-4a4c-ad16-75e941520d6c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:15.847099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:15.870323 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e16c2-1032-44e7-86d5-678dfdf2a688 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:15.907446 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79960eeb-b26d-4ec6-98e0-e0a0b1c9695b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:15.908067 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79960eeb-b26d-4ec6-98e0-e0a0b1c9695b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:15.908350 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79960eeb-b26d-4ec6-98e0-e0a0b1c9695b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:15.908627 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79960eeb-b26d-4ec6-98e0-e0a0b1c9695b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:15.979411 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:15.992937 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab9bcd-d286-4a4c-ad16-75e941520d6c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:16.006409 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79960eeb-b26d-4ec6-98e0-e0a0b1c9695b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:16.008918 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79960eeb-b26d-4ec6-98e0-e0a0b1c9695b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:16.033378 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de25c7-8a71-4fa0-8f05-d50128fb84c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:16.034028 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de25c7-8a71-4fa0-8f05-d50128fb84c2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:16.034312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de25c7-8a71-4fa0-8f05-d50128fb84c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:16.034757 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de25c7-8a71-4fa0-8f05-d50128fb84c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:16.109826 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de25c7-8a71-4fa0-8f05-d50128fb84c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:16.111607 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de25c7-8a71-4fa0-8f05-d50128fb84c2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:16.130539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:16.145460 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 85/177] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:16.145460 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79960eeb-b26d-4ec6-98e0-e0a0b1c9695b None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:16.251086 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 93/178] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:16.253072 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b3b7d-ef34-4886-b949-a5dd985e3185 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:16.253072 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b3b7d-ef34-4886-b949-a5dd985e3185 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:16.253072 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b3b7d-ef34-4886-b949-a5dd985e3185 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:16.261111 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 94/179] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:16.261319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b3b7d-ef34-4886-b949-a5dd985e3185 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:16.271432 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:16.320892 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79960eeb-b26d-4ec6-98e0-e0a0b1c9695b None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:16.362311 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35aa1e-209a-4e9f-9e0c-913e7f1c3bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:16.362952 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35aa1e-209a-4e9f-9e0c-913e7f1c3bff None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:16.363230 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35aa1e-209a-4e9f-9e0c-913e7f1c3bff None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:16.363501 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35aa1e-209a-4e9f-9e0c-913e7f1c3bff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:16.383440 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35aa1e-209a-4e9f-9e0c-913e7f1c3bff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:16.388578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-5e35aa1e-209a-4e9f-9e0c-913e7f1c3bff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:17:16.388578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:16.388578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:16.388578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:16.388578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:16.388578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:16.388578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:16.388578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:16.388578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:16.388578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:16.388578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:16.388578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:16.388578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:16.388578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:16.388578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:16.388578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:16.389515 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:16.389515 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:16.389515 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:16.389515 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:16.389515 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:16.389515 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:16.389515 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:16.389515 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:16.389515 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:16.389515 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:16.389515 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:16.389515 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:16.389515 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:16.389515 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:16.389515 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:16.389515 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:16.390309 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:16.390309 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:16.390309 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:16.390309 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:16.390309 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:16.390309 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:16.390309 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:16.390309 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:16.390309 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:16.390309 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:16.390309 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:17:16.390309 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:16.392642 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 86/180] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:17:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:16.398869 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35aa1e-209a-4e9f-9e0c-913e7f1c3bff None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:16.408151 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b3b7d-ef34-4886-b949-a5dd985e3185 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:16.423968 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:16.450034 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8ddfa-c6b1-4cf4-92ad-aa5ff022ab95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:16.450811 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8ddfa-c6b1-4cf4-92ad-aa5ff022ab95 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:16.451182 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8ddfa-c6b1-4cf4-92ad-aa5ff022ab95 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:16.451525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8ddfa-c6b1-4cf4-92ad-aa5ff022ab95 None admin] PATH_INFO: `/v3/projects/01c75d368d814248b8ba862ee53b50dc` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:16.452717 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8ddfa-c6b1-4cf4-92ad-aa5ff022ab95 None admin] RBAC: Authorizing `identity:get_project(project_id=01c75d368d814248b8ba862ee53b50dc)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:16.454265 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8ddfa-c6b1-4cf4-92ad-aa5ff022ab95 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:16.456165 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 95/181] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:16 2022] GET /identity/v3/projects/01c75d368d814248b8ba862ee53b50dc => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:16.457179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd3953-2ff8-4142-b210-d5835d9f8a2b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:16.457533 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd3953-2ff8-4142-b210-d5835d9f8a2b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:16.457875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd3953-2ff8-4142-b210-d5835d9f8a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:16.487251 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-10cd3953-2ff8-4142-b210-d5835d9f8a2b None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:16.488627 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-10cd3953-2ff8-4142-b210-d5835d9f8a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:16.504236 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35aa1e-209a-4e9f-9e0c-913e7f1c3bff None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:16.555923 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf22edf-b184-4838-aa48-97fa522fe734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:16.556562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf22edf-b184-4838-aa48-97fa522fe734 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:16.556838 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf22edf-b184-4838-aa48-97fa522fe734 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:16.557139 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf22edf-b184-4838-aa48-97fa522fe734 None admin] PATH_INFO: `/v3/projects/305d4f01062545a28720e3b6b916af99` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:16.558282 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf22edf-b184-4838-aa48-97fa522fe734 None admin] RBAC: Authorizing `identity:get_project(project_id=305d4f01062545a28720e3b6b916af99)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:16.559733 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf22edf-b184-4838-aa48-97fa522fe734 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:16.561620 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 87/182] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:16 2022] GET /identity/v3/projects/305d4f01062545a28720e3b6b916af99 => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:16.562548 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae259bf3-b6f4-4abb-98bf-b9bfc3c2a909 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:16.562827 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae259bf3-b6f4-4abb-98bf-b9bfc3c2a909 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:16.563077 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae259bf3-b6f4-4abb-98bf-b9bfc3c2a909 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:16.564261 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 88/183] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:16.564954 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae259bf3-b6f4-4abb-98bf-b9bfc3c2a909 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:16.574577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:16.590861 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 96/184] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:16.593964 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd3953-2ff8-4142-b210-d5835d9f8a2b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:16.682058 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae259bf3-b6f4-4abb-98bf-b9bfc3c2a909 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:16.702529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd3953-2ff8-4142-b210-d5835d9f8a2b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:16.713716 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:16.718060 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2c6da-d9aa-406c-b200-e8dc3ed54368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:16.718683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2c6da-d9aa-406c-b200-e8dc3ed54368 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:16.718966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2c6da-d9aa-406c-b200-e8dc3ed54368 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:16.719244 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2c6da-d9aa-406c-b200-e8dc3ed54368 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:16.719916 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2c6da-d9aa-406c-b200-e8dc3ed54368 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:16.720226 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2c6da-d9aa-406c-b200-e8dc3ed54368 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:16.721675 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2c6da-d9aa-406c-b200-e8dc3ed54368 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:16.734815 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 89/185] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:16.734815 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca66522-0fd8-4f6c-9879-66445ae56f17 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:16.734815 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca66522-0fd8-4f6c-9879-66445ae56f17 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:16.734815 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca66522-0fd8-4f6c-9879-66445ae56f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:16.745086 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8f4ea-96fa-4fbe-a8e3-dc043193f1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:16.745704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8f4ea-96fa-4fbe-a8e3-dc043193f1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:16.746077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8f4ea-96fa-4fbe-a8e3-dc043193f1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:16.746246 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8f4ea-96fa-4fbe-a8e3-dc043193f1a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:16.746973 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8f4ea-96fa-4fbe-a8e3-dc043193f1a6 None admin] RBAC: Adding query filter params (role.id=e2095c5a29d74c33b9dcb16f8e5343bf, scope.project.id=01c75d368d814248b8ba862ee53b50dc, user.id=49d550c3e3b54e2aaebfc450900dd727) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:16.747281 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8f4ea-96fa-4fbe-a8e3-dc043193f1a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:16.748709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8f4ea-96fa-4fbe-a8e3-dc043193f1a6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:16.750090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-9ca66522-0fd8-4f6c-9879-66445ae56f17 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:16.751286 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9ca66522-0fd8-4f6c-9879-66445ae56f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:16.755049 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 97/186] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:17:16 2022] GET /identity/v3/role_assignments?user.id=49d550c3e3b54e2aaebfc450900dd727&scope.project.id=01c75d368d814248b8ba862ee53b50dc&role.id=e2095c5a29d74c33b9dcb16f8e5343bf => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:16.755630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8f4ea-96fa-4fbe-a8e3-dc043193f1a6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:16.853357 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:16.862207 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 90/187] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:16.863093 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca66522-0fd8-4f6c-9879-66445ae56f17 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:16.887006 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8f4ea-96fa-4fbe-a8e3-dc043193f1a6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:16.926690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea239b-f3e3-4efb-bf61-26abb2b6fa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:16.927303 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea239b-f3e3-4efb-bf61-26abb2b6fa72 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:16.927584 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea239b-f3e3-4efb-bf61-26abb2b6fa72 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:16.927852 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea239b-f3e3-4efb-bf61-26abb2b6fa72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:16.928590 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea239b-f3e3-4efb-bf61-26abb2b6fa72 None admin] RBAC: Adding query filter params (role.id=a463f0ebb5cf4516b0bec345d25071cb, scope.project.id=305d4f01062545a28720e3b6b916af99, user.id=c03490a890814d2db0a221cf0a15aed9) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:16.929471 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea239b-f3e3-4efb-bf61-26abb2b6fa72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:16.930919 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea239b-f3e3-4efb-bf61-26abb2b6fa72 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:16.943201 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 98/188] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:17:16 2022] GET /identity/v3/role_assignments?user.id=c03490a890814d2db0a221cf0a15aed9&scope.project.id=305d4f01062545a28720e3b6b916af99&role.id=a463f0ebb5cf4516b0bec345d25071cb => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:16.944970 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea239b-f3e3-4efb-bf61-26abb2b6fa72 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:17.002449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:17.020320 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca66522-0fd8-4f6c-9879-66445ae56f17 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:17.061927 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2637e9-feee-4239-af0f-d6ab7c0937ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:17.062964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2637e9-feee-4239-af0f-d6ab7c0937ec None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:17.064254 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2637e9-feee-4239-af0f-d6ab7c0937ec None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:17.064824 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2637e9-feee-4239-af0f-d6ab7c0937ec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:17.073319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea239b-f3e3-4efb-bf61-26abb2b6fa72 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:17.078248 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2637e9-feee-4239-af0f-d6ab7c0937ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:17.083676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-8b2637e9-feee-4239-af0f-d6ab7c0937ec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 02:17:17.083676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:17.083676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:17.083676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:17.083676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:17.083676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:17.083676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:17.083676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:17.083676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:17.083676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:17.083676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:17.083676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:17.083676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:17.083676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:17.083676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:17.083676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:17.084701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:17.084701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:17.084701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:17.084701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:17.084701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:17.084701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:17.084701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:17.084701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:17.084701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:17.084701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:17.084701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:17.084701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:17.084701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:17.084701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:17.084701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:17.084701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:17.085576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:17.085576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:17.085576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:17.085576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:17.085576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:17.085576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:17.085576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:17.085576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:17.085576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:17.085576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:17.085576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 02:17:17.085576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:17.088031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 91/189] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 9 02:17:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:17.089119 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2637e9-feee-4239-af0f-d6ab7c0937ec None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:17.122309 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf39315-ba62-4d13-aa6f-7d394ce37149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:17.122877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf39315-ba62-4d13-aa6f-7d394ce37149 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:17.123161 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf39315-ba62-4d13-aa6f-7d394ce37149 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:17.123436 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf39315-ba62-4d13-aa6f-7d394ce37149 None admin] PATH_INFO: `/v3/users/07332412fe16471fbb77476c238efdf7` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:17.138721 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf39315-ba62-4d13-aa6f-7d394ce37149 None admin] RBAC: Authorizing `identity:get_user(user_id=07332412fe16471fbb77476c238efdf7)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:17.140220 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf39315-ba62-4d13-aa6f-7d394ce37149 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:17.146743 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 99/190] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:16 2022] GET /identity/v3/users/07332412fe16471fbb77476c238efdf7 => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:17.147657 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf39315-ba62-4d13-aa6f-7d394ce37149 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:17.159638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:17.218086 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2637e9-feee-4239-af0f-d6ab7c0937ec None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:17.264527 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8140992-3523-47c9-b154-0163e9f81bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:17.265193 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8140992-3523-47c9-b154-0163e9f81bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:17.265475 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8140992-3523-47c9-b154-0163e9f81bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:17.265745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8140992-3523-47c9-b154-0163e9f81bc7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:17.266861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8140992-3523-47c9-b154-0163e9f81bc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:17.268319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8140992-3523-47c9-b154-0163e9f81bc7 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:17.269937 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 92/191] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:17:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:17.270666 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:17.273705 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8140992-3523-47c9-b154-0163e9f81bc7 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:17.278343 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf39315-ba62-4d13-aa6f-7d394ce37149 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:17.316129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38decb-cbbc-4958-85ca-34690cf48521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:17.316743 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38decb-cbbc-4958-85ca-34690cf48521 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:17.317074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38decb-cbbc-4958-85ca-34690cf48521 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:17.317437 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38decb-cbbc-4958-85ca-34690cf48521 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:17.318117 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38decb-cbbc-4958-85ca-34690cf48521 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:17.318422 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38decb-cbbc-4958-85ca-34690cf48521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:17.319838 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38decb-cbbc-4958-85ca-34690cf48521 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:17.328274 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 100/192] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:17:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:17.329149 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38decb-cbbc-4958-85ca-34690cf48521 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:17.380635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8140992-3523-47c9-b154-0163e9f81bc7 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:17.414734 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:17.424575 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda950c6-d7cb-4fcb-867d-50bdf2190072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:17.425218 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda950c6-d7cb-4fcb-867d-50bdf2190072 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:17.425503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda950c6-d7cb-4fcb-867d-50bdf2190072 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:17.425787 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda950c6-d7cb-4fcb-867d-50bdf2190072 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:17.442333 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38decb-cbbc-4958-85ca-34690cf48521 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:17.480267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3eb7dc-66ba-4dcb-b430-46a3c546a5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:17.480870 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3eb7dc-66ba-4dcb-b430-46a3c546a5f8 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:17.481184 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3eb7dc-66ba-4dcb-b430-46a3c546a5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:17.481454 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3eb7dc-66ba-4dcb-b430-46a3c546a5f8 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:17.482098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3eb7dc-66ba-4dcb-b430-46a3c546a5f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:17.483543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3eb7dc-66ba-4dcb-b430-46a3c546a5f8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:17.491466 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda950c6-d7cb-4fcb-867d-50bdf2190072 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:17.492913 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda950c6-d7cb-4fcb-867d-50bdf2190072 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:17.504212 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 101/193] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 9 02:17:17 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:17:17.505528 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b5e7a-86d0-4534-8266-c9a141b14815 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:17.505812 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b5e7a-86d0-4534-8266-c9a141b14815 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:17.506346 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b5e7a-86d0-4534-8266-c9a141b14815 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:17.511557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 102/194] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:17.511557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b5e7a-86d0-4534-8266-c9a141b14815 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:17.533157 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:17.613340 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 93/195] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:17.613340 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a702a-6005-4436-8321-a8768b3902c3 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:17.613340 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a702a-6005-4436-8321-a8768b3902c3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:17.613340 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a702a-6005-4436-8321-a8768b3902c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:17.629754 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-de7a702a-6005-4436-8321-a8768b3902c3 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:17.631079 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-de7a702a-6005-4436-8321-a8768b3902c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:17.641664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b5e7a-86d0-4534-8266-c9a141b14815 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:17.653057 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:17.687497 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc41ce-527d-4c4b-af4a-0e3dbf908175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:17.688132 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc41ce-527d-4c4b-af4a-0e3dbf908175 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:17.688406 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc41ce-527d-4c4b-af4a-0e3dbf908175 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:17.688670 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc41ce-527d-4c4b-af4a-0e3dbf908175 None admin] PATH_INFO: `/v3/users/07332412fe16471fbb77476c238efdf7` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:17.689816 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc41ce-527d-4c4b-af4a-0e3dbf908175 None admin] RBAC: Authorizing `identity:get_user(user_id=07332412fe16471fbb77476c238efdf7)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:17.691264 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc41ce-527d-4c4b-af4a-0e3dbf908175 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:17.693007 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 103/196] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:17 2022] GET /identity/v3/users/07332412fe16471fbb77476c238efdf7 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:17.693610 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc41ce-527d-4c4b-af4a-0e3dbf908175 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:17.708754 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 94/197] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:17.709695 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a702a-6005-4436-8321-a8768b3902c3 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:17.804627 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:17.827731 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc41ce-527d-4c4b-af4a-0e3dbf908175 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:17.845954 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a702a-6005-4436-8321-a8768b3902c3 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:17.866332 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02843e7-970a-46d1-bb10-0eaa0d07a325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:17.866586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02843e7-970a-46d1-bb10-0eaa0d07a325 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:17.866874 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02843e7-970a-46d1-bb10-0eaa0d07a325 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:17.867149 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02843e7-970a-46d1-bb10-0eaa0d07a325 None admin] PATH_INFO: `/v3/projects/fcf93baab2904060974567318edbdc0b` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:17.868727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02843e7-970a-46d1-bb10-0eaa0d07a325 None admin] RBAC: Authorizing `identity:get_project(project_id=fcf93baab2904060974567318edbdc0b)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:17.870482 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02843e7-970a-46d1-bb10-0eaa0d07a325 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:17.872926 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 104/198] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:17 2022] GET /identity/v3/projects/fcf93baab2904060974567318edbdc0b => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:17.873675 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02843e7-970a-46d1-bb10-0eaa0d07a325 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:17.892444 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cb6f7-4b0e-44cf-98f3-85efff15d0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:17.893496 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cb6f7-4b0e-44cf-98f3-85efff15d0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:17.893924 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cb6f7-4b0e-44cf-98f3-85efff15d0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:17.894396 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cb6f7-4b0e-44cf-98f3-85efff15d0c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:17.941443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:17.972338 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1cb6f7-4b0e-44cf-98f3-85efff15d0c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:17.976494 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1cb6f7-4b0e-44cf-98f3-85efff15d0c2 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:17.997790 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02843e7-970a-46d1-bb10-0eaa0d07a325 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:18.041895 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99fa68-99c8-42de-9cbf-c8cb839c65ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:18.042540 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99fa68-99c8-42de-9cbf-c8cb839c65ff None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:18.043139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99fa68-99c8-42de-9cbf-c8cb839c65ff None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:18.043414 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99fa68-99c8-42de-9cbf-c8cb839c65ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:18.055709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99fa68-99c8-42de-9cbf-c8cb839c65ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:18.061370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-9a99fa68-99c8-42de-9cbf-c8cb839c65ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 02:17:18.061370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:18.061370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:18.061370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:18.061370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:18.061370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:18.061370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:18.061370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:18.061370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:18.061370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:18.061370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:18.061370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:18.061370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:18.061370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:18.061370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:18.061370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:18.062429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:18.062429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:18.062429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:18.062429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:18.062429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:18.062429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:18.062429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:18.062429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:18.062429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:18.062429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:18.062429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:18.062429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:18.062429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:18.062429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:18.062429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:18.062429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:18.063402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:18.063402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:18.063402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:18.063402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:18.063402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:18.063402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:18.063402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:18.063402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:18.063402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:18.063402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:18.063402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 02:17:18.063402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:18.066674 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 105/199] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:18.067793 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99fa68-99c8-42de-9cbf-c8cb839c65ff None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:18.084307 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:18.107627 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 95/200] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:18.108300 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cb6f7-4b0e-44cf-98f3-85efff15d0c2 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:18.172679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:18.198154 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99fa68-99c8-42de-9cbf-c8cb839c65ff None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:18.233969 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cb6f7-4b0e-44cf-98f3-85efff15d0c2 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:18.234249 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64d9b8-69fa-42c5-aee6-57335be7a3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:18.235042 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64d9b8-69fa-42c5-aee6-57335be7a3ec None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:18.235476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64d9b8-69fa-42c5-aee6-57335be7a3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:18.236058 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64d9b8-69fa-42c5-aee6-57335be7a3ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:18.237778 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64d9b8-69fa-42c5-aee6-57335be7a3ec None admin] RBAC: Adding query filter params (role.id=e2095c5a29d74c33b9dcb16f8e5343bf, scope.project.id=fcf93baab2904060974567318edbdc0b, user.id=07332412fe16471fbb77476c238efdf7) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:18.238243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64d9b8-69fa-42c5-aee6-57335be7a3ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:18.239856 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64d9b8-69fa-42c5-aee6-57335be7a3ec None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:18.252902 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 106/201] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:17:18 2022] GET /identity/v3/role_assignments?user.id=07332412fe16471fbb77476c238efdf7&scope.project.id=fcf93baab2904060974567318edbdc0b&role.id=e2095c5a29d74c33b9dcb16f8e5343bf => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:18.252902 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64d9b8-69fa-42c5-aee6-57335be7a3ec None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:18.304346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36855099-6523-4f25-9a1b-58bdc3b045f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:18.305090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36855099-6523-4f25-9a1b-58bdc3b045f8 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:18.305284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36855099-6523-4f25-9a1b-58bdc3b045f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:18.305542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36855099-6523-4f25-9a1b-58bdc3b045f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:18.306226 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36855099-6523-4f25-9a1b-58bdc3b045f8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:18.306531 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36855099-6523-4f25-9a1b-58bdc3b045f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:18.307944 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36855099-6523-4f25-9a1b-58bdc3b045f8 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:18.331626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 96/202] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:17:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:18.338334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36855099-6523-4f25-9a1b-58bdc3b045f8 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:18.431005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:18.462177 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64d9b8-69fa-42c5-aee6-57335be7a3ec None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:18.504445 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36855099-6523-4f25-9a1b-58bdc3b045f8 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:18.523473 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:18.525727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47667a-3d54-43e7-a36e-c20a7e42fd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:18.526388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47667a-3d54-43e7-a36e-c20a7e42fd93 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:18.526670 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47667a-3d54-43e7-a36e-c20a7e42fd93 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:18.526944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47667a-3d54-43e7-a36e-c20a7e42fd93 None admin] PATH_INFO: `/v3/projects/fcf93baab2904060974567318edbdc0b` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:18.528222 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47667a-3d54-43e7-a36e-c20a7e42fd93 None admin] RBAC: Authorizing `identity:get_project(project_id=fcf93baab2904060974567318edbdc0b)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:18.529784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47667a-3d54-43e7-a36e-c20a7e42fd93 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:18.531700 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 107/203] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:18 2022] GET /identity/v3/projects/fcf93baab2904060974567318edbdc0b => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:18.537354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47667a-3d54-43e7-a36e-c20a7e42fd93 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:18.545250 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34b950-cdc6-403d-a9bf-ee635e76b732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:18.546220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34b950-cdc6-403d-a9bf-ee635e76b732 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:18.546769 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34b950-cdc6-403d-a9bf-ee635e76b732 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:18.547242 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34b950-cdc6-403d-a9bf-ee635e76b732 None admin] PATH_INFO: `/v3/users/047b78a23d3c4a288698b9f5c35996a5` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:18.548598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34b950-cdc6-403d-a9bf-ee635e76b732 None admin] RBAC: Authorizing `identity:get_user(user_id=047b78a23d3c4a288698b9f5c35996a5)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:18.550482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34b950-cdc6-403d-a9bf-ee635e76b732 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:18.552688 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 97/204] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:18 2022] GET /identity/v3/users/047b78a23d3c4a288698b9f5c35996a5 => generated 289 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:18.562843 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34b950-cdc6-403d-a9bf-ee635e76b732 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:18.697854 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34b950-cdc6-403d-a9bf-ee635e76b732 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:18.714402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47667a-3d54-43e7-a36e-c20a7e42fd93 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:18.745833 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea6dd5-42cb-4cf2-90fa-e7a26378ddd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:18.746473 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea6dd5-42cb-4cf2-90fa-e7a26378ddd7 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:18.746750 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea6dd5-42cb-4cf2-90fa-e7a26378ddd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:18.747017 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea6dd5-42cb-4cf2-90fa-e7a26378ddd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:18.750275 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d30532-62a1-4ced-865f-7a2f6951b2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:18.751049 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d30532-62a1-4ced-865f-7a2f6951b2fc None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:18.751502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d30532-62a1-4ced-865f-7a2f6951b2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:18.751920 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d30532-62a1-4ced-865f-7a2f6951b2fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:18.752799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d30532-62a1-4ced-865f-7a2f6951b2fc None admin] RBAC: Adding query filter params (role.id=680e2c06ab714158b756dc317a3f4e2e, scope.project.id=fcf93baab2904060974567318edbdc0b, user.id=07332412fe16471fbb77476c238efdf7) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:18.753346 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d30532-62a1-4ced-865f-7a2f6951b2fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:18.754922 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d30532-62a1-4ced-865f-7a2f6951b2fc None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:18.760889 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 108/205] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:17:18 2022] GET /identity/v3/role_assignments?user.id=07332412fe16471fbb77476c238efdf7&scope.project.id=fcf93baab2904060974567318edbdc0b&role.id=680e2c06ab714158b756dc317a3f4e2e => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:18.828389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:18.845801 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea6dd5-42cb-4cf2-90fa-e7a26378ddd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:18.847298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea6dd5-42cb-4cf2-90fa-e7a26378ddd7 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:18.958746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 98/206] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:18.965129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d30532-62a1-4ced-865f-7a2f6951b2fc None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:18.988342 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:19.115716 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d30532-62a1-4ced-865f-7a2f6951b2fc None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:19.160610 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623b1d2-87cb-4e60-9557-57f6085dcb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:19.161280 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623b1d2-87cb-4e60-9557-57f6085dcb9d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:19.161564 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623b1d2-87cb-4e60-9557-57f6085dcb9d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:19.161842 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623b1d2-87cb-4e60-9557-57f6085dcb9d None admin] PATH_INFO: `/v3/projects/01c75d368d814248b8ba862ee53b50dc` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:19.163557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623b1d2-87cb-4e60-9557-57f6085dcb9d None admin] RBAC: Authorizing `identity:get_project(project_id=01c75d368d814248b8ba862ee53b50dc)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:19.165159 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623b1d2-87cb-4e60-9557-57f6085dcb9d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:19.167115 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 109/207] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:18 2022] GET /identity/v3/projects/01c75d368d814248b8ba862ee53b50dc => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:19.172608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea6dd5-42cb-4cf2-90fa-e7a26378ddd7 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:19.269389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:19.288484 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea6dd5-42cb-4cf2-90fa-e7a26378ddd7 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:19.327891 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ba5b6-307d-418c-a997-ba33495a256a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:19.328499 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ba5b6-307d-418c-a997-ba33495a256a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:19.328763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ba5b6-307d-418c-a997-ba33495a256a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:19.329052 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ba5b6-307d-418c-a997-ba33495a256a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:19.329786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ba5b6-307d-418c-a997-ba33495a256a None admin] RBAC: Adding query filter params (role.id=61e3cf9f4de64b22b7254b339eab813b, scope.project.id=01c75d368d814248b8ba862ee53b50dc, user.id=047b78a23d3c4a288698b9f5c35996a5) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:19.330094 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ba5b6-307d-418c-a997-ba33495a256a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:19.331547 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ba5b6-307d-418c-a997-ba33495a256a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:19.338632 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 99/208] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:17:19 2022] GET /identity/v3/role_assignments?user.id=047b78a23d3c4a288698b9f5c35996a5&scope.project.id=01c75d368d814248b8ba862ee53b50dc&role.id=61e3cf9f4de64b22b7254b339eab813b => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:19.821501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e1bcf-2519-412a-83d0-7342e39118b3 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:19.822008 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e1bcf-2519-412a-83d0-7342e39118b3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:19.822008 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e1bcf-2519-412a-83d0-7342e39118b3 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:19.823426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 110/209] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:19.829185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80228884-c07e-4945-8c21-d3172ecc756c None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:19.829477 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80228884-c07e-4945-8c21-d3172ecc756c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:19.829753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80228884-c07e-4945-8c21-d3172ecc756c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:19.853060 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-80228884-c07e-4945-8c21-d3172ecc756c None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:19.854272 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-80228884-c07e-4945-8c21-d3172ecc756c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:19.937572 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 100/210] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:19.960718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e1bcf-2519-412a-83d0-7342e39118b3 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:20.036874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd1dc5-40ac-41a3-a55d-5812cf909994 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:20.037212 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd1dc5-40ac-41a3-a55d-5812cf909994 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:20.037485 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd1dc5-40ac-41a3-a55d-5812cf909994 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:20.040324 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 101/211] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:17:20.046408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace23731-ac1c-46cb-a47a-70cf240a8cd1 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:20.046887 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace23731-ac1c-46cb-a47a-70cf240a8cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:20.047360 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace23731-ac1c-46cb-a47a-70cf240a8cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:20.056927 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:20.069406 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-ace23731-ac1c-46cb-a47a-70cf240a8cd1 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:20.071022 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ace23731-ac1c-46cb-a47a-70cf240a8cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:20.084160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e1bcf-2519-412a-83d0-7342e39118b3 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:20.124066 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a781f-65a8-4325-8005-454db0a34c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:20.125078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a781f-65a8-4325-8005-454db0a34c4e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:20.125525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a781f-65a8-4325-8005-454db0a34c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:20.125946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a781f-65a8-4325-8005-454db0a34c4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:20.137371 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a781f-65a8-4325-8005-454db0a34c4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:20.142763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-720a781f-65a8-4325-8005-454db0a34c4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:20.142763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:20.142763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:20.142763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:20.142763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:20.142763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:20.142763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:20.142763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:20.142763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:20.142763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:20.142763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:20.142763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:20.142763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:20.142763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:20.142763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:20.142763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:20.143643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:20.143643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:20.143643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:20.143643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:20.143643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:20.143643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:20.143643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:20.143643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:20.143643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:20.143643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:20.143643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:20.143643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:20.143643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:20.143643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:20.143643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:20.143643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:20.144402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:20.144402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:20.144402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:20.144402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:20.144402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:20.144402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:20.144402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:20.144402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:20.144402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:20.144402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:20.144402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:20.144402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:20.146459 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 111/212] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:20.151609 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 102/213] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 02:17:20.154253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a781f-65a8-4325-8005-454db0a34c4e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:20.172126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace23731-ac1c-46cb-a47a-70cf240a8cd1 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:20.184836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:20.272504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a781f-65a8-4325-8005-454db0a34c4e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:20.280660 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace23731-ac1c-46cb-a47a-70cf240a8cd1 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:20.319238 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1b0b6-04eb-4685-b06f-b6e0f8cf5f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:20.320235 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1b0b6-04eb-4685-b06f-b6e0f8cf5f46 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:20.320712 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1b0b6-04eb-4685-b06f-b6e0f8cf5f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:20.321326 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1b0b6-04eb-4685-b06f-b6e0f8cf5f46 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:20.322414 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1b0b6-04eb-4685-b06f-b6e0f8cf5f46 None admin] RBAC: Adding query filter params (name=member) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:20.322917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1b0b6-04eb-4685-b06f-b6e0f8cf5f46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:20.324066 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8da473-e317-4fda-850f-c461648113b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:20.324700 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8da473-e317-4fda-850f-c461648113b0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:20.324975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8da473-e317-4fda-850f-c461648113b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:20.325283 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8da473-e317-4fda-850f-c461648113b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:20.325591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1b0b6-04eb-4685-b06f-b6e0f8cf5f46 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:20.326408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8da473-e317-4fda-850f-c461648113b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:20.327606 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:20.329615 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8da473-e317-4fda-850f-c461648113b0 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:20.333274 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 103/214] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:17:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:20.338917 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8da473-e317-4fda-850f-c461648113b0 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:20.345181 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 112/215] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:17:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:20.347282 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1b0b6-04eb-4685-b06f-b6e0f8cf5f46 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:20.423771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:20.447834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8da473-e317-4fda-850f-c461648113b0 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:20.457883 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1b0b6-04eb-4685-b06f-b6e0f8cf5f46 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:20.484747 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbef9bd-4e3c-4d20-a859-4024256983a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:20.485693 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbef9bd-4e3c-4d20-a859-4024256983a0 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:20.486167 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbef9bd-4e3c-4d20-a859-4024256983a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:20.486631 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbef9bd-4e3c-4d20-a859-4024256983a0 None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:20.487507 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbef9bd-4e3c-4d20-a859-4024256983a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:20.489200 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbef9bd-4e3c-4d20-a859-4024256983a0 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:20.498642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e6b19-1161-4fb2-ab13-193fee5ac12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:20.499540 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e6b19-1161-4fb2-ab13-193fee5ac12b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:20.499667 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e6b19-1161-4fb2-ab13-193fee5ac12b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:20.499912 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e6b19-1161-4fb2-ab13-193fee5ac12b None admin] PATH_INFO: `/v3/users/e4b7e69fd4734d2fb29f049a5c09a5fa` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:20.521391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 104/216] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 9 02:17:20 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:17:20.522118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e6b19-1161-4fb2-ab13-193fee5ac12b None admin] RBAC: Authorizing `identity:get_user(user_id=e4b7e69fd4734d2fb29f049a5c09a5fa)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:20.524211 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e6b19-1161-4fb2-ab13-193fee5ac12b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:20.526313 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 113/217] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:20 2022] GET /identity/v3/users/e4b7e69fd4734d2fb29f049a5c09a5fa => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:20.533868 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbef9bd-4e3c-4d20-a859-4024256983a0 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:20.662171 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbef9bd-4e3c-4d20-a859-4024256983a0 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:20.699335 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af64099-057d-4f21-841a-af7fab9a3e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:20.700303 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af64099-057d-4f21-841a-af7fab9a3e82 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:20.700804 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af64099-057d-4f21-841a-af7fab9a3e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:20.701160 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af64099-057d-4f21-841a-af7fab9a3e82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:20.704085 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:20.749098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7205ecf-4cab-4c8b-b538-06a7373458c1 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:20.749742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7205ecf-4cab-4c8b-b538-06a7373458c1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:20.750022 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7205ecf-4cab-4c8b-b538-06a7373458c1 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:20.751962 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 114/218] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:17:20.757284 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227dbed-73e3-4c95-a7d3-ebc21a878393 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:20.757563 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227dbed-73e3-4c95-a7d3-ebc21a878393 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:20.757837 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227dbed-73e3-4c95-a7d3-ebc21a878393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:20.780929 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af64099-057d-4f21-841a-af7fab9a3e82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:20.782438 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af64099-057d-4f21-841a-af7fab9a3e82 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:20.782615 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5227dbed-73e3-4c95-a7d3-ebc21a878393 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:20.783806 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5227dbed-73e3-4c95-a7d3-ebc21a878393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:20.846068 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:20.871764 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 115/219] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 02:17:20.895166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227dbed-73e3-4c95-a7d3-ebc21a878393 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:20.909446 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 105/220] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:20.917627 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af64099-057d-4f21-841a-af7fab9a3e82 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:20.961576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:21.032099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227dbed-73e3-4c95-a7d3-ebc21a878393 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:21.050972 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af64099-057d-4f21-841a-af7fab9a3e82 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:21.078741 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f1339-80b1-410e-9809-3962530d4f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:21.080254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f1339-80b1-410e-9809-3962530d4f37 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:21.081000 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f1339-80b1-410e-9809-3962530d4f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:21.081498 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f1339-80b1-410e-9809-3962530d4f37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:21.088289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fd605-6c35-4e3f-bc53-84b1d8536416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:21.088899 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fd605-6c35-4e3f-bc53-84b1d8536416 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:21.089208 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fd605-6c35-4e3f-bc53-84b1d8536416 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:21.089479 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fd605-6c35-4e3f-bc53-84b1d8536416 None admin] PATH_INFO: `/v3/projects/fcf93baab2904060974567318edbdc0b` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:21.090668 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fd605-6c35-4e3f-bc53-84b1d8536416 None admin] RBAC: Authorizing `identity:get_project(project_id=fcf93baab2904060974567318edbdc0b)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:21.092276 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fd605-6c35-4e3f-bc53-84b1d8536416 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:21.094366 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 106/221] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:20 2022] GET /identity/v3/projects/fcf93baab2904060974567318edbdc0b => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:21.099872 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6202fb-502a-4377-a40e-8a8957b0cc44 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:21.099872 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6202fb-502a-4377-a40e-8a8957b0cc44 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:21.099872 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6202fb-502a-4377-a40e-8a8957b0cc44 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:21.099872 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 107/222] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:21.101430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6202fb-502a-4377-a40e-8a8957b0cc44 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:21.102054 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f1339-80b1-410e-9809-3962530d4f37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:21.108429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-364f1339-80b1-410e-9809-3962530d4f37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:17:21.108429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:21.108429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:21.108429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:21.108429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:21.108429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:21.108429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:21.108429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:21.108429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:21.108429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:21.108429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:21.108429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:21.108429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:21.108429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:21.108429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:21.108429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:21.109335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:21.109335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:21.109335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:21.109335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:21.109335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:21.109335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:21.109335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:21.109335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:21.109335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:21.109335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:21.109335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:21.109335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:21.109335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:21.109335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:21.109335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:21.109335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:21.110093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:21.110093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:21.110093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:21.110093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:21.110093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:21.110093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:21.110093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:21.110093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:21.110093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:21.110093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:21.110093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:17:21.110093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:21.112564 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 116/223] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:17:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:17:21.114578 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4d1a5-0aa4-414d-b008-cb96400b61bf None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:21.115072 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4d1a5-0aa4-414d-b008-cb96400b61bf None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:21.115588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4d1a5-0aa4-414d-b008-cb96400b61bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:21.138878 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f0c4d1a5-0aa4-414d-b008-cb96400b61bf None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:21.140884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f0c4d1a5-0aa4-414d-b008-cb96400b61bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:21.195154 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:21.222295 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6202fb-502a-4377-a40e-8a8957b0cc44 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:21.224159 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:21.232902 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 117/224] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:21.240469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4d1a5-0aa4-414d-b008-cb96400b61bf None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:21.283889 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837e3f4-5c22-47ee-b63e-7c4e39403d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:21.284824 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837e3f4-5c22-47ee-b63e-7c4e39403d0d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:21.285278 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837e3f4-5c22-47ee-b63e-7c4e39403d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:21.285750 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837e3f4-5c22-47ee-b63e-7c4e39403d0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:21.286682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837e3f4-5c22-47ee-b63e-7c4e39403d0d None admin] RBAC: Adding query filter params (role.id=a463f0ebb5cf4516b0bec345d25071cb, scope.project.id=fcf93baab2904060974567318edbdc0b, user.id=e4b7e69fd4734d2fb29f049a5c09a5fa) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:21.287173 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837e3f4-5c22-47ee-b63e-7c4e39403d0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:21.289535 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837e3f4-5c22-47ee-b63e-7c4e39403d0d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:21.297395 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 108/225] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:17:21 2022] GET /identity/v3/role_assignments?user.id=e4b7e69fd4734d2fb29f049a5c09a5fa&scope.project.id=fcf93baab2904060974567318edbdc0b&role.id=a463f0ebb5cf4516b0bec345d25071cb => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:21.298178 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837e3f4-5c22-47ee-b63e-7c4e39403d0d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:21.394586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4d1a5-0aa4-414d-b008-cb96400b61bf None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:21.466844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc69ed-2a1f-40df-8e1b-20a7e85873fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:21.468040 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc69ed-2a1f-40df-8e1b-20a7e85873fb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:21.468516 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc69ed-2a1f-40df-8e1b-20a7e85873fb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:21.468980 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc69ed-2a1f-40df-8e1b-20a7e85873fb None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:21.470082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc69ed-2a1f-40df-8e1b-20a7e85873fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:21.471901 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc69ed-2a1f-40df-8e1b-20a7e85873fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:21.473755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc69ed-2a1f-40df-8e1b-20a7e85873fb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:21.489190 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 118/226] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:21.490410 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837e3f4-5c22-47ee-b63e-7c4e39403d0d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:21.495377 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc69ed-2a1f-40df-8e1b-20a7e85873fb None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:21.543074 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6951d-04a1-4841-adbb-dd82b1cfb2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:21.546104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6951d-04a1-4841-adbb-dd82b1cfb2ce None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:21.546591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6951d-04a1-4841-adbb-dd82b1cfb2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:21.547088 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6951d-04a1-4841-adbb-dd82b1cfb2ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:21.551324 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:21.576506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6951d-04a1-4841-adbb-dd82b1cfb2ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:21.581981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-94b6951d-04a1-4841-adbb-dd82b1cfb2ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 02:17:21.581981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:21.581981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:21.581981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:21.581981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:21.581981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:21.581981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:21.581981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:21.581981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:21.581981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:21.581981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:21.581981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:21.581981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:21.581981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:21.581981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:21.581981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:21.582827 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:21.582827 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:21.582827 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:21.582827 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:21.582827 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:21.582827 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:21.582827 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:21.582827 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:21.582827 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:21.582827 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:21.582827 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:21.582827 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:21.582827 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:21.582827 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:21.582827 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:21.582827 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:21.583598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:21.583598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:21.583598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:21.583598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:21.583598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:21.583598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:21.583598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:21.583598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:21.583598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:21.583598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:21.583598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 02:17:21.583598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:21.589461 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 109/227] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 9 02:17:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:21.595106 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6951d-04a1-4841-adbb-dd82b1cfb2ce None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:21.633058 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc69ed-2a1f-40df-8e1b-20a7e85873fb None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:21.666544 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:21.669229 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df748d15-b31c-4b01-92f2-722cfe66380f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:21.670093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df748d15-b31c-4b01-92f2-722cfe66380f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:21.670563 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df748d15-b31c-4b01-92f2-722cfe66380f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:21.671024 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df748d15-b31c-4b01-92f2-722cfe66380f None admin] PATH_INFO: `/v3/users/07332412fe16471fbb77476c238efdf7` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:21.672361 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df748d15-b31c-4b01-92f2-722cfe66380f None admin] RBAC: Authorizing `identity:get_user(user_id=07332412fe16471fbb77476c238efdf7)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:21.674115 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df748d15-b31c-4b01-92f2-722cfe66380f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:21.676318 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 119/228] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:21 2022] GET /identity/v3/users/07332412fe16471fbb77476c238efdf7 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:21.681507 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df748d15-b31c-4b01-92f2-722cfe66380f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:21.784125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6951d-04a1-4841-adbb-dd82b1cfb2ce None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:21.831986 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b789bc-f000-4c95-8ff3-49f78f897b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:21.834068 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b789bc-f000-4c95-8ff3-49f78f897b33 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:21.835849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b789bc-f000-4c95-8ff3-49f78f897b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:21.836320 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b789bc-f000-4c95-8ff3-49f78f897b33 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:21.837281 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b789bc-f000-4c95-8ff3-49f78f897b33 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:21.838863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b789bc-f000-4c95-8ff3-49f78f897b33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:21.840431 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b789bc-f000-4c95-8ff3-49f78f897b33 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:21.854935 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 110/229] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:17:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:21.861970 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b789bc-f000-4c95-8ff3-49f78f897b33 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:21.869042 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df748d15-b31c-4b01-92f2-722cfe66380f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:21.869548 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:21.905092 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1a7aa-0f4d-41b7-9045-3eaf4db2bf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:21.905735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1a7aa-0f4d-41b7-9045-3eaf4db2bf96 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:21.906016 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1a7aa-0f4d-41b7-9045-3eaf4db2bf96 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:21.906290 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1a7aa-0f4d-41b7-9045-3eaf4db2bf96 None admin] PATH_INFO: `/v3/projects/fcf93baab2904060974567318edbdc0b` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:21.907427 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1a7aa-0f4d-41b7-9045-3eaf4db2bf96 None admin] RBAC: Authorizing `identity:get_project(project_id=fcf93baab2904060974567318edbdc0b)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:21.908895 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1a7aa-0f4d-41b7-9045-3eaf4db2bf96 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:21.910857 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 120/230] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:21 2022] GET /identity/v3/projects/fcf93baab2904060974567318edbdc0b => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:21.916935 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1a7aa-0f4d-41b7-9045-3eaf4db2bf96 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:22.036558 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:22.064032 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b789bc-f000-4c95-8ff3-49f78f897b33 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:22.104926 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1a7aa-0f4d-41b7-9045-3eaf4db2bf96 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:22.126402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a37f4b-a718-4265-9296-fbb3a7493b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:22.127027 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a37f4b-a718-4265-9296-fbb3a7493b05 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:22.127309 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a37f4b-a718-4265-9296-fbb3a7493b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:22.127584 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a37f4b-a718-4265-9296-fbb3a7493b05 None admin] PATH_INFO: `/v3/users/07332412fe16471fbb77476c238efdf7` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:22.129477 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a37f4b-a718-4265-9296-fbb3a7493b05 None admin] RBAC: Authorizing `identity:get_user(user_id=07332412fe16471fbb77476c238efdf7)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:22.131000 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a37f4b-a718-4265-9296-fbb3a7493b05 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:22.134088 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 111/231] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:21 2022] GET /identity/v3/users/07332412fe16471fbb77476c238efdf7 => generated 283 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:22.140036 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a37f4b-a718-4265-9296-fbb3a7493b05 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:22.172356 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6dfca9-e6c5-4dcd-89b6-eef96cbdbad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:22.173112 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6dfca9-e6c5-4dcd-89b6-eef96cbdbad3 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:22.173398 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6dfca9-e6c5-4dcd-89b6-eef96cbdbad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:22.176161 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6dfca9-e6c5-4dcd-89b6-eef96cbdbad3 None admin] PATH_INFO: `/v3/projects/fcf93baab2904060974567318edbdc0b/users/07332412fe16471fbb77476c238efdf7/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:22.179668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6dfca9-e6c5-4dcd-89b6-eef96cbdbad3 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcf93baab2904060974567318edbdc0b, user_id=07332412fe16471fbb77476c238efdf7, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:22.181143 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6dfca9-e6c5-4dcd-89b6-eef96cbdbad3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:22.201805 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 121/232] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 9 02:17:21 2022] PUT /identity/v3/projects/fcf93baab2904060974567318edbdc0b/users/07332412fe16471fbb77476c238efdf7/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:17:22.280236 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a37f4b-a718-4265-9296-fbb3a7493b05 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:22.317265 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918af45-b310-495f-94c0-8c5eea87d1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:22.317816 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918af45-b310-495f-94c0-8c5eea87d1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:22.318097 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918af45-b310-495f-94c0-8c5eea87d1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:22.318367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918af45-b310-495f-94c0-8c5eea87d1c9 None admin] PATH_INFO: `/v3/projects/fcf93baab2904060974567318edbdc0b` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:22.319571 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918af45-b310-495f-94c0-8c5eea87d1c9 None admin] RBAC: Authorizing `identity:get_project(project_id=fcf93baab2904060974567318edbdc0b)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:22.321156 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918af45-b310-495f-94c0-8c5eea87d1c9 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:22.323157 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 112/233] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:22 2022] GET /identity/v3/projects/fcf93baab2904060974567318edbdc0b => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:22.328976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6dfca9-e6c5-4dcd-89b6-eef96cbdbad3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:22.387941 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:22.469656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6dfca9-e6c5-4dcd-89b6-eef96cbdbad3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:22.516018 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09336f-e2bf-4740-8d92-312104d00173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:22.516696 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09336f-e2bf-4740-8d92-312104d00173 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:22.516978 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09336f-e2bf-4740-8d92-312104d00173 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:22.517302 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09336f-e2bf-4740-8d92-312104d00173 None admin] PATH_INFO: `/v3/projects/fcf93baab2904060974567318edbdc0b/users/07332412fe16471fbb77476c238efdf7/roles/680e2c06ab714158b756dc317a3f4e2e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:22.519452 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09336f-e2bf-4740-8d92-312104d00173 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcf93baab2904060974567318edbdc0b, user_id=07332412fe16471fbb77476c238efdf7, role_id=680e2c06ab714158b756dc317a3f4e2e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:22.520914 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09336f-e2bf-4740-8d92-312104d00173 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:22.540314 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 122/234] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 9 02:17:22 2022] PUT /identity/v3/projects/fcf93baab2904060974567318edbdc0b/users/07332412fe16471fbb77476c238efdf7/roles/680e2c06ab714158b756dc317a3f4e2e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:17:22.977770 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b29f31-4d59-41dd-a8ba-8f2efb58dee9 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:22.978271 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b29f31-4d59-41dd-a8ba-8f2efb58dee9 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:22.978343 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b29f31-4d59-41dd-a8ba-8f2efb58dee9 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:22.979927 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 113/235] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:22.985453 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c1e45-648e-44d5-a437-f730be4882a7 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:22.986255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c1e45-648e-44d5-a437-f730be4882a7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:22.986723 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c1e45-648e-44d5-a437-f730be4882a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:23.014287 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-1c9c1e45-648e-44d5-a437-f730be4882a7 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:23.015862 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1c9c1e45-648e-44d5-a437-f730be4882a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:23.102212 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 123/236] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:23.135607 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b29f31-4d59-41dd-a8ba-8f2efb58dee9 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:23.171421 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:23.266520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b29f31-4d59-41dd-a8ba-8f2efb58dee9 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:23.269597 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2228db-3ddb-4cc3-b006-9b8da9324b78 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:23.270113 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2228db-3ddb-4cc3-b006-9b8da9324b78 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:23.270579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2228db-3ddb-4cc3-b006-9b8da9324b78 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:23.272464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 124/237] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:23.277432 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e7301-fc36-4c69-8ef3-f06c114a43a2 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:23.278440 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e7301-fc36-4c69-8ef3-f06c114a43a2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:23.278909 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e7301-fc36-4c69-8ef3-f06c114a43a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:23.304436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c04bf-c85c-423c-b58d-111cc3db440a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:23.304436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c04bf-c85c-423c-b58d-111cc3db440a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:23.304436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c04bf-c85c-423c-b58d-111cc3db440a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:23.304436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c04bf-c85c-423c-b58d-111cc3db440a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:23.313161 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c04bf-c85c-423c-b58d-111cc3db440a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:23.314277 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-6b6e7301-fc36-4c69-8ef3-f06c114a43a2 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:23.315661 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6b6e7301-fc36-4c69-8ef3-f06c114a43a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:23.321055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-c46c04bf-c85c-423c-b58d-111cc3db440a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 02:17:23.321055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:23.321055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:23.321055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:23.321055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:23.321055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:23.321055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:23.321055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:23.321055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:23.321055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:23.321055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:23.321055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:23.321055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:23.321055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:23.321055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:23.321055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:23.322104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:23.322104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:23.322104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:23.322104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:23.322104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:23.322104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:23.322104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:23.322104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:23.322104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:23.322104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:23.322104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:23.322104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:23.322104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:23.322104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:23.322104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:23.322104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:23.322861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:23.322861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:23.322861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:23.322861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:23.322861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:23.322861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:23.322861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:23.322861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:23.322861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:23.322861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:23.322861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 02:17:23.322861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:23.322861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 114/238] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:23.334016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c04bf-c85c-423c-b58d-111cc3db440a None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:23.349556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:23.410525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 125/239] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:23.435005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e7301-fc36-4c69-8ef3-f06c114a43a2 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:23.435563 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:23.451539 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c04bf-c85c-423c-b58d-111cc3db440a None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:23.489594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa2f2e-9fe7-477e-aa15-95729162ee69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:23.490453 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa2f2e-9fe7-477e-aa15-95729162ee69 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:23.491420 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa2f2e-9fe7-477e-aa15-95729162ee69 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:23.491834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa2f2e-9fe7-477e-aa15-95729162ee69 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:23.492763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa2f2e-9fe7-477e-aa15-95729162ee69 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:23.493234 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa2f2e-9fe7-477e-aa15-95729162ee69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:23.495017 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa2f2e-9fe7-477e-aa15-95729162ee69 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:23.504583 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 115/240] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:17:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:23.510203 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa2f2e-9fe7-477e-aa15-95729162ee69 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:23.655994 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa2f2e-9fe7-477e-aa15-95729162ee69 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:23.679485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e7301-fc36-4c69-8ef3-f06c114a43a2 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:23.692732 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f53b4-4e37-4b08-bc01-6a3f03ffc71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:23.693605 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f53b4-4e37-4b08-bc01-6a3f03ffc71a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:23.694711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f53b4-4e37-4b08-bc01-6a3f03ffc71a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:23.695139 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f53b4-4e37-4b08-bc01-6a3f03ffc71a None admin] PATH_INFO: `/v3/users/2f2cd91751f947cf8a14f5dadfb4bf07` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:23.711321 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f53b4-4e37-4b08-bc01-6a3f03ffc71a None admin] RBAC: Authorizing `identity:get_user(user_id=2f2cd91751f947cf8a14f5dadfb4bf07)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:23.713057 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f53b4-4e37-4b08-bc01-6a3f03ffc71a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:23.715406 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 116/241] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:23 2022] GET /identity/v3/users/2f2cd91751f947cf8a14f5dadfb4bf07 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:23.721959 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f53b4-4e37-4b08-bc01-6a3f03ffc71a None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:23.733355 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:23.758159 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938d7a5-f8b7-4309-b7dd-cda0b25d4dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:23.759219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938d7a5-f8b7-4309-b7dd-cda0b25d4dbb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:23.759632 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938d7a5-f8b7-4309-b7dd-cda0b25d4dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:23.760033 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938d7a5-f8b7-4309-b7dd-cda0b25d4dbb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:23.761421 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938d7a5-f8b7-4309-b7dd-cda0b25d4dbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:23.763614 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938d7a5-f8b7-4309-b7dd-cda0b25d4dbb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:23.766402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 126/242] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:17:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:23.767530 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1079a-6410-49f5-8f31-80640eb02573 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:23.767813 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1079a-6410-49f5-8f31-80640eb02573 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:23.772506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1079a-6410-49f5-8f31-80640eb02573 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:23.773855 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 127/243] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:23.777805 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1079a-6410-49f5-8f31-80640eb02573 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:23.801159 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:23.841961 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f53b4-4e37-4b08-bc01-6a3f03ffc71a None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:23.882163 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da2ef7-2c09-40df-9068-b6c49187f7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:23.882793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da2ef7-2c09-40df-9068-b6c49187f7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:23.883131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da2ef7-2c09-40df-9068-b6c49187f7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:23.883402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da2ef7-2c09-40df-9068-b6c49187f7c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:23.891377 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1079a-6410-49f5-8f31-80640eb02573 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:23.929502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8e343-f607-4fdc-a335-a4f9c1515735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:23.930040 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8e343-f607-4fdc-a335-a4f9c1515735 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:23.930323 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8e343-f607-4fdc-a335-a4f9c1515735 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:23.930654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8e343-f607-4fdc-a335-a4f9c1515735 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:23.931319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8e343-f607-4fdc-a335-a4f9c1515735 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:23.932803 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8e343-f607-4fdc-a335-a4f9c1515735 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:23.958068 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 128/244] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 9 02:17:23 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:17:23.959447 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5e51b-cc8c-4d0c-bb8c-767bc1328ae8 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:23.959806 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5e51b-cc8c-4d0c-bb8c-767bc1328ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:23.960089 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5e51b-cc8c-4d0c-bb8c-767bc1328ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:23.969161 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da2ef7-2c09-40df-9068-b6c49187f7c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:23.971034 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da2ef7-2c09-40df-9068-b6c49187f7c6 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:23.980749 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:23.990133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7ae5e51b-cc8c-4d0c-bb8c-767bc1328ae8 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:23.992162 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7ae5e51b-cc8c-4d0c-bb8c-767bc1328ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:24.081244 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 129/245] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:24.099213 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5e51b-cc8c-4d0c-bb8c-767bc1328ae8 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:24.108697 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:24.173503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 117/246] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:24.179608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da2ef7-2c09-40df-9068-b6c49187f7c6 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:24.219113 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5e51b-cc8c-4d0c-bb8c-767bc1328ae8 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:24.260019 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a86c19-813f-44b3-a280-4f7547027950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:24.261167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a86c19-813f-44b3-a280-4f7547027950 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:24.261652 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a86c19-813f-44b3-a280-4f7547027950 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:24.262122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a86c19-813f-44b3-a280-4f7547027950 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:24.274800 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a86c19-813f-44b3-a280-4f7547027950 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:24.280252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-38a86c19-813f-44b3-a280-4f7547027950 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:24.280252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:24.280252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:24.280252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:24.280252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:24.280252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:24.280252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:24.280252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:24.280252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:24.280252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:24.280252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:24.280252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:24.280252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:24.280252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:24.280252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:24.280252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:24.282150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:24.282150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:24.282150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:24.282150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:24.282150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:24.282150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:24.282150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:24.282150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:24.282150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:24.282150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:24.282150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:24.282150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:24.282150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:24.282150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:24.282150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:24.282150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:24.283152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:24.283152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:24.283152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:24.283152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:24.283152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:24.283152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:24.283152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:24.283152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:24.283152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:24.283152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:24.283152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:24.283152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:24.289136 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 130/247] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:24.291960 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a86c19-813f-44b3-a280-4f7547027950 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:24.338720 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da2ef7-2c09-40df-9068-b6c49187f7c6 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:24.341435 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:24.378474 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:24.389480 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a60323-0e6e-4d4b-a5d6-06f145e1f88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:24.390413 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a60323-0e6e-4d4b-a5d6-06f145e1f88d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:24.390871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a60323-0e6e-4d4b-a5d6-06f145e1f88d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:24.391320 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a60323-0e6e-4d4b-a5d6-06f145e1f88d None admin] PATH_INFO: `/v3/projects/fcf93baab2904060974567318edbdc0b` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:24.393244 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a60323-0e6e-4d4b-a5d6-06f145e1f88d None admin] RBAC: Authorizing `identity:get_project(project_id=fcf93baab2904060974567318edbdc0b)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:24.395394 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a60323-0e6e-4d4b-a5d6-06f145e1f88d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:24.398344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 118/248] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:24 2022] GET /identity/v3/projects/fcf93baab2904060974567318edbdc0b => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:24.404140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a60323-0e6e-4d4b-a5d6-06f145e1f88d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:24.423114 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a86c19-813f-44b3-a280-4f7547027950 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:24.478516 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e87e7-7df5-4829-8613-189e633dd1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:24.479058 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e87e7-7df5-4829-8613-189e633dd1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:24.479335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e87e7-7df5-4829-8613-189e633dd1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:24.479603 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e87e7-7df5-4829-8613-189e633dd1c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:24.480284 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e87e7-7df5-4829-8613-189e633dd1c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:24.480585 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e87e7-7df5-4829-8613-189e633dd1c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:24.482092 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e87e7-7df5-4829-8613-189e633dd1c5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:24.495060 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 131/249] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:17:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:24.500868 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e87e7-7df5-4829-8613-189e633dd1c5 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:24.547547 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a60323-0e6e-4d4b-a5d6-06f145e1f88d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:24.608566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407464a-430f-4615-91ac-1df6e2828cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:24.609218 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407464a-430f-4615-91ac-1df6e2828cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:24.609505 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407464a-430f-4615-91ac-1df6e2828cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:24.609816 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407464a-430f-4615-91ac-1df6e2828cc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:24.611194 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407464a-430f-4615-91ac-1df6e2828cc9 None admin] RBAC: Adding query filter params (role.id=61e3cf9f4de64b22b7254b339eab813b, scope.project.id=fcf93baab2904060974567318edbdc0b, user.id=2f2cd91751f947cf8a14f5dadfb4bf07) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:24.611517 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407464a-430f-4615-91ac-1df6e2828cc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:24.613389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407464a-430f-4615-91ac-1df6e2828cc9 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:24.624690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 119/250] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:17:24 2022] GET /identity/v3/role_assignments?user.id=2f2cd91751f947cf8a14f5dadfb4bf07&scope.project.id=fcf93baab2904060974567318edbdc0b&role.id=61e3cf9f4de64b22b7254b339eab813b => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:24.652678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e87e7-7df5-4829-8613-189e633dd1c5 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:24.687901 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:24.707753 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35035e71-f4c6-4ff4-851b-3e6781ae9c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:24.708767 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35035e71-f4c6-4ff4-851b-3e6781ae9c99 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:24.709288 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35035e71-f4c6-4ff4-851b-3e6781ae9c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:24.713763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35035e71-f4c6-4ff4-851b-3e6781ae9c99 None admin] PATH_INFO: `/v3/users/e4b7e69fd4734d2fb29f049a5c09a5fa` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:24.716746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35035e71-f4c6-4ff4-851b-3e6781ae9c99 None admin] RBAC: Authorizing `identity:get_user(user_id=e4b7e69fd4734d2fb29f049a5c09a5fa)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:24.719162 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35035e71-f4c6-4ff4-851b-3e6781ae9c99 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:24.725961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 132/251] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:24 2022] GET /identity/v3/users/e4b7e69fd4734d2fb29f049a5c09a5fa => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:24.731239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407464a-430f-4615-91ac-1df6e2828cc9 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:24.780696 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:24.853889 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407464a-430f-4615-91ac-1df6e2828cc9 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:24.888488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7b0a0-720f-49c3-9483-e8afe524d29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:24.889162 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7b0a0-720f-49c3-9483-e8afe524d29f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:24.889443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7b0a0-720f-49c3-9483-e8afe524d29f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:24.889713 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7b0a0-720f-49c3-9483-e8afe524d29f None admin] PATH_INFO: `/v3/projects/fcf93baab2904060974567318edbdc0b` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:24.890839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7b0a0-720f-49c3-9483-e8afe524d29f None admin] RBAC: Authorizing `identity:get_project(project_id=fcf93baab2904060974567318edbdc0b)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:24.892303 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7b0a0-720f-49c3-9483-e8afe524d29f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:24.894260 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 120/252] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:24 2022] GET /identity/v3/projects/fcf93baab2904060974567318edbdc0b => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:24.900565 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35035e71-f4c6-4ff4-851b-3e6781ae9c99 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:24.923583 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc90ac-f8a1-4f01-b4f2-1e022e57e2e5 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:24.923886 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc90ac-f8a1-4f01-b4f2-1e022e57e2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:24.924128 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc90ac-f8a1-4f01-b4f2-1e022e57e2e5 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:24.925822 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 121/253] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:17:24.930826 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6c169-f811-4281-b749-912b88d535e1 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:24.931115 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6c169-f811-4281-b749-912b88d535e1 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:24.931398 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6c169-f811-4281-b749-912b88d535e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:24.949699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-1ff6c169-f811-4281-b749-912b88d535e1 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:24.950933 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1ff6c169-f811-4281-b749-912b88d535e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:25.023212 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35035e71-f4c6-4ff4-851b-3e6781ae9c99 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:25.061488 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e7f04-b5ee-4c82-80fb-c5a42186113b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:25.062506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e7f04-b5ee-4c82-80fb-c5a42186113b None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:25.063031 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e7f04-b5ee-4c82-80fb-c5a42186113b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:25.063504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e7f04-b5ee-4c82-80fb-c5a42186113b None admin] PATH_INFO: `/v3/projects/fcf93baab2904060974567318edbdc0b/users/e4b7e69fd4734d2fb29f049a5c09a5fa/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:25.065668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e7f04-b5ee-4c82-80fb-c5a42186113b None admin] RBAC: Authorizing `identity:create_grant(project_id=fcf93baab2904060974567318edbdc0b, user_id=e4b7e69fd4734d2fb29f049a5c09a5fa, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:25.067338 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e7f04-b5ee-4c82-80fb-c5a42186113b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:25.093175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 133/254] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 9 02:17:24 2022] PUT /identity/v3/projects/fcf93baab2904060974567318edbdc0b/users/e4b7e69fd4734d2fb29f049a5c09a5fa/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:17:25.095017 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390221f6-eb8c-4cc1-8013-541a879d115b None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:25.095505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390221f6-eb8c-4cc1-8013-541a879d115b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:25.096510 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390221f6-eb8c-4cc1-8013-541a879d115b None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:25.098062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 134/255] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:25.105508 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea1832-35d7-4a22-a871-7b9bf7d7de40 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:25.106152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea1832-35d7-4a22-a871-7b9bf7d7de40 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:25.106627 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea1832-35d7-4a22-a871-7b9bf7d7de40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:25.130043 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 122/256] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 02:17:25.136597 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-52ea1832-35d7-4a22-a871-7b9bf7d7de40 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:25.138063 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-52ea1832-35d7-4a22-a871-7b9bf7d7de40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:25.173195 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6c169-f811-4281-b749-912b88d535e1 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:25.229052 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:25.230656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:25.262677 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 135/257] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:25.304865 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea1832-35d7-4a22-a871-7b9bf7d7de40 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:25.363241 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6c169-f811-4281-b749-912b88d535e1 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:25.437030 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea1832-35d7-4a22-a871-7b9bf7d7de40 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:25.456197 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcff81f-270d-4a8d-809b-0ec815a5f7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:25.456843 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcff81f-270d-4a8d-809b-0ec815a5f7ed None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:25.457177 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcff81f-270d-4a8d-809b-0ec815a5f7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:25.457446 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcff81f-270d-4a8d-809b-0ec815a5f7ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:25.476073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcff81f-270d-4a8d-809b-0ec815a5f7ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:25.481773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-4fcff81f-270d-4a8d-809b-0ec815a5f7ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 02:17:25.481773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:25.481773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:25.481773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:25.481773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:25.481773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:25.481773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:25.481773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:25.481773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:25.481773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:25.481773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:25.481773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:25.481773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:25.481773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:25.481773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:25.481773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:25.482626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:25.482626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:25.482626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:25.482626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:25.482626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:25.482626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:25.482626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:25.482626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:25.482626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:25.482626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:25.482626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:25.482626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:25.482626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:25.482626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:25.482626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:25.482626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:25.483874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:25.483874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:25.483874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:25.483874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:25.483874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:25.483874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:25.483874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:25.483874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:25.483874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:25.483874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:25.483874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 02:17:25.483874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:25.483874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 123/258] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 9 02:17:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:17:25.488345 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367bc63-6da4-44f4-b794-e2c9ca8efedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:25.489070 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367bc63-6da4-44f4-b794-e2c9ca8efedd None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:25.489355 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367bc63-6da4-44f4-b794-e2c9ca8efedd None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:25.489625 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367bc63-6da4-44f4-b794-e2c9ca8efedd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:25.490941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcff81f-270d-4a8d-809b-0ec815a5f7ed None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:25.511934 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367bc63-6da4-44f4-b794-e2c9ca8efedd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:25.518960 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-0367bc63-6da4-44f4-b794-e2c9ca8efedd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:17:25.518960 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:25.518960 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:25.518960 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:25.518960 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:25.518960 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:25.518960 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:25.518960 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:25.518960 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:25.518960 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:25.518960 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:25.518960 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:25.518960 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:25.518960 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:25.518960 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:25.518960 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:25.519835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:25.519835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:25.519835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:25.519835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:25.519835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:25.519835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:25.519835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:25.519835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:25.519835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:25.519835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:25.519835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:25.519835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:25.519835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:25.519835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:25.519835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:25.519835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:25.520617 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:25.520617 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:25.520617 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:25.520617 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:25.520617 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:25.520617 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:25.520617 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:25.520617 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:25.520617 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:25.520617 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:25.520617 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:17:25.520617 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:25.522611 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 136/259] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:17:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:17:25.529954 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367bc63-6da4-44f4-b794-e2c9ca8efedd None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:25.616729 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:25.665041 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:25.675950 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcff81f-270d-4a8d-809b-0ec815a5f7ed None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:25.712626 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367bc63-6da4-44f4-b794-e2c9ca8efedd None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:25.738712 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb8138-c434-4e9c-8f3c-7e23e82e2b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:25.739322 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb8138-c434-4e9c-8f3c-7e23e82e2b5d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:25.739597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb8138-c434-4e9c-8f3c-7e23e82e2b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:25.739870 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb8138-c434-4e9c-8f3c-7e23e82e2b5d None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:25.741125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb8138-c434-4e9c-8f3c-7e23e82e2b5d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:25.741437 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb8138-c434-4e9c-8f3c-7e23e82e2b5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:25.742820 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb8138-c434-4e9c-8f3c-7e23e82e2b5d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:25.760837 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 124/260] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:17:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:25.765984 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb8138-c434-4e9c-8f3c-7e23e82e2b5d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:25.783102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fcbb16-ec94-4824-a990-9b4f4c9a70f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:25.783710 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcbb16-ec94-4824-a990-9b4f4c9a70f2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:25.783985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcbb16-ec94-4824-a990-9b4f4c9a70f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:25.784255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcbb16-ec94-4824-a990-9b4f4c9a70f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:25.784977 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fcbb16-ec94-4824-a990-9b4f4c9a70f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:25.791225 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fcbb16-ec94-4824-a990-9b4f4c9a70f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:25.791225 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fcbb16-ec94-4824-a990-9b4f4c9a70f2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:25.802322 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 137/261] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:25.809442 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fcbb16-ec94-4824-a990-9b4f4c9a70f2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:26.016837 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb8138-c434-4e9c-8f3c-7e23e82e2b5d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:26.041166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fcbb16-ec94-4824-a990-9b4f4c9a70f2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:26.060223 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:26.085956 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d0082-a88b-48b9-9774-9f648c9c1962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:26.087016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d0082-a88b-48b9-9774-9f648c9c1962 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:26.087513 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d0082-a88b-48b9-9774-9f648c9c1962 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:26.087980 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d0082-a88b-48b9-9774-9f648c9c1962 None admin] PATH_INFO: `/v3/users/07332412fe16471fbb77476c238efdf7` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:26.089454 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d0082-a88b-48b9-9774-9f648c9c1962 None admin] RBAC: Authorizing `identity:get_user(user_id=07332412fe16471fbb77476c238efdf7)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:26.091107 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d0082-a88b-48b9-9774-9f648c9c1962 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:26.093291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 125/262] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:25 2022] GET /identity/v3/users/07332412fe16471fbb77476c238efdf7 => generated 283 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:26.098829 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d0082-a88b-48b9-9774-9f648c9c1962 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:26.124143 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9995a9-a859-413d-975a-84227a6428d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:26.124784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9995a9-a859-413d-975a-84227a6428d9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:26.125080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9995a9-a859-413d-975a-84227a6428d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:26.125353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9995a9-a859-413d-975a-84227a6428d9 None admin] PATH_INFO: `/v3/users/07332412fe16471fbb77476c238efdf7` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:26.127183 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9995a9-a859-413d-975a-84227a6428d9 None admin] RBAC: Authorizing `identity:get_user(user_id=07332412fe16471fbb77476c238efdf7)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:26.128692 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9995a9-a859-413d-975a-84227a6428d9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:26.132032 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 138/263] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:25 2022] GET /identity/v3/users/07332412fe16471fbb77476c238efdf7 => generated 283 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:26.138630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9995a9-a859-413d-975a-84227a6428d9 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:26.154793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:26.304627 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d0082-a88b-48b9-9774-9f648c9c1962 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:26.338657 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9995a9-a859-413d-975a-84227a6428d9 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:26.367727 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc3cd1-0f77-4d1a-a9a8-f33d521a2dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:26.368336 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc3cd1-0f77-4d1a-a9a8-f33d521a2dcf None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:26.368867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc3cd1-0f77-4d1a-a9a8-f33d521a2dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:26.369162 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc3cd1-0f77-4d1a-a9a8-f33d521a2dcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:26.399092 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a5d0d-f046-44ff-9cf6-35bf3b72ac15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:26.399702 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a5d0d-f046-44ff-9cf6-35bf3b72ac15 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:26.399977 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a5d0d-f046-44ff-9cf6-35bf3b72ac15 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:26.400244 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a5d0d-f046-44ff-9cf6-35bf3b72ac15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:26.476143 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:26.489675 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc3cd1-0f77-4d1a-a9a8-f33d521a2dcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:26.491695 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc3cd1-0f77-4d1a-a9a8-f33d521a2dcf None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:26.518450 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a5d0d-f046-44ff-9cf6-35bf3b72ac15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:26.519921 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a5d0d-f046-44ff-9cf6-35bf3b72ac15 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:26.542648 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:26.679485 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 126/264] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 02:17:26.686147 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc3cd1-0f77-4d1a-a9a8-f33d521a2dcf None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:26.701843 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 139/265] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:26.710108 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a5d0d-f046-44ff-9cf6-35bf3b72ac15 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:26.819255 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc3cd1-0f77-4d1a-a9a8-f33d521a2dcf None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:26.830349 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:26.842808 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:26.854220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59609a90-718e-4bff-be6f-07f002e2121d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:26.854865 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59609a90-718e-4bff-be6f-07f002e2121d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:26.855134 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59609a90-718e-4bff-be6f-07f002e2121d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:26.855414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59609a90-718e-4bff-be6f-07f002e2121d None admin] PATH_INFO: `/v3/projects/fcf93baab2904060974567318edbdc0b` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:26.856543 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59609a90-718e-4bff-be6f-07f002e2121d None admin] RBAC: Authorizing `identity:get_project(project_id=fcf93baab2904060974567318edbdc0b)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:26.858029 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59609a90-718e-4bff-be6f-07f002e2121d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:26.859973 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 127/266] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:26 2022] GET /identity/v3/projects/fcf93baab2904060974567318edbdc0b => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:26.860957 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a5d0d-f046-44ff-9cf6-35bf3b72ac15 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:26.869824 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59609a90-718e-4bff-be6f-07f002e2121d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:26.939252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc3a77-dfdb-452e-b00c-64056de2e71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:26.939816 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc3a77-dfdb-452e-b00c-64056de2e71b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:26.940096 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc3a77-dfdb-452e-b00c-64056de2e71b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:26.940372 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc3a77-dfdb-452e-b00c-64056de2e71b None admin] PATH_INFO: `/v3/projects/fcf93baab2904060974567318edbdc0b` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:26.945751 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc3a77-dfdb-452e-b00c-64056de2e71b None admin] RBAC: Authorizing `identity:get_project(project_id=fcf93baab2904060974567318edbdc0b)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:26.947236 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc3a77-dfdb-452e-b00c-64056de2e71b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:26.949268 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 140/267] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:26 2022] GET /identity/v3/projects/fcf93baab2904060974567318edbdc0b => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:26.960156 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc3a77-dfdb-452e-b00c-64056de2e71b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:27.078612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59609a90-718e-4bff-be6f-07f002e2121d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:27.139128 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c3572-326e-4535-a190-e9650c978d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:27.140132 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c3572-326e-4535-a190-e9650c978d0c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:27.141572 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c3572-326e-4535-a190-e9650c978d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:27.142058 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c3572-326e-4535-a190-e9650c978d0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:27.143020 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c3572-326e-4535-a190-e9650c978d0c None admin] RBAC: Adding query filter params (role.id=680e2c06ab714158b756dc317a3f4e2e, scope.project.id=fcf93baab2904060974567318edbdc0b, user.id=07332412fe16471fbb77476c238efdf7) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:27.143535 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c3572-326e-4535-a190-e9650c978d0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:27.145228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c3572-326e-4535-a190-e9650c978d0c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:27.159490 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 128/268] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:17:26 2022] GET /identity/v3/role_assignments?user.id=07332412fe16471fbb77476c238efdf7&scope.project.id=fcf93baab2904060974567318edbdc0b&role.id=680e2c06ab714158b756dc317a3f4e2e => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:27.202952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc3a77-dfdb-452e-b00c-64056de2e71b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:27.216915 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e5733-dc14-4a38-8c6d-4127c1a29748 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:27.217376 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e5733-dc14-4a38-8c6d-4127c1a29748 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:27.217492 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e5733-dc14-4a38-8c6d-4127c1a29748 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:27.219332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 129/269] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:17:27.225424 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58fe95-30f8-4331-9789-9db68e84f833 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:27.226029 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58fe95-30f8-4331-9789-9db68e84f833 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:27.226498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58fe95-30f8-4331-9789-9db68e84f833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:27.245979 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-ea58fe95-30f8-4331-9789-9db68e84f833 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:27.247559 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ea58fe95-30f8-4331-9789-9db68e84f833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:27.274861 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0258d1-848d-4fac-8e67-6b4877b46cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:27.275272 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0258d1-848d-4fac-8e67-6b4877b46cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:27.275555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0258d1-848d-4fac-8e67-6b4877b46cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:27.275827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0258d1-848d-4fac-8e67-6b4877b46cf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:27.276706 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0258d1-848d-4fac-8e67-6b4877b46cf3 None admin] RBAC: Adding query filter params (role.id=e2095c5a29d74c33b9dcb16f8e5343bf, scope.project.id=fcf93baab2904060974567318edbdc0b, user.id=07332412fe16471fbb77476c238efdf7) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:27.276887 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0258d1-848d-4fac-8e67-6b4877b46cf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:27.278426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0258d1-848d-4fac-8e67-6b4877b46cf3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:27.291846 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 141/270] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:17:26 2022] GET /identity/v3/role_assignments?user.id=07332412fe16471fbb77476c238efdf7&scope.project.id=fcf93baab2904060974567318edbdc0b&role.id=e2095c5a29d74c33b9dcb16f8e5343bf => generated 608 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:27.311433 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:27.326502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 130/271] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 02:17:27.349227 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0258d1-848d-4fac-8e67-6b4877b46cf3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:27.362760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:27.483802 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0258d1-848d-4fac-8e67-6b4877b46cf3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:27.534055 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd698761-4978-48b5-833c-34696fc16ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:27.534716 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd698761-4978-48b5-833c-34696fc16ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:27.534994 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd698761-4978-48b5-833c-34696fc16ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:27.535337 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd698761-4978-48b5-833c-34696fc16ab7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:27.539991 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fba67-2729-4762-9b46-b28ae6b40e87 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:27.540270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fba67-2729-4762-9b46-b28ae6b40e87 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:27.540543 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fba67-2729-4762-9b46-b28ae6b40e87 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:27.541950 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 131/272] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:17:27.547577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f84f8-eac6-41fc-99bf-7b3ee5b4b86f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:27.547873 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f84f8-eac6-41fc-99bf-7b3ee5b4b86f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:27.548118 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f84f8-eac6-41fc-99bf-7b3ee5b4b86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:27.555033 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd698761-4978-48b5-833c-34696fc16ab7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:27.560457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-fd698761-4978-48b5-833c-34696fc16ab7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 02:17:27.560457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:27.560457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:27.560457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:27.560457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:27.560457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:27.560457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:27.560457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:27.560457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:27.560457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:27.560457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:27.560457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:27.560457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:27.560457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:27.560457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:27.560457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:27.561431 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:27.561431 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:27.561431 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:27.561431 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:27.561431 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:27.561431 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:27.561431 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:27.561431 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:27.561431 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:27.561431 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:27.561431 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:27.561431 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:27.561431 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:27.561431 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:27.561431 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:27.561431 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:27.562207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:27.562207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:27.562207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:27.562207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:27.562207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:27.562207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:27.562207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:27.562207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:27.562207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:27.562207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:27.562207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 02:17:27.562207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:27.565579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 142/273] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:27.569537 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd698761-4978-48b5-833c-34696fc16ab7 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:27.590963 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-d04f84f8-eac6-41fc-99bf-7b3ee5b4b86f None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:27.592190 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d04f84f8-eac6-41fc-99bf-7b3ee5b4b86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:27.677409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:27.698668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd698761-4978-48b5-833c-34696fc16ab7 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:27.711719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 132/274] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 02:17:27.747119 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f84f8-eac6-41fc-99bf-7b3ee5b4b86f None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:27.752413 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc659359-2bd2-42ea-86ed-c60e545a26b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:27.753256 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc659359-2bd2-42ea-86ed-c60e545a26b7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:27.753703 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc659359-2bd2-42ea-86ed-c60e545a26b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:27.754180 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc659359-2bd2-42ea-86ed-c60e545a26b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:27.755058 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc659359-2bd2-42ea-86ed-c60e545a26b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:27.755505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc659359-2bd2-42ea-86ed-c60e545a26b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:27.757614 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc659359-2bd2-42ea-86ed-c60e545a26b7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:27.770459 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 143/275] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:17:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:27.780131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc659359-2bd2-42ea-86ed-c60e545a26b7 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:27.879015 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f84f8-eac6-41fc-99bf-7b3ee5b4b86f None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:27.896176 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:27.911301 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc659359-2bd2-42ea-86ed-c60e545a26b7 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:27.914801 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c500d-71e3-4d43-8eda-36da79601afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:27.915436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c500d-71e3-4d43-8eda-36da79601afa None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:27.915713 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c500d-71e3-4d43-8eda-36da79601afa None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:27.915982 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c500d-71e3-4d43-8eda-36da79601afa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:27.927758 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c500d-71e3-4d43-8eda-36da79601afa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:27.933113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-278c500d-71e3-4d43-8eda-36da79601afa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:27.933113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:27.933113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:27.933113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:27.933113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:27.933113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:27.933113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:27.933113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:27.933113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:27.933113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:27.933113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:27.933113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:27.933113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:27.933113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:27.933113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:27.933113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:27.933964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:27.933964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:27.933964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:27.933964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:27.933964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:27.933964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:27.933964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:27.933964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:27.933964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:27.933964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:27.933964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:27.933964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:27.933964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:27.933964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:27.933964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:27.933964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:27.935524 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:27.935524 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:27.935524 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:27.935524 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:27.935524 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:27.935524 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:27.935524 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:27.935524 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:27.935524 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:27.935524 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:27.935524 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:27.935524 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:27.935524 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 133/276] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:27.936159 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319c80e-0021-4e3f-add6-96d410905f28 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:27.936159 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319c80e-0021-4e3f-add6-96d410905f28 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:27.936271 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319c80e-0021-4e3f-add6-96d410905f28 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:27.937734 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 134/277] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:27.942488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319c80e-0021-4e3f-add6-96d410905f28 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:27.948158 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:27.954481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab991c-9026-4738-bbd9-83e1dfeb292e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:27.955116 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab991c-9026-4738-bbd9-83e1dfeb292e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:27.955395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab991c-9026-4738-bbd9-83e1dfeb292e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:27.955663 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab991c-9026-4738-bbd9-83e1dfeb292e None admin] PATH_INFO: `/v3/users/2f2cd91751f947cf8a14f5dadfb4bf07` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:27.956789 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab991c-9026-4738-bbd9-83e1dfeb292e None admin] RBAC: Authorizing `identity:get_user(user_id=2f2cd91751f947cf8a14f5dadfb4bf07)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:27.958294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab991c-9026-4738-bbd9-83e1dfeb292e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:27.964381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 144/278] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:27 2022] GET /identity/v3/users/2f2cd91751f947cf8a14f5dadfb4bf07 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:27.964381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0620c8e-e2f3-467e-ab93-f97586afc41d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:27.964381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0620c8e-e2f3-467e-ab93-f97586afc41d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:27.964381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0620c8e-e2f3-467e-ab93-f97586afc41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:27.978805 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e0620c8e-e2f3-467e-ab93-f97586afc41d None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:27.979989 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e0620c8e-e2f3-467e-ab93-f97586afc41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:28.060690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 145/279] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:28.062146 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0620c8e-e2f3-467e-ab93-f97586afc41d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:28.062334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319c80e-0021-4e3f-add6-96d410905f28 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:28.107507 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136406fa-90da-42f3-a520-7e5d465ef2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:28.108162 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136406fa-90da-42f3-a520-7e5d465ef2cd None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:28.108483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136406fa-90da-42f3-a520-7e5d465ef2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:28.108763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136406fa-90da-42f3-a520-7e5d465ef2cd None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:28.109470 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136406fa-90da-42f3-a520-7e5d465ef2cd None admin] RBAC: Adding query filter params (name=member) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:28.109778 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136406fa-90da-42f3-a520-7e5d465ef2cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:28.111253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136406fa-90da-42f3-a520-7e5d465ef2cd None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:28.120468 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 135/280] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:17:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:28.125743 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136406fa-90da-42f3-a520-7e5d465ef2cd None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:28.164493 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:28.175917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0620c8e-e2f3-467e-ab93-f97586afc41d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:28.205501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:28.215299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9fe6d-65de-4c96-ba56-5e427962edb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:28.215932 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9fe6d-65de-4c96-ba56-5e427962edb5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:28.216221 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9fe6d-65de-4c96-ba56-5e427962edb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:28.216484 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9fe6d-65de-4c96-ba56-5e427962edb5 None admin] PATH_INFO: `/v3/projects/fcf93baab2904060974567318edbdc0b` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:28.217713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9fe6d-65de-4c96-ba56-5e427962edb5 None admin] RBAC: Authorizing `identity:get_project(project_id=fcf93baab2904060974567318edbdc0b)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:28.219370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9fe6d-65de-4c96-ba56-5e427962edb5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:28.221233 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 146/281] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:28 2022] GET /identity/v3/projects/fcf93baab2904060974567318edbdc0b => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:28.226630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9fe6d-65de-4c96-ba56-5e427962edb5 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:28.228945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136406fa-90da-42f3-a520-7e5d465ef2cd None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:28.263019 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe282e-b93c-4da8-bf62-c7b7fe2532bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:28.263638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe282e-b93c-4da8-bf62-c7b7fe2532bf None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:28.263914 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe282e-b93c-4da8-bf62-c7b7fe2532bf None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:28.264180 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe282e-b93c-4da8-bf62-c7b7fe2532bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:28.265301 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe282e-b93c-4da8-bf62-c7b7fe2532bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:28.266747 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe282e-b93c-4da8-bf62-c7b7fe2532bf None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:28.268300 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 136/282] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:17:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:28.269045 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe282e-b93c-4da8-bf62-c7b7fe2532bf None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:28.330347 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9fe6d-65de-4c96-ba56-5e427962edb5 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:28.363406 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9441c79-9a9b-49de-971c-a336b72b5c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:28.364033 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9441c79-9a9b-49de-971c-a336b72b5c4f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:28.364314 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9441c79-9a9b-49de-971c-a336b72b5c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:28.364587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9441c79-9a9b-49de-971c-a336b72b5c4f None admin] PATH_INFO: `/v3/users/09be5d8d92034b4f9e59abcf36ddb884` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:28.366220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe282e-b93c-4da8-bf62-c7b7fe2532bf None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:28.373186 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:28.379468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9441c79-9a9b-49de-971c-a336b72b5c4f None admin] RBAC: Authorizing `identity:get_user(user_id=09be5d8d92034b4f9e59abcf36ddb884)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:28.380936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9441c79-9a9b-49de-971c-a336b72b5c4f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:28.382590 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 147/283] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:28 2022] GET /identity/v3/users/09be5d8d92034b4f9e59abcf36ddb884 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:28.383733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f4667-eb4b-4ba7-90df-3ed9021091d4 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:28.384015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f4667-eb4b-4ba7-90df-3ed9021091d4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:28.384284 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f4667-eb4b-4ba7-90df-3ed9021091d4 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:28.385502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 148/284] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:28.386183 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f4667-eb4b-4ba7-90df-3ed9021091d4 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:28.407159 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb22fa-2cee-42a2-9cb3-1f77eb8363f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:28.407819 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb22fa-2cee-42a2-9cb3-1f77eb8363f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:28.408104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb22fa-2cee-42a2-9cb3-1f77eb8363f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:28.408385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb22fa-2cee-42a2-9cb3-1f77eb8363f9 None admin] PATH_INFO: `/v3/projects/fcf93baab2904060974567318edbdc0b/users/2f2cd91751f947cf8a14f5dadfb4bf07/roles/61e3cf9f4de64b22b7254b339eab813b` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:28.410355 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb22fa-2cee-42a2-9cb3-1f77eb8363f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcf93baab2904060974567318edbdc0b, user_id=2f2cd91751f947cf8a14f5dadfb4bf07, role_id=61e3cf9f4de64b22b7254b339eab813b)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:28.411798 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb22fa-2cee-42a2-9cb3-1f77eb8363f9 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:28.424601 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 137/285] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 9 02:17:28 2022] PUT /identity/v3/projects/fcf93baab2904060974567318edbdc0b/users/2f2cd91751f947cf8a14f5dadfb4bf07/roles/61e3cf9f4de64b22b7254b339eab813b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:17:28.425452 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb22fa-2cee-42a2-9cb3-1f77eb8363f9 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:28.451191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:28.503195 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f4667-eb4b-4ba7-90df-3ed9021091d4 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:28.541345 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb22fa-2cee-42a2-9cb3-1f77eb8363f9 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:28.543278 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca61c07-b9b6-4df4-ac8d-749d0daed26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:28.543980 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca61c07-b9b6-4df4-ac8d-749d0daed26f None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:28.544265 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca61c07-b9b6-4df4-ac8d-749d0daed26f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:28.544535 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca61c07-b9b6-4df4-ac8d-749d0daed26f None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:28.545229 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca61c07-b9b6-4df4-ac8d-749d0daed26f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:28.546680 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca61c07-b9b6-4df4-ac8d-749d0daed26f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:28.572355 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 149/286] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 9 02:17:28 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:17:28.574812 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422006d6-ad4c-4be4-8ac1-9246ca8c5493 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:28.575303 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422006d6-ad4c-4be4-8ac1-9246ca8c5493 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:28.575766 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422006d6-ad4c-4be4-8ac1-9246ca8c5493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:28.591217 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c25f6-4831-4ce5-b0ed-f7a5fd137da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:28.591782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c25f6-4831-4ce5-b0ed-f7a5fd137da9 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:28.592062 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c25f6-4831-4ce5-b0ed-f7a5fd137da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:28.592334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c25f6-4831-4ce5-b0ed-f7a5fd137da9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:28.594280 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c25f6-4831-4ce5-b0ed-f7a5fd137da9 None admin] RBAC: Adding query filter params (role.id=a463f0ebb5cf4516b0bec345d25071cb, user.id=09be5d8d92034b4f9e59abcf36ddb884, scope.system=all) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:28.594621 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c25f6-4831-4ce5-b0ed-f7a5fd137da9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:28.596194 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c25f6-4831-4ce5-b0ed-f7a5fd137da9 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:28.596302 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-422006d6-ad4c-4be4-8ac1-9246ca8c5493 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:28.597563 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-422006d6-ad4c-4be4-8ac1-9246ca8c5493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:28.602787 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 138/287] 10.222.0.16 () {56 vars in 1308 bytes} [Tue Aug 9 02:17:28 2022] GET /identity/v3/role_assignments?user.id=09be5d8d92034b4f9e59abcf36ddb884&scope.system=all&role.id=a463f0ebb5cf4516b0bec345d25071cb => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:28.682611 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 150/288] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:28.706420 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c25f6-4831-4ce5-b0ed-f7a5fd137da9 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:28.744718 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:28.821730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c25f6-4831-4ce5-b0ed-f7a5fd137da9 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:28.855591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ccf6a6-19f3-4ad5-a3de-f57e26f59573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:28.856155 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccf6a6-19f3-4ad5-a3de-f57e26f59573 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:28.856463 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccf6a6-19f3-4ad5-a3de-f57e26f59573 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:28.856711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccf6a6-19f3-4ad5-a3de-f57e26f59573 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:28.868202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ccf6a6-19f3-4ad5-a3de-f57e26f59573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:28.873661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-94ccf6a6-19f3-4ad5-a3de-f57e26f59573 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:28.873661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:28.873661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:28.873661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:28.873661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:28.873661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:28.873661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:28.873661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:28.873661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:28.873661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:28.873661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:28.873661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:28.873661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:28.873661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:28.873661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:28.873661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:28.874551 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:28.874551 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:28.874551 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:28.874551 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:28.874551 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:28.874551 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:28.874551 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:28.874551 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:28.874551 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:28.874551 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:28.874551 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:28.874551 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:28.874551 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:28.874551 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:28.874551 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:28.874551 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:28.875508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:28.875508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:28.875508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:28.875508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:28.875508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:28.875508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:28.875508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:28.875508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:28.875508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:28.875508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:28.875508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:28.875508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:28.875508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 139/289] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:28.882137 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422006d6-ad4c-4be4-8ac1-9246ca8c5493 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:28.937432 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:29.013658 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422006d6-ad4c-4be4-8ac1-9246ca8c5493 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:29.048974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae4d8e-4b37-4de2-b268-c49c2ffa8f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:29.049678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae4d8e-4b37-4de2-b268-c49c2ffa8f78 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:29.049964 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae4d8e-4b37-4de2-b268-c49c2ffa8f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:29.050241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae4d8e-4b37-4de2-b268-c49c2ffa8f78 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:29.050910 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae4d8e-4b37-4de2-b268-c49c2ffa8f78 None admin] RBAC: Adding query filter params (name=member) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:29.051216 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae4d8e-4b37-4de2-b268-c49c2ffa8f78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:29.052606 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae4d8e-4b37-4de2-b268-c49c2ffa8f78 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:29.062246 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 151/290] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:17:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:29.067840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ccf6a6-19f3-4ad5-a3de-f57e26f59573 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:29.168011 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:29.179458 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ccf6a6-19f3-4ad5-a3de-f57e26f59573 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:29.216171 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10949e15-c5fa-44d5-b09c-a7c70885fd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:29.216810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10949e15-c5fa-44d5-b09c-a7c70885fd89 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:29.217144 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10949e15-c5fa-44d5-b09c-a7c70885fd89 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:29.225473 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10949e15-c5fa-44d5-b09c-a7c70885fd89 None admin] PATH_INFO: `/v3/users/e4b7e69fd4734d2fb29f049a5c09a5fa` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:29.226688 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10949e15-c5fa-44d5-b09c-a7c70885fd89 None admin] RBAC: Authorizing `identity:get_user(user_id=e4b7e69fd4734d2fb29f049a5c09a5fa)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:29.228154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10949e15-c5fa-44d5-b09c-a7c70885fd89 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:29.229775 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 140/291] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:29 2022] GET /identity/v3/users/e4b7e69fd4734d2fb29f049a5c09a5fa => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:29.235601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae4d8e-4b37-4de2-b268-c49c2ffa8f78 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:29.390313 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae4d8e-4b37-4de2-b268-c49c2ffa8f78 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:29.391890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:29.436124 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c8995-5a13-47ac-b521-b36ffa467c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:29.436654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c8995-5a13-47ac-b521-b36ffa467c7a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:29.436938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c8995-5a13-47ac-b521-b36ffa467c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:29.437236 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c8995-5a13-47ac-b521-b36ffa467c7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:29.516319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c8995-5a13-47ac-b521-b36ffa467c7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:29.518148 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c8995-5a13-47ac-b521-b36ffa467c7a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:29.642554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 152/292] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:29.648529 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10949e15-c5fa-44d5-b09c-a7c70885fd89 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:29.785057 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10949e15-c5fa-44d5-b09c-a7c70885fd89 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:29.833681 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd8afd-725d-4116-b799-50b5ac0a0fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:29.834937 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd8afd-725d-4116-b799-50b5ac0a0fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:29.835218 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd8afd-725d-4116-b799-50b5ac0a0fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:29.835488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd8afd-725d-4116-b799-50b5ac0a0fd9 None admin] PATH_INFO: `/v3/projects/fcf93baab2904060974567318edbdc0b` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:29.836608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd8afd-725d-4116-b799-50b5ac0a0fd9 None admin] RBAC: Authorizing `identity:get_project(project_id=fcf93baab2904060974567318edbdc0b)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:29.838079 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd8afd-725d-4116-b799-50b5ac0a0fd9 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:29.839698 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 141/293] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:29 2022] GET /identity/v3/projects/fcf93baab2904060974567318edbdc0b => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:29.845750 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c8995-5a13-47ac-b521-b36ffa467c7a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:29.847931 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:29.985040 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c8995-5a13-47ac-b521-b36ffa467c7a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:30.032012 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d1440-a0bd-43df-b335-89ddeb4bfae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:30.032616 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d1440-a0bd-43df-b335-89ddeb4bfae0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:30.032896 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d1440-a0bd-43df-b335-89ddeb4bfae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:30.033192 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d1440-a0bd-43df-b335-89ddeb4bfae0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:30.033920 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d1440-a0bd-43df-b335-89ddeb4bfae0 None admin] RBAC: Adding query filter params (role.id=a463f0ebb5cf4516b0bec345d25071cb, scope.project.id=fcf93baab2904060974567318edbdc0b, user.id=e4b7e69fd4734d2fb29f049a5c09a5fa) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:30.034224 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d1440-a0bd-43df-b335-89ddeb4bfae0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:30.035697 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d1440-a0bd-43df-b335-89ddeb4bfae0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:30.045487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 153/294] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:17:29 2022] GET /identity/v3/role_assignments?user.id=e4b7e69fd4734d2fb29f049a5c09a5fa&scope.project.id=fcf93baab2904060974567318edbdc0b&role.id=a463f0ebb5cf4516b0bec345d25071cb => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:30.691575 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1216a5-d1bc-4ab4-8bce-d7a60625e1f6 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:30.692078 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1216a5-d1bc-4ab4-8bce-d7a60625e1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:30.692151 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1216a5-d1bc-4ab4-8bce-d7a60625e1f6 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:30.693811 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 142/295] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:30.699344 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7ab4b-2a30-4ebe-953a-1016fa7de992 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:30.699777 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7ab4b-2a30-4ebe-953a-1016fa7de992 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:30.699945 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7ab4b-2a30-4ebe-953a-1016fa7de992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:30.721154 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7fa7ab4b-2a30-4ebe-953a-1016fa7de992 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:30.722366 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7fa7ab4b-2a30-4ebe-953a-1016fa7de992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:30.795665 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:30.805974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 154/296] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:30.828106 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1216a5-d1bc-4ab4-8bce-d7a60625e1f6 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:30.857532 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:30.934690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1216a5-d1bc-4ab4-8bce-d7a60625e1f6 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:30.972099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc17bc-0152-4bd1-b7d2-a4333f009947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:30.972099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc17bc-0152-4bd1-b7d2-a4333f009947 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:30.972099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc17bc-0152-4bd1-b7d2-a4333f009947 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:30.972099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc17bc-0152-4bd1-b7d2-a4333f009947 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:30.989671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc17bc-0152-4bd1-b7d2-a4333f009947 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:30.989671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-e4dc17bc-0152-4bd1-b7d2-a4333f009947 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 02:17:30.989671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:30.989671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:30.989671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:30.989671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:30.989671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:30.989671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:30.989671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:30.989671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:30.989671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:30.989671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:30.989671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:30.989671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:30.990706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:30.990706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:30.990706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:30.990706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:30.990706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:30.990706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:30.990706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:30.990706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:30.990706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:30.990706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:30.990706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:30.990706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:30.990706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:30.990706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:30.990706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:30.990706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:30.990706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:30.991529 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:30.991529 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:30.991529 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:30.991529 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:30.991529 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:30.991529 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:30.991529 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:30.991529 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:30.991529 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:30.991529 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:30.991529 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:30.991529 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:30.991529 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 02:17:30.991529 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:30.993123 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 143/297] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:30.995437 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7ab4b-2a30-4ebe-953a-1016fa7de992 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:31.045574 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec827354-ba84-4105-ae90-f3adc9d6b8cc None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:31.046190 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec827354-ba84-4105-ae90-f3adc9d6b8cc None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:31.046712 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec827354-ba84-4105-ae90-f3adc9d6b8cc None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:31.048234 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 144/298] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:31.053411 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58fde3-df1d-46be-b310-e0231cf6146b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:31.053929 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58fde3-df1d-46be-b310-e0231cf6146b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:31.054398 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58fde3-df1d-46be-b310-e0231cf6146b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:31.072169 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-1e58fde3-df1d-46be-b310-e0231cf6146b None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:31.073705 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1e58fde3-df1d-46be-b310-e0231cf6146b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:31.112542 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7ab4b-2a30-4ebe-953a-1016fa7de992 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:31.150962 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 145/299] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 02:17:31.154132 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a446f-f820-4373-b9b4-a98699c54405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:31.154756 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a446f-f820-4373-b9b4-a98699c54405 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:31.155038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a446f-f820-4373-b9b4-a98699c54405 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:31.155313 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a446f-f820-4373-b9b4-a98699c54405 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:31.156116 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a446f-f820-4373-b9b4-a98699c54405 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:31.156420 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a446f-f820-4373-b9b4-a98699c54405 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:31.157849 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a446f-f820-4373-b9b4-a98699c54405 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:31.167169 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 155/300] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:17:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:31.171674 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58fde3-df1d-46be-b310-e0231cf6146b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:31.173945 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a446f-f820-4373-b9b4-a98699c54405 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:31.197314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:31.242157 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:31.286182 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a446f-f820-4373-b9b4-a98699c54405 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:31.290673 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58fde3-df1d-46be-b310-e0231cf6146b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:31.323455 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d8d24-412c-412c-8215-c33d563160f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:31.324121 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d8d24-412c-412c-8215-c33d563160f0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:31.324387 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d8d24-412c-412c-8215-c33d563160f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:31.324658 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d8d24-412c-412c-8215-c33d563160f0 None admin] PATH_INFO: `/v3/users/2f2cd91751f947cf8a14f5dadfb4bf07` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:31.325264 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e936c8-adfb-4852-aa20-0d8ec508a431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:31.325811 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d8d24-412c-412c-8215-c33d563160f0 None admin] RBAC: Authorizing `identity:get_user(user_id=2f2cd91751f947cf8a14f5dadfb4bf07)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:31.325908 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e936c8-adfb-4852-aa20-0d8ec508a431 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:31.326148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e936c8-adfb-4852-aa20-0d8ec508a431 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:31.326414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e936c8-adfb-4852-aa20-0d8ec508a431 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:31.327263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d8d24-412c-412c-8215-c33d563160f0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:31.334511 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 156/301] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:31 2022] GET /identity/v3/users/2f2cd91751f947cf8a14f5dadfb4bf07 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:31.334511 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cc22e-5220-47ad-bdd0-a2e1d1fc2e31 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:31.334511 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cc22e-5220-47ad-bdd0-a2e1d1fc2e31 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:31.334511 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cc22e-5220-47ad-bdd0-a2e1d1fc2e31 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:31.334511 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 157/302] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:31.336900 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5cc22e-5220-47ad-bdd0-a2e1d1fc2e31 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:31.343018 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e936c8-adfb-4852-aa20-0d8ec508a431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:31.347883 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-81e936c8-adfb-4852-aa20-0d8ec508a431 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:31.347883 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:31.347883 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:31.347883 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:31.347883 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:31.347883 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:31.347883 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:31.347883 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:31.347883 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:31.347883 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:31.347883 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:31.347883 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:31.347883 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:31.347883 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:31.347883 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:31.347883 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:31.348834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:31.348834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:31.348834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:31.348834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:31.348834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:31.348834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:31.348834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:31.348834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:31.348834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:31.348834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:31.348834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:31.348834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:31.348834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:31.348834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:31.348834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:31.348834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:31.349704 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:31.349704 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:31.349704 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:31.349704 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:31.349704 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:31.349704 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:31.349704 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:31.349704 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:31.349704 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:31.349704 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:31.349704 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:31.349704 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:31.349704 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 146/303] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:31.350867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee659fe-81f8-4d56-b800-552a376a09b7 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:31.350867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee659fe-81f8-4d56-b800-552a376a09b7 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:31.350867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee659fe-81f8-4d56-b800-552a376a09b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:31.367830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-dee659fe-81f8-4d56-b800-552a376a09b7 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:31.369299 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-dee659fe-81f8-4d56-b800-552a376a09b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:31.441232 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 147/304] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:31.442485 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa9539-f998-4b36-9a44-ce8850e5e7c1 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:31.442772 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa9539-f998-4b36-9a44-ce8850e5e7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:31.443043 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa9539-f998-4b36-9a44-ce8850e5e7c1 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:31.448906 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 148/305] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:31.448906 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa9539-f998-4b36-9a44-ce8850e5e7c1 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:31.456163 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:31.458541 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5cc22e-5220-47ad-bdd0-a2e1d1fc2e31 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:31.486064 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:31.495572 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca9c71-c83d-44d4-bd3a-5805fa87363e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:31.496122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca9c71-c83d-44d4-bd3a-5805fa87363e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:31.496398 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca9c71-c83d-44d4-bd3a-5805fa87363e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:31.496668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca9c71-c83d-44d4-bd3a-5805fa87363e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:31.548480 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa9539-f998-4b36-9a44-ce8850e5e7c1 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:31.563217 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca9c71-c83d-44d4-bd3a-5805fa87363e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:31.564664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca9c71-c83d-44d4-bd3a-5805fa87363e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:31.582052 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca98086-833d-41fe-a379-9d7419fd83bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:31.582654 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca98086-833d-41fe-a379-9d7419fd83bc None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:31.582939 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca98086-833d-41fe-a379-9d7419fd83bc None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:31.583212 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca98086-833d-41fe-a379-9d7419fd83bc None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:31.584468 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca98086-833d-41fe-a379-9d7419fd83bc None admin] RBAC: Adding query filter params (name=member) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:31.584781 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca98086-833d-41fe-a379-9d7419fd83bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:31.586179 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca98086-833d-41fe-a379-9d7419fd83bc None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:31.594514 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 149/306] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:17:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:31.595629 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10277821-bbc3-46be-b3a8-5f3634da17bf None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:31.595912 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10277821-bbc3-46be-b3a8-5f3634da17bf None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:31.596223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10277821-bbc3-46be-b3a8-5f3634da17bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:31.612966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-10277821-bbc3-46be-b3a8-5f3634da17bf None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:31.614191 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-10277821-bbc3-46be-b3a8-5f3634da17bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:31.668209 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 158/307] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:31.669958 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca9c71-c83d-44d4-bd3a-5805fa87363e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:31.673611 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:31.682722 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 150/308] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:31.683370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10277821-bbc3-46be-b3a8-5f3634da17bf None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:31.697839 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:31.771002 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca9c71-c83d-44d4-bd3a-5805fa87363e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:31.780888 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10277821-bbc3-46be-b3a8-5f3634da17bf None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:31.804128 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2450e4-b379-4faf-9bb5-30f920ed182c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:31.804856 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2450e4-b379-4faf-9bb5-30f920ed182c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:31.805167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2450e4-b379-4faf-9bb5-30f920ed182c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:31.805428 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2450e4-b379-4faf-9bb5-30f920ed182c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:31.813473 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87b0c3-c88e-4c6c-bd52-12a29750eb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:31.814091 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87b0c3-c88e-4c6c-bd52-12a29750eb22 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:31.814374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87b0c3-c88e-4c6c-bd52-12a29750eb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:31.814645 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87b0c3-c88e-4c6c-bd52-12a29750eb22 None admin] PATH_INFO: `/v3/users/09be5d8d92034b4f9e59abcf36ddb884` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:31.815197 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2450e4-b379-4faf-9bb5-30f920ed182c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:31.815740 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87b0c3-c88e-4c6c-bd52-12a29750eb22 None admin] RBAC: Authorizing `identity:get_user(user_id=09be5d8d92034b4f9e59abcf36ddb884)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:31.817215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c87b0c3-c88e-4c6c-bd52-12a29750eb22 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:31.819330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 151/309] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:31 2022] GET /identity/v3/users/09be5d8d92034b4f9e59abcf36ddb884 => generated 293 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:31.820087 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87b0c3-c88e-4c6c-bd52-12a29750eb22 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:31.820587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-1b2450e4-b379-4faf-9bb5-30f920ed182c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 02:17:31.820587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:31.820587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:31.820587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:31.820587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:31.820587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:31.820587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:31.820587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:31.820587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:31.820587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:31.820587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:31.820587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:31.820587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:31.820587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:31.820587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:31.820587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:31.821448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:31.821448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:31.821448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:31.821448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:31.821448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:31.821448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:31.821448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:31.821448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:31.821448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:31.821448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:31.821448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:31.821448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:31.821448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:31.821448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:31.821448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:31.821448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:31.822273 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:31.822273 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:31.822273 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:31.822273 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:31.822273 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:31.822273 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:31.822273 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:31.822273 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:31.822273 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:31.822273 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:31.822273 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 02:17:31.822273 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:31.822273 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 159/310] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:31.825301 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2450e4-b379-4faf-9bb5-30f920ed182c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:31.886003 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:31.910817 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:31.920157 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c87b0c3-c88e-4c6c-bd52-12a29750eb22 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:31.925816 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2450e4-b379-4faf-9bb5-30f920ed182c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:31.954571 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea857da-c505-41f2-b076-3645acd1c1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:31.955190 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea857da-c505-41f2-b076-3645acd1c1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:31.955464 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea857da-c505-41f2-b076-3645acd1c1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:31.955737 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea857da-c505-41f2-b076-3645acd1c1a3 None admin] PATH_INFO: `/v3/projects/fcf93baab2904060974567318edbdc0b` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:31.956837 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea857da-c505-41f2-b076-3645acd1c1a3 None admin] RBAC: Authorizing `identity:get_project(project_id=fcf93baab2904060974567318edbdc0b)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:31.958325 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea857da-c505-41f2-b076-3645acd1c1a3 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:31.959964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 152/311] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:31 2022] GET /identity/v3/projects/fcf93baab2904060974567318edbdc0b => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:31.960382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d684c-e569-45ab-bb17-e7b515c72327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:31.960694 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea857da-c505-41f2-b076-3645acd1c1a3 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:31.961004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d684c-e569-45ab-bb17-e7b515c72327 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:31.961322 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d684c-e569-45ab-bb17-e7b515c72327 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:31.961704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d684c-e569-45ab-bb17-e7b515c72327 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:31.962809 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d684c-e569-45ab-bb17-e7b515c72327 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:31.964252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d684c-e569-45ab-bb17-e7b515c72327 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:31.970294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 160/312] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:17:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:31.970294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d684c-e569-45ab-bb17-e7b515c72327 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:32.059026 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea857da-c505-41f2-b076-3645acd1c1a3 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:32.069206 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d684c-e569-45ab-bb17-e7b515c72327 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:32.095592 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55adfa-1065-451f-a849-a67f38285bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:32.096239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55adfa-1065-451f-a849-a67f38285bc2 None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:32.096535 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55adfa-1065-451f-a849-a67f38285bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:32.096806 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55adfa-1065-451f-a849-a67f38285bc2 None admin] PATH_INFO: `/v3/system/users/09be5d8d92034b4f9e59abcf36ddb884/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:32.098224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55adfa-1065-451f-a849-a67f38285bc2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=09be5d8d92034b4f9e59abcf36ddb884, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:32.100143 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55adfa-1065-451f-a849-a67f38285bc2 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:32.101675 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:32.104602 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284455f-b584-4cc5-a0a3-bc8864e2e3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:32.105352 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284455f-b584-4cc5-a0a3-bc8864e2e3cf None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:32.105703 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284455f-b584-4cc5-a0a3-bc8864e2e3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:32.106004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284455f-b584-4cc5-a0a3-bc8864e2e3cf None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:32.106672 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284455f-b584-4cc5-a0a3-bc8864e2e3cf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:32.106970 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284455f-b584-4cc5-a0a3-bc8864e2e3cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:32.108344 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b284455f-b584-4cc5-a0a3-bc8864e2e3cf None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:32.109002 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 153/313] 10.222.0.16 () {58 vars in 1334 bytes} [Tue Aug 9 02:17:31 2022] PUT /identity/v3/system/users/09be5d8d92034b4f9e59abcf36ddb884/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:17:32.110041 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55adfa-1065-451f-a849-a67f38285bc2 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:32.118044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 161/314] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:17:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:32.118963 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284455f-b584-4cc5-a0a3-bc8864e2e3cf None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:32.138713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:32.228138 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55adfa-1065-451f-a849-a67f38285bc2 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:32.232903 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284455f-b584-4cc5-a0a3-bc8864e2e3cf None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:32.269244 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53f32a-0055-4dfd-b852-20b7c1f0de4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:32.270101 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53f32a-0055-4dfd-b852-20b7c1f0de4c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:32.270529 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53f32a-0055-4dfd-b852-20b7c1f0de4c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:32.270643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79de88f-068c-4441-8b17-4933046f359d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:32.271090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53f32a-0055-4dfd-b852-20b7c1f0de4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:32.271215 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79de88f-068c-4441-8b17-4933046f359d None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:32.271535 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79de88f-068c-4441-8b17-4933046f359d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:32.271810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79de88f-068c-4441-8b17-4933046f359d None admin] PATH_INFO: `/v3/groups` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:32.271925 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53f32a-0055-4dfd-b852-20b7c1f0de4c None admin] RBAC: Adding query filter params (role.id=61e3cf9f4de64b22b7254b339eab813b, scope.project.id=fcf93baab2904060974567318edbdc0b, user.id=2f2cd91751f947cf8a14f5dadfb4bf07) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:32.272237 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53f32a-0055-4dfd-b852-20b7c1f0de4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:32.272437 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79de88f-068c-4441-8b17-4933046f359d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:32.273720 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53f32a-0055-4dfd-b852-20b7c1f0de4c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:32.274604 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79de88f-068c-4441-8b17-4933046f359d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:32.280474 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 154/315] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:17:32 2022] GET /identity/v3/role_assignments?user.id=2f2cd91751f947cf8a14f5dadfb4bf07&scope.project.id=fcf93baab2904060974567318edbdc0b&role.id=61e3cf9f4de64b22b7254b339eab813b => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:32.282107 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53f32a-0055-4dfd-b852-20b7c1f0de4c None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:32.300387 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 162/316] 10.222.0.16 () {60 vars in 1134 bytes} [Tue Aug 9 02:17:32 2022] POST /identity/v3/groups => generated 229 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:17:32.367644 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:32.418680 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53f32a-0055-4dfd-b852-20b7c1f0de4c None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:32.459715 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc4533-a46f-4edf-be70-416d2e7f24ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:32.460366 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc4533-a46f-4edf-be70-416d2e7f24ef None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:32.460645 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc4533-a46f-4edf-be70-416d2e7f24ef None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:32.460924 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc4533-a46f-4edf-be70-416d2e7f24ef None admin] PATH_INFO: `/v3/users/2ee2ea83241e43c89501fb7b400d5688` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:32.478483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc4533-a46f-4edf-be70-416d2e7f24ef None admin] RBAC: Authorizing `identity:get_user(user_id=2ee2ea83241e43c89501fb7b400d5688)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:32.479971 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc4533-a46f-4edf-be70-416d2e7f24ef None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:32.481697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 155/317] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:32 2022] GET /identity/v3/users/2ee2ea83241e43c89501fb7b400d5688 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:32.487711 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79de88f-068c-4441-8b17-4933046f359d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:32.569640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:32.599057 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79de88f-068c-4441-8b17-4933046f359d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:32.633417 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65f796-bea5-41bb-817a-2fd972ce91cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:32.633924 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65f796-bea5-41bb-817a-2fd972ce91cc None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:32.634204 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65f796-bea5-41bb-817a-2fd972ce91cc None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:32.634471 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65f796-bea5-41bb-817a-2fd972ce91cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:32.635194 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65f796-bea5-41bb-817a-2fd972ce91cc None admin] RBAC: Adding query filter params (role.id=61e3cf9f4de64b22b7254b339eab813b, user.id=2ee2ea83241e43c89501fb7b400d5688, scope.system=all) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:32.635500 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65f796-bea5-41bb-817a-2fd972ce91cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:32.636930 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65f796-bea5-41bb-817a-2fd972ce91cc None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:32.645117 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 163/318] 10.222.0.16 () {56 vars in 1308 bytes} [Tue Aug 9 02:17:32 2022] GET /identity/v3/role_assignments?user.id=2ee2ea83241e43c89501fb7b400d5688&scope.system=all&role.id=61e3cf9f4de64b22b7254b339eab813b => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:34.139941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20877296-742a-4fb6-85e4-9e461d30f012 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:34.140475 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20877296-742a-4fb6-85e4-9e461d30f012 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:34.140475 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20877296-742a-4fb6-85e4-9e461d30f012 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:34.141915 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 156/319] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:34.147640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae0c3f-22d1-4845-8daf-84e4eb009ca2 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:34.148028 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae0c3f-22d1-4845-8daf-84e4eb009ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:34.148202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae0c3f-22d1-4845-8daf-84e4eb009ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:34.166778 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7cae0c3f-22d1-4845-8daf-84e4eb009ca2 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:34.167981 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7cae0c3f-22d1-4845-8daf-84e4eb009ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:34.235229 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 164/320] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:34.258413 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20877296-742a-4fb6-85e4-9e461d30f012 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:34.361085 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20877296-742a-4fb6-85e4-9e461d30f012 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:34.377214 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be0df1-d139-400a-a828-1e3353296099 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:34.377509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be0df1-d139-400a-a828-1e3353296099 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:34.377792 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be0df1-d139-400a-a828-1e3353296099 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:34.379265 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 165/321] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:17:34.382135 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:34.384410 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f2884-918b-4ecb-8c54-3e3de17dc211 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:34.384694 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f2884-918b-4ecb-8c54-3e3de17dc211 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:34.384966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f2884-918b-4ecb-8c54-3e3de17dc211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:34.399774 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed054f2e-c482-4fc5-a018-9e873d436911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:34.400412 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed054f2e-c482-4fc5-a018-9e873d436911 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:34.400694 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed054f2e-c482-4fc5-a018-9e873d436911 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:34.400970 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed054f2e-c482-4fc5-a018-9e873d436911 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:34.406427 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ba5f2884-918b-4ecb-8c54-3e3de17dc211 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:34.408016 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ba5f2884-918b-4ecb-8c54-3e3de17dc211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:34.411264 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed054f2e-c482-4fc5-a018-9e873d436911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:34.416125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-ed054f2e-c482-4fc5-a018-9e873d436911 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:34.416125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:34.416125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:34.416125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:34.416125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:34.416125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:34.416125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:34.416125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:34.416125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:34.416125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:34.416125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:34.416125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:34.416125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:34.416125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:34.416125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:34.416125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:34.417002 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:34.417002 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:34.417002 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:34.417002 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:34.417002 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:34.417002 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:34.417002 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:34.417002 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:34.417002 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:34.417002 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:34.417002 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:34.417002 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:34.417002 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:34.417002 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:34.417002 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:34.417002 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:34.417830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:34.417830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:34.417830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:34.417830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:34.417830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:34.417830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:34.417830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:34.417830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:34.417830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:34.417830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:34.417830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:34.417830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:34.417830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 157/322] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:34.423127 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed054f2e-c482-4fc5-a018-9e873d436911 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:34.481098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:34.486769 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 166/323] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:34.509541 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f2884-918b-4ecb-8c54-3e3de17dc211 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:34.535531 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed054f2e-c482-4fc5-a018-9e873d436911 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:34.574647 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b973dc4-d451-4b48-af80-b6b6333100c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:34.575258 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b973dc4-d451-4b48-af80-b6b6333100c1 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:34.575540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b973dc4-d451-4b48-af80-b6b6333100c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:34.575812 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b973dc4-d451-4b48-af80-b6b6333100c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:34.576478 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b973dc4-d451-4b48-af80-b6b6333100c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:34.576807 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b973dc4-d451-4b48-af80-b6b6333100c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:34.578272 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b973dc4-d451-4b48-af80-b6b6333100c1 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:34.587432 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 158/324] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:17:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:34.592586 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b973dc4-d451-4b48-af80-b6b6333100c1 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:34.621684 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f2884-918b-4ecb-8c54-3e3de17dc211 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:34.640690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:34.656389 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fbaea-ca6c-4dc6-8ce6-d7c6cea4ddef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:34.657043 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fbaea-ca6c-4dc6-8ce6-d7c6cea4ddef None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:34.657327 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fbaea-ca6c-4dc6-8ce6-d7c6cea4ddef None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:34.657603 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fbaea-ca6c-4dc6-8ce6-d7c6cea4ddef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:34.658693 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fbaea-ca6c-4dc6-8ce6-d7c6cea4ddef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:34.660130 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fbaea-ca6c-4dc6-8ce6-d7c6cea4ddef None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:34.661767 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 167/325] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:17:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:34.662878 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99f4d9-3c46-4c8c-92e6-d72b5a2c3fc8 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:34.663163 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99f4d9-3c46-4c8c-92e6-d72b5a2c3fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:34.663438 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99f4d9-3c46-4c8c-92e6-d72b5a2c3fc8 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:34.668377 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 168/326] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:34.668377 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99f4d9-3c46-4c8c-92e6-d72b5a2c3fc8 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:34.698288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b973dc4-d451-4b48-af80-b6b6333100c1 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:34.730033 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0733a-16a1-4d89-b943-401d3d7fb5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:34.730649 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0733a-16a1-4d89-b943-401d3d7fb5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:34.730924 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0733a-16a1-4d89-b943-401d3d7fb5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:34.731192 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0733a-16a1-4d89-b943-401d3d7fb5d0 None admin] PATH_INFO: `/v3/users/09be5d8d92034b4f9e59abcf36ddb884` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:34.732295 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0733a-16a1-4d89-b943-401d3d7fb5d0 None admin] RBAC: Authorizing `identity:get_user(user_id=09be5d8d92034b4f9e59abcf36ddb884)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:34.733747 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0733a-16a1-4d89-b943-401d3d7fb5d0 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:34.733992 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:34.735420 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 159/327] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:34 2022] GET /identity/v3/users/09be5d8d92034b4f9e59abcf36ddb884 => generated 293 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:34.736919 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc199660-0fc0-4cc8-bbf2-bab67b417000 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:34.737172 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc199660-0fc0-4cc8-bbf2-bab67b417000 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:34.737440 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc199660-0fc0-4cc8-bbf2-bab67b417000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:34.755001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-dc199660-0fc0-4cc8-bbf2-bab67b417000 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:34.756846 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-dc199660-0fc0-4cc8-bbf2-bab67b417000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:34.773917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99f4d9-3c46-4c8c-92e6-d72b5a2c3fc8 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:34.806754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c05d3-1b2a-405c-8bfb-85421de5c1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:34.807346 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c05d3-1b2a-405c-8bfb-85421de5c1b2 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:34.807619 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c05d3-1b2a-405c-8bfb-85421de5c1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:34.807883 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c05d3-1b2a-405c-8bfb-85421de5c1b2 None admin] PATH_INFO: `/v3/groups` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:34.808489 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c05d3-1b2a-405c-8bfb-85421de5c1b2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:34.809936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c05d3-1b2a-405c-8bfb-85421de5c1b2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:34.824534 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 169/328] 10.222.0.16 () {60 vars in 1134 bytes} [Tue Aug 9 02:17:34 2022] POST /identity/v3/groups => generated 226 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:17:34.825349 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c05d3-1b2a-405c-8bfb-85421de5c1b2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:34.828987 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 160/329] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:34.853378 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc199660-0fc0-4cc8-bbf2-bab67b417000 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:34.903786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:34.950204 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c05d3-1b2a-405c-8bfb-85421de5c1b2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:34.972057 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc199660-0fc0-4cc8-bbf2-bab67b417000 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:34.985716 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:34.999686 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c87428-3484-432d-a8d2-52c8af2e6169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:35.000230 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c87428-3484-432d-a8d2-52c8af2e6169 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:35.000538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c87428-3484-432d-a8d2-52c8af2e6169 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:35.000775 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c87428-3484-432d-a8d2-52c8af2e6169 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:35.001538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c87428-3484-432d-a8d2-52c8af2e6169 None admin] RBAC: Adding query filter params (role.id=a463f0ebb5cf4516b0bec345d25071cb, user.id=09be5d8d92034b4f9e59abcf36ddb884, scope.system=all) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:35.002356 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c87428-3484-432d-a8d2-52c8af2e6169 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:35.004861 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c87428-3484-432d-a8d2-52c8af2e6169 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:35.017272 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2267d0-13b6-464d-980f-4eb59eaa54b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:35.017905 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2267d0-13b6-464d-980f-4eb59eaa54b0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:35.018180 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2267d0-13b6-464d-980f-4eb59eaa54b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:35.018447 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2267d0-13b6-464d-980f-4eb59eaa54b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:35.020566 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 170/330] 10.222.0.16 () {56 vars in 1308 bytes} [Tue Aug 9 02:17:34 2022] GET /identity/v3/role_assignments?user.id=09be5d8d92034b4f9e59abcf36ddb884&scope.system=all&role.id=a463f0ebb5cf4516b0bec345d25071cb => generated 510 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:35.030421 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2267d0-13b6-464d-980f-4eb59eaa54b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:35.035523 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-bb2267d0-13b6-464d-980f-4eb59eaa54b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 02:17:35.035523 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:35.035523 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:35.035523 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:35.035523 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:35.035523 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:35.035523 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:35.035523 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:35.035523 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:35.035523 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:35.035523 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:35.035523 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:35.035523 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:35.035523 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:35.035523 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:35.035523 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:35.036457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:35.036457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:35.036457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:35.036457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:35.036457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:35.036457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:35.036457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:35.036457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:35.036457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:35.036457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:35.036457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:35.036457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:35.036457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:35.036457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:35.036457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:35.036457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:35.037896 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:35.037896 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:35.037896 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:35.037896 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:35.037896 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:35.037896 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:35.037896 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:35.037896 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:35.037896 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:35.037896 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:35.037896 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 02:17:35.037896 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:35.037896 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 161/331] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:17:35.043615 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c87428-3484-432d-a8d2-52c8af2e6169 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:35.165146 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c87428-3484-432d-a8d2-52c8af2e6169 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:35.201747 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25165150-08ac-4337-a9a1-46cb19f5608c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:35.202365 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25165150-08ac-4337-a9a1-46cb19f5608c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:35.202647 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25165150-08ac-4337-a9a1-46cb19f5608c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:35.202922 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25165150-08ac-4337-a9a1-46cb19f5608c None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:35.203600 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25165150-08ac-4337-a9a1-46cb19f5608c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:35.203907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25165150-08ac-4337-a9a1-46cb19f5608c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:35.205323 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25165150-08ac-4337-a9a1-46cb19f5608c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:35.214186 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 171/332] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:17:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:35.219987 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2267d0-13b6-464d-980f-4eb59eaa54b0 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:35.334195 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:35.338843 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2267d0-13b6-464d-980f-4eb59eaa54b0 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:35.379676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec4df6-9ab3-4835-8237-0584d0208f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:35.380316 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec4df6-9ab3-4835-8237-0584d0208f7c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:35.380632 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec4df6-9ab3-4835-8237-0584d0208f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:35.380907 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec4df6-9ab3-4835-8237-0584d0208f7c None admin] PATH_INFO: `/v3/users/2ee2ea83241e43c89501fb7b400d5688` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:35.382106 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec4df6-9ab3-4835-8237-0584d0208f7c None admin] RBAC: Authorizing `identity:get_user(user_id=2ee2ea83241e43c89501fb7b400d5688)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:35.383559 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec4df6-9ab3-4835-8237-0584d0208f7c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:35.385610 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 162/333] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:35 2022] GET /identity/v3/users/2ee2ea83241e43c89501fb7b400d5688 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:35.390824 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25165150-08ac-4337-a9a1-46cb19f5608c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:35.444916 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:35.508367 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25165150-08ac-4337-a9a1-46cb19f5608c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:35.550453 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352d412-d006-461e-8dcd-8472900fdf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:35.551121 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352d412-d006-461e-8dcd-8472900fdf9d None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:35.551404 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352d412-d006-461e-8dcd-8472900fdf9d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:35.556389 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352d412-d006-461e-8dcd-8472900fdf9d None admin] PATH_INFO: `/v3/system/users/2ee2ea83241e43c89501fb7b400d5688/roles/61e3cf9f4de64b22b7254b339eab813b` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:35.556389 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8352d412-d006-461e-8dcd-8472900fdf9d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2ee2ea83241e43c89501fb7b400d5688, role_id=61e3cf9f4de64b22b7254b339eab813b)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:35.556389 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8352d412-d006-461e-8dcd-8472900fdf9d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:35.565959 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 172/334] 10.222.0.16 () {58 vars in 1334 bytes} [Tue Aug 9 02:17:35 2022] PUT /identity/v3/system/users/2ee2ea83241e43c89501fb7b400d5688/roles/61e3cf9f4de64b22b7254b339eab813b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:17:37.329081 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd06cc-2f9e-4f6e-8a2c-042a4d05e10d None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:37.329586 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd06cc-2f9e-4f6e-8a2c-042a4d05e10d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:37.329586 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd06cc-2f9e-4f6e-8a2c-042a4d05e10d None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:37.331308 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 163/335] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:37.351988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e042d0f-7318-4d11-a4e2-905cab0c1955 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:37.352476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e042d0f-7318-4d11-a4e2-905cab0c1955 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:37.352552 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e042d0f-7318-4d11-a4e2-905cab0c1955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:37.378237 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-6e042d0f-7318-4d11-a4e2-905cab0c1955 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:37.379426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6e042d0f-7318-4d11-a4e2-905cab0c1955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:37.461681 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 173/336] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:37.506943 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd06cc-2f9e-4f6e-8a2c-042a4d05e10d None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:37.561351 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce10d9-496d-490f-a6a0-19306184773d None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:37.561668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce10d9-496d-490f-a6a0-19306184773d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:37.561901 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce10d9-496d-490f-a6a0-19306184773d None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:37.563488 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 174/337] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:37.615045 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b766c6-294d-4b5b-b553-0a00d977b6e0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:37.615323 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b766c6-294d-4b5b-b553-0a00d977b6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:37.615510 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b766c6-294d-4b5b-b553-0a00d977b6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:37.634881 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd06cc-2f9e-4f6e-8a2c-042a4d05e10d None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:37.657368 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-25b766c6-294d-4b5b-b553-0a00d977b6e0 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:37.658590 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-25b766c6-294d-4b5b-b553-0a00d977b6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:37.702570 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f54438-cb35-459a-be98-65a6d0302b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:37.703215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f54438-cb35-459a-be98-65a6d0302b56 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:37.703492 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f54438-cb35-459a-be98-65a6d0302b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:37.703760 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f54438-cb35-459a-be98-65a6d0302b56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:37.725899 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f54438-cb35-459a-be98-65a6d0302b56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:37.730782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-f6f54438-cb35-459a-be98-65a6d0302b56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:37.730782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:37.730782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:37.730782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:37.730782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:37.730782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:37.730782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:37.730782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:37.730782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:37.730782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:37.730782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:37.730782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:37.730782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:37.730782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:37.730782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:37.730782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:37.731650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:37.731650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:37.731650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:37.731650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:37.731650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:37.731650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:37.731650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:37.731650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:37.731650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:37.731650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:37.731650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:37.731650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:37.731650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:37.731650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:37.731650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:37.731650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:37.732422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:37.732422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:37.732422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:37.732422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:37.732422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:37.732422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:37.732422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:37.732422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:37.732422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:37.732422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:37.732422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:37.732422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:37.732422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 164/338] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:37.737939 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f54438-cb35-459a-be98-65a6d0302b56 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:37.738641 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:37.791246 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 175/339] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:37.809277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:37.815000 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b766c6-294d-4b5b-b553-0a00d977b6e0 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:37.977518 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f54438-cb35-459a-be98-65a6d0302b56 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:38.058516 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b766c6-294d-4b5b-b553-0a00d977b6e0 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:38.072602 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64859bd1-8501-47d6-8f24-2f68fd9fd466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:38.073246 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64859bd1-8501-47d6-8f24-2f68fd9fd466 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:38.073532 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64859bd1-8501-47d6-8f24-2f68fd9fd466 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:38.073802 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64859bd1-8501-47d6-8f24-2f68fd9fd466 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:38.074479 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64859bd1-8501-47d6-8f24-2f68fd9fd466 None admin] RBAC: Adding query filter params (name=member) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:38.074786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64859bd1-8501-47d6-8f24-2f68fd9fd466 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:38.076174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64859bd1-8501-47d6-8f24-2f68fd9fd466 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:38.106074 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 165/340] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:17:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:38.112556 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64859bd1-8501-47d6-8f24-2f68fd9fd466 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:38.157957 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6a17f-94e6-4b30-828a-bfa509ba1e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:38.159511 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6a17f-94e6-4b30-828a-bfa509ba1e56 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:38.159792 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6a17f-94e6-4b30-828a-bfa509ba1e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:38.160069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6a17f-94e6-4b30-828a-bfa509ba1e56 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:38.187676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6a17f-94e6-4b30-828a-bfa509ba1e56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:38.192577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-fef6a17f-94e6-4b30-828a-bfa509ba1e56 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 02:17:38.192577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:38.192577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:38.192577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:38.192577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:38.192577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:38.192577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:38.192577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:38.192577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:38.192577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:38.192577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:38.192577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:38.192577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:38.192577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:38.192577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:38.192577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:38.193985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:38.193985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:38.193985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:38.193985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:38.193985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:38.193985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:38.193985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:38.193985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:38.193985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:38.193985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:38.193985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:38.193985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:38.193985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:38.193985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:38.193985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:38.193985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:38.194771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:38.194771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:38.194771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:38.194771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:38.194771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:38.194771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:38.194771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:38.194771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:38.194771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:38.194771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:38.194771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 02:17:38.194771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:38.197812 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 176/341] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 9 02:17:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:17:38.203602 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6a17f-94e6-4b30-828a-bfa509ba1e56 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:38.268798 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:38.296701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:38.313446 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64859bd1-8501-47d6-8f24-2f68fd9fd466 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:38.359834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906492cb-962d-4959-94eb-85f3981cd3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:38.361137 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6a17f-94e6-4b30-828a-bfa509ba1e56 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:38.361648 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906492cb-962d-4959-94eb-85f3981cd3ad None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:38.362068 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906492cb-962d-4959-94eb-85f3981cd3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:38.362690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906492cb-962d-4959-94eb-85f3981cd3ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:38.402487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a5e6b-a779-455f-b6ad-c5e456a22265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:38.403265 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a5e6b-a779-455f-b6ad-c5e456a22265 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:38.403645 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a5e6b-a779-455f-b6ad-c5e456a22265 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:38.404041 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a5e6b-a779-455f-b6ad-c5e456a22265 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:38.404910 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a5e6b-a779-455f-b6ad-c5e456a22265 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:38.406016 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a5e6b-a779-455f-b6ad-c5e456a22265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:38.406933 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a5e6b-a779-455f-b6ad-c5e456a22265 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:38.418313 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 177/342] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:17:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:38.419721 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19626d-a6d8-4b66-b2cd-1b7dbc81bc02 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:38.420104 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19626d-a6d8-4b66-b2cd-1b7dbc81bc02 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:38.425231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19626d-a6d8-4b66-b2cd-1b7dbc81bc02 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:38.425231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 178/343] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:38.425231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad0d21-c0cd-47ac-86a5-79d85f3c8054 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:38.425231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad0d21-c0cd-47ac-86a5-79d85f3c8054 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:38.425231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad0d21-c0cd-47ac-86a5-79d85f3c8054 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:38.428028 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 179/344] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:38.428940 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad0d21-c0cd-47ac-86a5-79d85f3c8054 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:38.462482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906492cb-962d-4959-94eb-85f3981cd3ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:38.466451 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906492cb-962d-4959-94eb-85f3981cd3ad None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:38.554914 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:38.569874 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad0d21-c0cd-47ac-86a5-79d85f3c8054 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:38.575216 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:38.593053 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 166/345] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:38.593053 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028b48b-f596-4a5a-9900-51464e91ce6f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:38.593053 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028b48b-f596-4a5a-9900-51464e91ce6f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:38.593053 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028b48b-f596-4a5a-9900-51464e91ce6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:38.614067 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a028b48b-f596-4a5a-9900-51464e91ce6f None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:38.617013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a028b48b-f596-4a5a-9900-51464e91ce6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:38.620469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d614ab-a8c3-4830-bef5-f572625d5116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:38.621992 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d614ab-a8c3-4830-bef5-f572625d5116 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:38.622276 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d614ab-a8c3-4830-bef5-f572625d5116 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:38.622553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d614ab-a8c3-4830-bef5-f572625d5116 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:38.705391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 167/346] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:38.706699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be52a8a-4125-4dde-9868-8fc67a2e2252 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:38.706985 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be52a8a-4125-4dde-9868-8fc67a2e2252 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:38.710435 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be52a8a-4125-4dde-9868-8fc67a2e2252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:38.718015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d614ab-a8c3-4830-bef5-f572625d5116 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:38.719743 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d614ab-a8c3-4830-bef5-f572625d5116 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:38.728445 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-1be52a8a-4125-4dde-9868-8fc67a2e2252 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:38.729680 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1be52a8a-4125-4dde-9868-8fc67a2e2252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:38.820845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 168/347] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:38.821740 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be52a8a-4125-4dde-9868-8fc67a2e2252 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:38.849687 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:38.860286 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 180/348] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:38.861842 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d614ab-a8c3-4830-bef5-f572625d5116 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:38.891484 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:38.959814 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be52a8a-4125-4dde-9868-8fc67a2e2252 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:39.010844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d614ab-a8c3-4830-bef5-f572625d5116 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:39.019005 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a487a-e133-4390-866b-b3bdc9a1e88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:39.019650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a487a-e133-4390-866b-b3bdc9a1e88f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:39.019931 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a487a-e133-4390-866b-b3bdc9a1e88f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:39.020202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a487a-e133-4390-866b-b3bdc9a1e88f None admin] PATH_INFO: `/v3/projects/01c75d368d814248b8ba862ee53b50dc` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:39.021400 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a487a-e133-4390-866b-b3bdc9a1e88f None admin] RBAC: Authorizing `identity:get_project(project_id=01c75d368d814248b8ba862ee53b50dc)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:39.022865 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a487a-e133-4390-866b-b3bdc9a1e88f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:39.029191 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 169/349] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:38 2022] GET /identity/v3/projects/01c75d368d814248b8ba862ee53b50dc => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:39.030362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a487a-e133-4390-866b-b3bdc9a1e88f None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:39.069360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868f5c3-24c1-4d21-ada8-297a37bddffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:39.069360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868f5c3-24c1-4d21-ada8-297a37bddffd None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:39.069360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868f5c3-24c1-4d21-ada8-297a37bddffd None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:39.069360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868f5c3-24c1-4d21-ada8-297a37bddffd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:39.082241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868f5c3-24c1-4d21-ada8-297a37bddffd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:39.087689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-6868f5c3-24c1-4d21-ada8-297a37bddffd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 02:17:39.087689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:39.087689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:39.087689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:39.087689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:39.087689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:39.087689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:39.087689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:39.087689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:39.087689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:39.087689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:39.087689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:39.087689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:39.087689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:39.087689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:39.087689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:39.088644 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:39.088644 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:39.088644 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:39.088644 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:39.088644 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:39.088644 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:39.088644 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:39.088644 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:39.088644 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:39.088644 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:39.088644 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:39.088644 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:39.088644 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:39.088644 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:39.088644 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:39.088644 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:39.089464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:39.089464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:39.089464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:39.089464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:39.089464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:39.089464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:39.089464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:39.089464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:39.089464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:39.089464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:39.089464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 02:17:39.089464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:39.089464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 181/350] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:39.090106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868f5c3-24c1-4d21-ada8-297a37bddffd None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:39.169994 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a487a-e133-4390-866b-b3bdc9a1e88f None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:39.178753 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:39.194484 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:39.217469 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36379038-aae9-433d-9ccc-4fdbfa319936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:39.218113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36379038-aae9-433d-9ccc-4fdbfa319936 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:39.218767 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36379038-aae9-433d-9ccc-4fdbfa319936 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:39.218767 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36379038-aae9-433d-9ccc-4fdbfa319936 None admin] PATH_INFO: `/v3/projects/01c75d368d814248b8ba862ee53b50dc` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:39.220538 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36379038-aae9-433d-9ccc-4fdbfa319936 None admin] RBAC: Authorizing `identity:get_project(project_id=01c75d368d814248b8ba862ee53b50dc)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:39.222121 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36379038-aae9-433d-9ccc-4fdbfa319936 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:39.223816 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 170/351] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:39 2022] GET /identity/v3/projects/01c75d368d814248b8ba862ee53b50dc => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:39.225154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36379038-aae9-433d-9ccc-4fdbfa319936 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:39.234387 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868f5c3-24c1-4d21-ada8-297a37bddffd None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:39.285778 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e262f0-0c18-4480-91c8-8b7bcff44eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:39.286988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e262f0-0c18-4480-91c8-8b7bcff44eed None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:39.287268 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e262f0-0c18-4480-91c8-8b7bcff44eed None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:39.287865 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e262f0-0c18-4480-91c8-8b7bcff44eed None admin] PATH_INFO: `/v3/roles/member` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:39.299530 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e262f0-0c18-4480-91c8-8b7bcff44eed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:39.304152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-89e262f0-0c18-4480-91c8-8b7bcff44eed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:39.304152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:39.304152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:39.304152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:39.304152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:39.304152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:39.304152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:39.304152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:39.304152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:39.304152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:39.304152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:39.304152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:39.304152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:39.304152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:39.304152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:39.304152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:39.305085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:39.305085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:39.305085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:39.305085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:39.305085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:39.305085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:39.305085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:39.305085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:39.305085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:39.305085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:39.305085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:39.305085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:39.305085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:39.305085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:39.305085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:39.305085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:39.306017 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:39.306017 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:39.306017 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:39.306017 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:39.306017 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:39.306017 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:39.306017 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:39.306017 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:39.306017 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:39.306017 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:39.306017 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:39.306017 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:39.306017 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 182/352] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:39.306811 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3d376-516c-42ef-baff-be65d7950417 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:39.306811 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3d376-516c-42ef-baff-be65d7950417 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:39.306947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3d376-516c-42ef-baff-be65d7950417 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:39.309059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 183/353] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:39.309172 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3d376-516c-42ef-baff-be65d7950417 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:39.371063 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36379038-aae9-433d-9ccc-4fdbfa319936 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:39.420826 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71080e-d2dc-4e28-917d-c7d8bb8e950c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:39.421498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71080e-d2dc-4e28-917d-c7d8bb8e950c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:39.421777 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71080e-d2dc-4e28-917d-c7d8bb8e950c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:39.422045 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71080e-d2dc-4e28-917d-c7d8bb8e950c None admin] PATH_INFO: `/v3/groups/321ee9d5e67b491bb873ed4bce14a39e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:39.430275 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71080e-d2dc-4e28-917d-c7d8bb8e950c None admin] RBAC: Authorizing `identity:get_group(group_id=321ee9d5e67b491bb873ed4bce14a39e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:39.430862 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71080e-d2dc-4e28-917d-c7d8bb8e950c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:39.432443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 171/354] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 9 02:17:39 2022] GET /identity/v3/groups/321ee9d5e67b491bb873ed4bce14a39e => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:39.433980 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71080e-d2dc-4e28-917d-c7d8bb8e950c None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:39.451379 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3d376-516c-42ef-baff-be65d7950417 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:39.468144 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:39.490062 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:39.496167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b69fb-f5cb-4dd9-a2e1-60f769a6b2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:39.497658 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b69fb-f5cb-4dd9-a2e1-60f769a6b2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:39.497944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b69fb-f5cb-4dd9-a2e1-60f769a6b2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:39.498220 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b69fb-f5cb-4dd9-a2e1-60f769a6b2e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:39.498942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b69fb-f5cb-4dd9-a2e1-60f769a6b2e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:39.499254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b69fb-f5cb-4dd9-a2e1-60f769a6b2e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:39.500693 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b69fb-f5cb-4dd9-a2e1-60f769a6b2e4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:39.510208 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 184/355] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:17:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:39.510863 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b69fb-f5cb-4dd9-a2e1-60f769a6b2e4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:39.555673 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71080e-d2dc-4e28-917d-c7d8bb8e950c None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:39.598835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169c997-26eb-4af2-b5c2-ffe1aaf8a8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:39.599481 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169c997-26eb-4af2-b5c2-ffe1aaf8a8ad None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:39.599765 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169c997-26eb-4af2-b5c2-ffe1aaf8a8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:39.600041 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169c997-26eb-4af2-b5c2-ffe1aaf8a8ad None admin] PATH_INFO: `/v3/groups/321ee9d5e67b491bb873ed4bce14a39e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:39.601279 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169c997-26eb-4af2-b5c2-ffe1aaf8a8ad None admin] RBAC: Authorizing `identity:get_group(group_id=321ee9d5e67b491bb873ed4bce14a39e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:39.602732 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169c997-26eb-4af2-b5c2-ffe1aaf8a8ad None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:39.604515 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 172/356] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 9 02:17:39 2022] GET /identity/v3/groups/321ee9d5e67b491bb873ed4bce14a39e => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:39.608546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd45ec1-99bb-4fbe-b24c-694f3903a743 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:39.608546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd45ec1-99bb-4fbe-b24c-694f3903a743 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:39.608546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd45ec1-99bb-4fbe-b24c-694f3903a743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:39.626670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-2bd45ec1-99bb-4fbe-b24c-694f3903a743 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:39.627797 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2bd45ec1-99bb-4fbe-b24c-694f3903a743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:39.639832 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b69fb-f5cb-4dd9-a2e1-60f769a6b2e4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:39.682763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dae56-a6ed-4440-b54c-124ceaaede8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:39.683380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dae56-a6ed-4440-b54c-124ceaaede8c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:39.683660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dae56-a6ed-4440-b54c-124ceaaede8c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:39.683933 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dae56-a6ed-4440-b54c-124ceaaede8c None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:39.684604 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dae56-a6ed-4440-b54c-124ceaaede8c None admin] RBAC: Adding query filter params (name=member) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:39.684913 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dae56-a6ed-4440-b54c-124ceaaede8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:39.686333 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dae56-a6ed-4440-b54c-124ceaaede8c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:39.696130 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 185/357] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:17:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:39.697538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24e009-a6b4-4aaf-87b9-61fdd8f8659f None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:39.697899 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24e009-a6b4-4aaf-87b9-61fdd8f8659f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:39.698247 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24e009-a6b4-4aaf-87b9-61fdd8f8659f None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:39.699678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 186/358] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:39.700315 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24e009-a6b4-4aaf-87b9-61fdd8f8659f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:39.701246 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 173/359] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:39.702263 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd45ec1-99bb-4fbe-b24c-694f3903a743 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:39.756759 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:39.759378 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:39.820945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd45ec1-99bb-4fbe-b24c-694f3903a743 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:39.832502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24e009-a6b4-4aaf-87b9-61fdd8f8659f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:39.870376 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d5721-9f6d-48d8-8595-fea4591b53e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:39.870376 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d5721-9f6d-48d8-8595-fea4591b53e4 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:39.870682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d5721-9f6d-48d8-8595-fea4591b53e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:39.870918 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d5721-9f6d-48d8-8595-fea4591b53e4 None admin] PATH_INFO: `/v3/users/2ee2ea83241e43c89501fb7b400d5688` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:39.873134 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d5721-9f6d-48d8-8595-fea4591b53e4 None admin] RBAC: Authorizing `identity:get_user(user_id=2ee2ea83241e43c89501fb7b400d5688)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:39.874581 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d5721-9f6d-48d8-8595-fea4591b53e4 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:39.875941 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9305c-9f42-4bb2-b602-d04ae04eeba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:39.876391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 174/360] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:17:39 2022] GET /identity/v3/users/2ee2ea83241e43c89501fb7b400d5688 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:39.877101 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9305c-9f42-4bb2-b602-d04ae04eeba6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:39.877204 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d5721-9f6d-48d8-8595-fea4591b53e4 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:39.877276 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9305c-9f42-4bb2-b602-d04ae04eeba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:39.877276 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9305c-9f42-4bb2-b602-d04ae04eeba6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:39.881060 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9305c-9f42-4bb2-b602-d04ae04eeba6 None admin] RBAC: Adding query filter params (group.id=321ee9d5e67b491bb873ed4bce14a39e, role.id=a463f0ebb5cf4516b0bec345d25071cb, scope.project.id=01c75d368d814248b8ba862ee53b50dc) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:39.881060 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9305c-9f42-4bb2-b602-d04ae04eeba6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:39.881060 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9305c-9f42-4bb2-b602-d04ae04eeba6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:39.888203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 187/361] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 9 02:17:39 2022] GET /identity/v3/role_assignments?group.id=321ee9d5e67b491bb873ed4bce14a39e&scope.project.id=01c75d368d814248b8ba862ee53b50dc&role.id=a463f0ebb5cf4516b0bec345d25071cb => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:39.889302 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9305c-9f42-4bb2-b602-d04ae04eeba6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:40.030628 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9305c-9f42-4bb2-b602-d04ae04eeba6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:40.033405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:40.036745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d5721-9f6d-48d8-8595-fea4591b53e4 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:40.062224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:40.084887 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98e798-4f3b-407d-a0c1-fb9a65383258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:40.085335 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679785c-714d-4ffa-b143-64e8d8f98c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:40.085794 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679785c-714d-4ffa-b143-64e8d8f98c0f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:40.086076 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679785c-714d-4ffa-b143-64e8d8f98c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:40.086348 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679785c-714d-4ffa-b143-64e8d8f98c0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:40.086789 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98e798-4f3b-407d-a0c1-fb9a65383258 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:40.087082 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679785c-714d-4ffa-b143-64e8d8f98c0f None admin] RBAC: Adding query filter params (group.id=321ee9d5e67b491bb873ed4bce14a39e, role.id=680e2c06ab714158b756dc317a3f4e2e, scope.project.id=01c75d368d814248b8ba862ee53b50dc) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:40.087392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679785c-714d-4ffa-b143-64e8d8f98c0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:40.087669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98e798-4f3b-407d-a0c1-fb9a65383258 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:40.088120 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98e798-4f3b-407d-a0c1-fb9a65383258 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:40.088823 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679785c-714d-4ffa-b143-64e8d8f98c0f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:40.099945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 175/362] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 9 02:17:39 2022] GET /identity/v3/role_assignments?group.id=321ee9d5e67b491bb873ed4bce14a39e&scope.project.id=01c75d368d814248b8ba862ee53b50dc&role.id=680e2c06ab714158b756dc317a3f4e2e => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:40.104393 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b4c13-143a-4966-8eb9-648fa48001a4 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:40.104393 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b4c13-143a-4966-8eb9-648fa48001a4 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:40.104393 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b4c13-143a-4966-8eb9-648fa48001a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:40.138524 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-505b4c13-143a-4966-8eb9-648fa48001a4 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:40.140249 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-505b4c13-143a-4966-8eb9-648fa48001a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:40.200030 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98e798-4f3b-407d-a0c1-fb9a65383258 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:40.202030 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98e798-4f3b-407d-a0c1-fb9a65383258 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:40.232600 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 176/363] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:40.233713 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b4c13-143a-4966-8eb9-648fa48001a4 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:40.330015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 188/364] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:40.330878 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98e798-4f3b-407d-a0c1-fb9a65383258 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:40.337465 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:40.373928 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b4c13-143a-4966-8eb9-648fa48001a4 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:40.386821 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:40.424023 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db5097-5fbd-4a4f-ab57-741a13a1cae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:40.424593 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db5097-5fbd-4a4f-ab57-741a13a1cae6 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:40.424871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db5097-5fbd-4a4f-ab57-741a13a1cae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:40.425166 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db5097-5fbd-4a4f-ab57-741a13a1cae6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:40.438112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db5097-5fbd-4a4f-ab57-741a13a1cae6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:40.444527 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-03db5097-5fbd-4a4f-ab57-741a13a1cae6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 02:17:40.444527 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:40.444527 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:40.444527 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:40.444527 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:40.444527 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:40.444527 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:40.444527 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:40.444527 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:40.444527 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:40.444527 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:40.444527 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:40.444527 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:40.444527 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:40.444527 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:40.444527 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:40.445420 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:40.445420 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:40.445420 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:40.445420 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:40.445420 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:40.445420 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:40.445420 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:40.445420 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:40.445420 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:40.445420 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:40.445420 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:40.445420 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:40.445420 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:40.445420 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:40.445420 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:40.445420 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:40.446217 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:40.446217 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:40.446217 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:40.446217 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:40.446217 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:40.446217 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:40.446217 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:40.446217 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:40.446217 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:40.446217 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:40.446217 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 02:17:40.446217 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:40.446217 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 177/365] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 9 02:17:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:40.446872 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db5097-5fbd-4a4f-ab57-741a13a1cae6 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:40.470160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98e798-4f3b-407d-a0c1-fb9a65383258 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:40.508258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d0d7f-c95c-416d-9c7d-8d9fc4b3ce6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:40.509556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d0d7f-c95c-416d-9c7d-8d9fc4b3ce6d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:40.510304 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d0d7f-c95c-416d-9c7d-8d9fc4b3ce6d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:40.510770 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d0d7f-c95c-416d-9c7d-8d9fc4b3ce6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:40.511885 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d0d7f-c95c-416d-9c7d-8d9fc4b3ce6d None admin] RBAC: Adding query filter params (role.id=61e3cf9f4de64b22b7254b339eab813b, user.id=2ee2ea83241e43c89501fb7b400d5688, scope.system=all) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:40.512760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d0d7f-c95c-416d-9c7d-8d9fc4b3ce6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:40.515175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d0d7f-c95c-416d-9c7d-8d9fc4b3ce6d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:40.534907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 189/366] 10.222.0.16 () {56 vars in 1308 bytes} [Tue Aug 9 02:17:40 2022] GET /identity/v3/role_assignments?user.id=2ee2ea83241e43c89501fb7b400d5688&scope.system=all&role.id=61e3cf9f4de64b22b7254b339eab813b => generated 510 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:40.535593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d0d7f-c95c-416d-9c7d-8d9fc4b3ce6d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:40.580042 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db5097-5fbd-4a4f-ab57-741a13a1cae6 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:40.609154 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:40.633945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a6e09-b758-40a1-a7b6-0308da1946a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:40.634428 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a6e09-b758-40a1-a7b6-0308da1946a9 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:40.634712 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a6e09-b758-40a1-a7b6-0308da1946a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:40.634982 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a6e09-b758-40a1-a7b6-0308da1946a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:40.659097 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a6e09-b758-40a1-a7b6-0308da1946a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:40.664051 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d0d7f-c95c-416d-9c7d-8d9fc4b3ce6d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:40.664520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-7a6a6e09-b758-40a1-a7b6-0308da1946a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:17:40.664520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:40.664520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:40.664520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:40.664520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:40.664520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:40.664520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:40.664520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:40.664520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:40.664520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:40.664520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:40.664520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:40.664520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:40.664520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:40.664520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:40.664520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:40.665639 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:40.665639 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:40.665639 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:40.665639 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:40.665639 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:40.665639 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:40.665639 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:40.665639 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:40.665639 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:40.665639 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:40.665639 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:40.665639 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:40.665639 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:40.665639 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:40.665639 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:40.665639 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:40.666433 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:40.666433 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:40.666433 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:40.666433 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:40.666433 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:40.666433 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:40.666433 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:40.666433 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:40.666433 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:40.666433 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:40.666433 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:17:40.666433 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:40.667916 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 178/367] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:17:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:40.668763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a6e09-b758-40a1-a7b6-0308da1946a9 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:40.714883 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:40.719227 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3826bf-4a42-4945-9455-86bd6820c7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:40.719889 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3826bf-4a42-4945-9455-86bd6820c7ef None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:40.720168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3826bf-4a42-4945-9455-86bd6820c7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:40.720444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3826bf-4a42-4945-9455-86bd6820c7ef None admin] PATH_INFO: `/v3/projects/fcf93baab2904060974567318edbdc0b` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:40.723867 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3826bf-4a42-4945-9455-86bd6820c7ef None admin] RBAC: Authorizing `identity:get_project(project_id=fcf93baab2904060974567318edbdc0b)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:40.725392 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3826bf-4a42-4945-9455-86bd6820c7ef None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:40.729053 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 190/368] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:40 2022] GET /identity/v3/projects/fcf93baab2904060974567318edbdc0b => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:40.733790 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3826bf-4a42-4945-9455-86bd6820c7ef None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:40.836811 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a6e09-b758-40a1-a7b6-0308da1946a9 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:40.875803 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9db56-f4b3-4eab-b6d3-19d8ff3eb803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:40.876418 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9db56-f4b3-4eab-b6d3-19d8ff3eb803 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:40.876697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9db56-f4b3-4eab-b6d3-19d8ff3eb803 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:40.876966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9db56-f4b3-4eab-b6d3-19d8ff3eb803 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:40.877662 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9db56-f4b3-4eab-b6d3-19d8ff3eb803 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:40.878429 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9db56-f4b3-4eab-b6d3-19d8ff3eb803 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:40.879933 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9db56-f4b3-4eab-b6d3-19d8ff3eb803 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:40.890142 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 179/369] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:17:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:40.891678 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9db56-f4b3-4eab-b6d3-19d8ff3eb803 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:40.915254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3826bf-4a42-4945-9455-86bd6820c7ef None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:40.962481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:40.981683 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8481cec-5039-45f3-a2c5-1ee4f4e5f5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:40.982875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8481cec-5039-45f3-a2c5-1ee4f4e5f5cb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:40.982875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8481cec-5039-45f3-a2c5-1ee4f4e5f5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:40.982875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8481cec-5039-45f3-a2c5-1ee4f4e5f5cb None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:40.983487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8481cec-5039-45f3-a2c5-1ee4f4e5f5cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:40.983787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8481cec-5039-45f3-a2c5-1ee4f4e5f5cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:40.985199 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8481cec-5039-45f3-a2c5-1ee4f4e5f5cb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:40.998978 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 191/370] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:41.004603 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8481cec-5039-45f3-a2c5-1ee4f4e5f5cb None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:41.034644 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:41.054773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9db56-f4b3-4eab-b6d3-19d8ff3eb803 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:41.108173 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ff186-9f80-4083-b118-78308bc94056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:41.108818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ff186-9f80-4083-b118-78308bc94056 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:41.109155 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ff186-9f80-4083-b118-78308bc94056 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:41.109440 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ff186-9f80-4083-b118-78308bc94056 None admin] PATH_INFO: `/v3/groups/321ee9d5e67b491bb873ed4bce14a39e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:41.110979 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ff186-9f80-4083-b118-78308bc94056 None admin] RBAC: Authorizing `identity:get_group(group_id=321ee9d5e67b491bb873ed4bce14a39e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:41.112434 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ff186-9f80-4083-b118-78308bc94056 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:41.114987 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 180/371] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 9 02:17:40 2022] GET /identity/v3/groups/321ee9d5e67b491bb873ed4bce14a39e => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:41.115836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ff186-9f80-4083-b118-78308bc94056 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:41.126027 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8481cec-5039-45f3-a2c5-1ee4f4e5f5cb None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:41.163381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e44be2-2e47-4dfe-a5b4-bfd1b30f7099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:41.164546 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e44be2-2e47-4dfe-a5b4-bfd1b30f7099 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:41.165157 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e44be2-2e47-4dfe-a5b4-bfd1b30f7099 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:41.165717 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e44be2-2e47-4dfe-a5b4-bfd1b30f7099 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:41.230220 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:41.242558 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e44be2-2e47-4dfe-a5b4-bfd1b30f7099 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:41.244630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e44be2-2e47-4dfe-a5b4-bfd1b30f7099 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:41.246077 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ff186-9f80-4083-b118-78308bc94056 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:41.287790 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4861d-f956-4b6d-8441-2430d8333334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:41.287790 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4861d-f956-4b6d-8441-2430d8333334 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:41.287790 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4861d-f956-4b6d-8441-2430d8333334 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:41.287790 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4861d-f956-4b6d-8441-2430d8333334 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:41.330484 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:41.380203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 192/372] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:41.381114 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e44be2-2e47-4dfe-a5b4-bfd1b30f7099 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:41.394329 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4861d-f956-4b6d-8441-2430d8333334 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:41.399384 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4861d-f956-4b6d-8441-2430d8333334 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:41.519787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e44be2-2e47-4dfe-a5b4-bfd1b30f7099 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:41.529758 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 181/373] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:41.530731 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4861d-f956-4b6d-8441-2430d8333334 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:41.537457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:41.568619 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c77f1-4734-4240-88d4-1c085431c627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:41.569520 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c77f1-4734-4240-88d4-1c085431c627 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:41.569809 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c77f1-4734-4240-88d4-1c085431c627 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:41.570070 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c77f1-4734-4240-88d4-1c085431c627 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:41.570910 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c77f1-4734-4240-88d4-1c085431c627 None admin] RBAC: Adding query filter params (group.id=321ee9d5e67b491bb873ed4bce14a39e, role.id=a463f0ebb5cf4516b0bec345d25071cb, scope.project.id=fcf93baab2904060974567318edbdc0b) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:41.571267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c77f1-4734-4240-88d4-1c085431c627 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:41.575154 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c77f1-4734-4240-88d4-1c085431c627 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:41.581795 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 193/374] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 9 02:17:41 2022] GET /identity/v3/role_assignments?group.id=321ee9d5e67b491bb873ed4bce14a39e&scope.project.id=fcf93baab2904060974567318edbdc0b&role.id=a463f0ebb5cf4516b0bec345d25071cb => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:41.582714 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c77f1-4734-4240-88d4-1c085431c627 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:41.602151 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:41.672599 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4861d-f956-4b6d-8441-2430d8333334 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:41.717763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c77f1-4734-4240-88d4-1c085431c627 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:41.727297 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50546c-7329-4fee-a133-13ad1d5f19b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:41.727962 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50546c-7329-4fee-a133-13ad1d5f19b5 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:41.728246 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50546c-7329-4fee-a133-13ad1d5f19b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:41.728522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50546c-7329-4fee-a133-13ad1d5f19b5 None admin] PATH_INFO: `/v3/projects/fcf93baab2904060974567318edbdc0b` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:41.733903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50546c-7329-4fee-a133-13ad1d5f19b5 None admin] RBAC: Authorizing `identity:get_project(project_id=fcf93baab2904060974567318edbdc0b)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:41.735381 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50546c-7329-4fee-a133-13ad1d5f19b5 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:41.737577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 182/375] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:41 2022] GET /identity/v3/projects/fcf93baab2904060974567318edbdc0b => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:41.762111 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50546c-7329-4fee-a133-13ad1d5f19b5 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:41.762651 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506ad8f-5e78-433d-b48b-2a66a1a68f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:41.763356 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506ad8f-5e78-433d-b48b-2a66a1a68f81 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:41.763635 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506ad8f-5e78-433d-b48b-2a66a1a68f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:41.763963 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506ad8f-5e78-433d-b48b-2a66a1a68f81 None admin] PATH_INFO: `/v3/projects/5637b6dc3c504974958d887ed2c87b3c` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:41.765239 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506ad8f-5e78-433d-b48b-2a66a1a68f81 None admin] RBAC: Authorizing `identity:get_project(project_id=5637b6dc3c504974958d887ed2c87b3c)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:41.767042 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506ad8f-5e78-433d-b48b-2a66a1a68f81 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:41.768987 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 194/376] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:41 2022] GET /identity/v3/projects/5637b6dc3c504974958d887ed2c87b3c => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:41.775011 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506ad8f-5e78-433d-b48b-2a66a1a68f81 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:41.814877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:41.904125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50546c-7329-4fee-a133-13ad1d5f19b5 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:41.944102 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:41.955408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90b400-fe06-44c4-b122-8e25b93742b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:41.956397 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90b400-fe06-44c4-b122-8e25b93742b8 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:41.956750 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90b400-fe06-44c4-b122-8e25b93742b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:41.957730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90b400-fe06-44c4-b122-8e25b93742b8 None admin] PATH_INFO: `/v3/groups/321ee9d5e67b491bb873ed4bce14a39e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:41.960604 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f90b400-fe06-44c4-b122-8e25b93742b8 None admin] RBAC: Authorizing `identity:get_group(group_id=321ee9d5e67b491bb873ed4bce14a39e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:41.962645 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f90b400-fe06-44c4-b122-8e25b93742b8 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:41.965320 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 183/377] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 9 02:17:41 2022] GET /identity/v3/groups/321ee9d5e67b491bb873ed4bce14a39e => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:41.966067 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506ad8f-5e78-433d-b48b-2a66a1a68f81 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:41.979926 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90b400-fe06-44c4-b122-8e25b93742b8 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:42.032569 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad227a-18bb-41ba-bccb-ea32edf7381c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:42.033238 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad227a-18bb-41ba-bccb-ea32edf7381c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:42.033516 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad227a-18bb-41ba-bccb-ea32edf7381c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:42.033784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad227a-18bb-41ba-bccb-ea32edf7381c None admin] PATH_INFO: `/v3/groups/d16bf8903420471abe7d32aca3bf6ac9` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:42.052079 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad227a-18bb-41ba-bccb-ea32edf7381c None admin] RBAC: Authorizing `identity:get_group(group_id=d16bf8903420471abe7d32aca3bf6ac9)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:42.053592 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad227a-18bb-41ba-bccb-ea32edf7381c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:42.057775 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 195/378] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 9 02:17:41 2022] GET /identity/v3/groups/d16bf8903420471abe7d32aca3bf6ac9 => generated 229 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:42.063669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad227a-18bb-41ba-bccb-ea32edf7381c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:42.132545 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90b400-fe06-44c4-b122-8e25b93742b8 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:42.174702 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663e2b5-c9ef-4efd-bc9b-125b094498a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:42.175528 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663e2b5-c9ef-4efd-bc9b-125b094498a1 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:42.175852 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663e2b5-c9ef-4efd-bc9b-125b094498a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:42.176158 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663e2b5-c9ef-4efd-bc9b-125b094498a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:42.176920 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9663e2b5-c9ef-4efd-bc9b-125b094498a1 None admin] RBAC: Adding query filter params (group.id=321ee9d5e67b491bb873ed4bce14a39e, role.id=680e2c06ab714158b756dc317a3f4e2e, scope.project.id=fcf93baab2904060974567318edbdc0b) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:42.177262 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9663e2b5-c9ef-4efd-bc9b-125b094498a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:42.178699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9663e2b5-c9ef-4efd-bc9b-125b094498a1 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:42.184799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 184/379] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 9 02:17:41 2022] GET /identity/v3/role_assignments?group.id=321ee9d5e67b491bb873ed4bce14a39e&scope.project.id=fcf93baab2904060974567318edbdc0b&role.id=680e2c06ab714158b756dc317a3f4e2e => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:42.254333 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:42.277175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad227a-18bb-41ba-bccb-ea32edf7381c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:42.318485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa0dd6-e66f-4e84-984c-7219f2e3d572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:42.319027 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa0dd6-e66f-4e84-984c-7219f2e3d572 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:42.319308 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa0dd6-e66f-4e84-984c-7219f2e3d572 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:42.319578 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa0dd6-e66f-4e84-984c-7219f2e3d572 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:42.320324 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa0dd6-e66f-4e84-984c-7219f2e3d572 None admin] RBAC: Adding query filter params (group.id=d16bf8903420471abe7d32aca3bf6ac9, role.id=e2095c5a29d74c33b9dcb16f8e5343bf, scope.project.id=5637b6dc3c504974958d887ed2c87b3c) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:42.320633 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa0dd6-e66f-4e84-984c-7219f2e3d572 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:42.322118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa0dd6-e66f-4e84-984c-7219f2e3d572 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:42.334588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 196/380] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 9 02:17:42 2022] GET /identity/v3/role_assignments?group.id=d16bf8903420471abe7d32aca3bf6ac9&scope.project.id=5637b6dc3c504974958d887ed2c87b3c&role.id=e2095c5a29d74c33b9dcb16f8e5343bf => generated 260 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:42.341906 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b486f9e-b3f3-4e5e-be25-917e9ae91fc0 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:42.342240 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b486f9e-b3f3-4e5e-be25-917e9ae91fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:42.342457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b486f9e-b3f3-4e5e-be25-917e9ae91fc0 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:42.344241 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 185/381] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:42.350553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8d455-e491-4f55-bf86-fc2b55151375 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:42.350829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8d455-e491-4f55-bf86-fc2b55151375 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:42.351100 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8d455-e491-4f55-bf86-fc2b55151375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:42.378691 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-52c8d455-e491-4f55-bf86-fc2b55151375 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:42.380587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-52c8d455-e491-4f55-bf86-fc2b55151375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:42.477963 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 197/382] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:42.510907 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b486f9e-b3f3-4e5e-be25-917e9ae91fc0 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:42.575437 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013859f1-cf66-4e4a-a7ff-086847967bf1 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:42.575913 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013859f1-cf66-4e4a-a7ff-086847967bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:42.576109 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013859f1-cf66-4e4a-a7ff-086847967bf1 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:42.577712 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 198/383] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:42.582663 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4f7ca-fac1-423b-bb1d-527841534b01 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:42.583002 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4f7ca-fac1-423b-bb1d-527841534b01 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:42.583276 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4f7ca-fac1-423b-bb1d-527841534b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:42.606181 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a0d4f7ca-fac1-423b-bb1d-527841534b01 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:42.607383 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a0d4f7ca-fac1-423b-bb1d-527841534b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:42.615616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:42.688166 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b486f9e-b3f3-4e5e-be25-917e9ae91fc0 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:42.709878 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 199/384] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 02:17:42.731626 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4f7ca-fac1-423b-bb1d-527841534b01 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:42.746309 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:42.767581 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3750452-8db1-46aa-89cd-9496e9ed1205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:42.768559 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3750452-8db1-46aa-89cd-9496e9ed1205 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:42.769087 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3750452-8db1-46aa-89cd-9496e9ed1205 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:42.769559 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3750452-8db1-46aa-89cd-9496e9ed1205 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:42.791065 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3750452-8db1-46aa-89cd-9496e9ed1205 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:42.799013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-d3750452-8db1-46aa-89cd-9496e9ed1205 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:42.799013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:42.799013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:42.799013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:42.799013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:42.799013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:42.799013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:42.799013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:42.799013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:42.799013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:42.799013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:42.799013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:42.799013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:42.799013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:42.799013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:42.799013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:42.799891 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:42.799891 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:42.799891 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:42.799891 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:42.799891 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:42.799891 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:42.799891 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:42.799891 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:42.799891 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:42.799891 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:42.799891 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:42.799891 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:42.799891 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:42.799891 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:42.799891 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:42.799891 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:42.800665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:42.800665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:42.800665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:42.800665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:42.800665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:42.800665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:42.800665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:42.800665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:42.800665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:42.800665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:42.800665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:42.800665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:42.805234 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 186/385] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:42.812407 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3750452-8db1-46aa-89cd-9496e9ed1205 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:42.906827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4f7ca-fac1-423b-bb1d-527841534b01 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:42.942356 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890cdd5-7efc-4ad7-ba49-c4a355166b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:42.943135 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890cdd5-7efc-4ad7-ba49-c4a355166b66 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:42.943471 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890cdd5-7efc-4ad7-ba49-c4a355166b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:42.943812 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890cdd5-7efc-4ad7-ba49-c4a355166b66 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:42.955499 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890cdd5-7efc-4ad7-ba49-c4a355166b66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:42.961622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-3890cdd5-7efc-4ad7-ba49-c4a355166b66 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 02:17:42.961622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:42.961622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:42.961622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:42.961622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:42.961622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:42.961622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:42.961622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:42.961622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:42.961622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:42.961622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:42.961622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:42.961622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:42.961622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:42.961622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:42.961622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:42.962495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:42.962495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:42.962495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:42.962495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:42.962495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:42.962495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:42.962495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:42.962495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:42.962495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:42.962495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:42.962495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:42.962495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:42.962495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:42.962495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:42.962495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:42.962495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:42.963800 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:42.963800 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:42.963800 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:42.963800 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:42.963800 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:42.963800 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:42.963800 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:42.963800 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:42.963800 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:42.963800 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:42.963800 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 02:17:42.963800 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:42.963800 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 200/386] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 9 02:17:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:17:42.968299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890cdd5-7efc-4ad7-ba49-c4a355166b66 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:42.986172 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3750452-8db1-46aa-89cd-9496e9ed1205 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:43.030490 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:43.049631 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:43.065573 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ebb7f-de5f-4448-b5ff-0fa0da3aeb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:43.066404 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ebb7f-de5f-4448-b5ff-0fa0da3aeb25 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:43.066834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ebb7f-de5f-4448-b5ff-0fa0da3aeb25 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:43.067276 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ebb7f-de5f-4448-b5ff-0fa0da3aeb25 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:43.068187 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ebb7f-de5f-4448-b5ff-0fa0da3aeb25 None admin] RBAC: Adding query filter params (name=member) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:43.068750 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ebb7f-de5f-4448-b5ff-0fa0da3aeb25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:43.070376 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ebb7f-de5f-4448-b5ff-0fa0da3aeb25 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:43.084631 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890cdd5-7efc-4ad7-ba49-c4a355166b66 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:43.092543 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 187/387] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:17:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:43.101238 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ebb7f-de5f-4448-b5ff-0fa0da3aeb25 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:43.128179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ef0dc-7c40-469c-a2bf-85e49f657db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:43.129052 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ef0dc-7c40-469c-a2bf-85e49f657db7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:43.129334 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ef0dc-7c40-469c-a2bf-85e49f657db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:43.129607 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ef0dc-7c40-469c-a2bf-85e49f657db7 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:43.130366 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ef0dc-7c40-469c-a2bf-85e49f657db7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:43.131137 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ef0dc-7c40-469c-a2bf-85e49f657db7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:43.132798 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ef0dc-7c40-469c-a2bf-85e49f657db7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:43.142485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 201/388] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:17:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:43.147658 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ef0dc-7c40-469c-a2bf-85e49f657db7 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:43.239185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ebb7f-de5f-4448-b5ff-0fa0da3aeb25 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:43.275754 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b18ef-c474-4259-ae24-1ed81ab9a938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:43.276390 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b18ef-c474-4259-ae24-1ed81ab9a938 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:43.276671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b18ef-c474-4259-ae24-1ed81ab9a938 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:43.276945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b18ef-c474-4259-ae24-1ed81ab9a938 None admin] PATH_INFO: `/v3/groups/321ee9d5e67b491bb873ed4bce14a39e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:43.278097 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b18ef-c474-4259-ae24-1ed81ab9a938 None admin] RBAC: Authorizing `identity:get_group(group_id=321ee9d5e67b491bb873ed4bce14a39e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:43.279537 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b18ef-c474-4259-ae24-1ed81ab9a938 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:43.281486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 188/389] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 9 02:17:43 2022] GET /identity/v3/groups/321ee9d5e67b491bb873ed4bce14a39e => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:43.288039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b18ef-c474-4259-ae24-1ed81ab9a938 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:43.346105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:43.399348 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b18ef-c474-4259-ae24-1ed81ab9a938 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:43.403139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ef0dc-7c40-469c-a2bf-85e49f657db7 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:43.435214 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da73bb-d144-4337-b775-70f47eb07a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:43.436236 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da73bb-d144-4337-b775-70f47eb07a0f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:43.436721 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da73bb-d144-4337-b775-70f47eb07a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:43.437239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90da73bb-d144-4337-b775-70f47eb07a0f None admin] PATH_INFO: `/v3/projects/01c75d368d814248b8ba862ee53b50dc` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:43.439049 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da73bb-d144-4337-b775-70f47eb07a0f None admin] RBAC: Authorizing `identity:get_project(project_id=01c75d368d814248b8ba862ee53b50dc)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:43.440976 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90da73bb-d144-4337-b775-70f47eb07a0f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:43.443895 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 189/390] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:43 2022] GET /identity/v3/projects/01c75d368d814248b8ba862ee53b50dc => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:43.449253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da73bb-d144-4337-b775-70f47eb07a0f None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:43.479534 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:43.509787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da176b65-3f74-4224-a572-2157e3623c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:43.510361 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da176b65-3f74-4224-a572-2157e3623c5f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:43.510648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da176b65-3f74-4224-a572-2157e3623c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:43.510924 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da176b65-3f74-4224-a572-2157e3623c5f None admin] PATH_INFO: `/v3/groups/321ee9d5e67b491bb873ed4bce14a39e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:43.514519 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da176b65-3f74-4224-a572-2157e3623c5f None admin] RBAC: Authorizing `identity:get_group(group_id=321ee9d5e67b491bb873ed4bce14a39e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:43.516201 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da176b65-3f74-4224-a572-2157e3623c5f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:43.517953 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 202/391] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 9 02:17:43 2022] GET /identity/v3/groups/321ee9d5e67b491bb873ed4bce14a39e => generated 226 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:43.525916 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da176b65-3f74-4224-a572-2157e3623c5f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:43.561584 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90da73bb-d144-4337-b775-70f47eb07a0f None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:43.581421 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:43.601252 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4a325-35da-473b-ba43-211bad93b26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:43.602596 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4a325-35da-473b-ba43-211bad93b26a None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:43.603079 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4a325-35da-473b-ba43-211bad93b26a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:43.603551 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4a325-35da-473b-ba43-211bad93b26a None admin] PATH_INFO: `/v3/projects/01c75d368d814248b8ba862ee53b50dc/groups/321ee9d5e67b491bb873ed4bce14a39e/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:43.605973 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e4a325-35da-473b-ba43-211bad93b26a None admin] RBAC: Authorizing `identity:create_grant(project_id=01c75d368d814248b8ba862ee53b50dc, group_id=321ee9d5e67b491bb873ed4bce14a39e, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:43.607680 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e4a325-35da-473b-ba43-211bad93b26a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:43.636531 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 190/392] 10.222.0.16 () {58 vars in 1442 bytes} [Tue Aug 9 02:17:43 2022] PUT /identity/v3/projects/01c75d368d814248b8ba862ee53b50dc/groups/321ee9d5e67b491bb873ed4bce14a39e/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:17:43.745495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da176b65-3f74-4224-a572-2157e3623c5f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:43.790045 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88671a30-e93a-4f44-99e8-f74996362349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:43.790686 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88671a30-e93a-4f44-99e8-f74996362349 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:43.790963 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88671a30-e93a-4f44-99e8-f74996362349 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:43.791233 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88671a30-e93a-4f44-99e8-f74996362349 None admin] PATH_INFO: `/v3/projects/01c75d368d814248b8ba862ee53b50dc` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:43.793792 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88671a30-e93a-4f44-99e8-f74996362349 None admin] RBAC: Authorizing `identity:get_project(project_id=01c75d368d814248b8ba862ee53b50dc)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:43.795266 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88671a30-e93a-4f44-99e8-f74996362349 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:43.796993 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 203/393] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:43 2022] GET /identity/v3/projects/01c75d368d814248b8ba862ee53b50dc => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:43.803593 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4a325-35da-473b-ba43-211bad93b26a None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:43.917734 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4a325-35da-473b-ba43-211bad93b26a None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:43.963819 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba0bae-b46f-416e-8e1f-78e0ce5845e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:43.964482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba0bae-b46f-416e-8e1f-78e0ce5845e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:43.964760 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba0bae-b46f-416e-8e1f-78e0ce5845e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:43.965045 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba0bae-b46f-416e-8e1f-78e0ce5845e8 None admin] PATH_INFO: `/v3/projects/01c75d368d814248b8ba862ee53b50dc/groups/321ee9d5e67b491bb873ed4bce14a39e/roles/680e2c06ab714158b756dc317a3f4e2e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:43.985875 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba0bae-b46f-416e-8e1f-78e0ce5845e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=01c75d368d814248b8ba862ee53b50dc, group_id=321ee9d5e67b491bb873ed4bce14a39e, role_id=680e2c06ab714158b756dc317a3f4e2e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:43.987379 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba0bae-b46f-416e-8e1f-78e0ce5845e8 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:44.013240 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 191/394] 10.222.0.16 () {58 vars in 1442 bytes} [Tue Aug 9 02:17:43 2022] PUT /identity/v3/projects/01c75d368d814248b8ba862ee53b50dc/groups/321ee9d5e67b491bb873ed4bce14a39e/roles/680e2c06ab714158b756dc317a3f4e2e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:17:44.313930 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07bd30-ea43-4a9c-94ee-e5e0fb731bde None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:44.314223 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07bd30-ea43-4a9c-94ee-e5e0fb731bde None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:44.314545 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07bd30-ea43-4a9c-94ee-e5e0fb731bde None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:44.316250 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 204/395] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:44.329171 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a447ac-9c8a-47ae-8721-a6334772339c None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:44.329457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a447ac-9c8a-47ae-8721-a6334772339c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:44.329791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a447ac-9c8a-47ae-8721-a6334772339c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:44.352002 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-67a447ac-9c8a-47ae-8721-a6334772339c None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:44.353266 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-67a447ac-9c8a-47ae-8721-a6334772339c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:44.386419 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:44.446605 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 192/396] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:44.469558 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a4a36-9c89-45f7-8092-b68f67ae5eff None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:44.470192 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a4a36-9c89-45f7-8092-b68f67ae5eff None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:44.470678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a4a36-9c89-45f7-8092-b68f67ae5eff None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:44.472455 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 205/397] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:44.477919 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b747ed-25a7-472c-bff0-55105d0a0ee8 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:44.478200 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b747ed-25a7-472c-bff0-55105d0a0ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:44.478468 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b747ed-25a7-472c-bff0-55105d0a0ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:44.482815 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a4a36-9c89-45f7-8092-b68f67ae5eff None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:44.510032 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a5b747ed-25a7-472c-bff0-55105d0a0ee8 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:44.511235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a5b747ed-25a7-472c-bff0-55105d0a0ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:44.592558 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:44.638157 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 193/398] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:44.653807 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a4a36-9c89-45f7-8092-b68f67ae5eff None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:44.667579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b747ed-25a7-472c-bff0-55105d0a0ee8 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:44.709052 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e9c40-336a-4f66-b51c-9b47395ada8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:44.710058 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e9c40-336a-4f66-b51c-9b47395ada8a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:44.710569 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e9c40-336a-4f66-b51c-9b47395ada8a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:44.711126 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e9c40-336a-4f66-b51c-9b47395ada8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:44.722624 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e9c40-336a-4f66-b51c-9b47395ada8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:44.728485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-5a6e9c40-336a-4f66-b51c-9b47395ada8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:44.728485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:44.728485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:44.728485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:44.728485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:44.728485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:44.728485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:44.728485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:44.728485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:44.728485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:44.728485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:44.728485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:44.728485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:44.728485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:44.728485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:44.728485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:44.729445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:44.729445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:44.729445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:44.729445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:44.729445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:44.729445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:44.729445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:44.729445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:44.729445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:44.729445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:44.729445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:44.729445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:44.729445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:44.729445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:44.729445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:44.729445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:44.730375 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:44.730375 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:44.730375 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:44.730375 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:44.730375 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:44.730375 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:44.730375 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:44.730375 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:44.730375 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:44.730375 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:44.730375 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:44.730375 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:44.733122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 206/399] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:44.749681 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e9c40-336a-4f66-b51c-9b47395ada8a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:44.834629 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:44.844877 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b747ed-25a7-472c-bff0-55105d0a0ee8 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:44.912281 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a9d90-2dc9-4522-89ae-3593d9796241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:44.912919 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a9d90-2dc9-4522-89ae-3593d9796241 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:44.914036 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a9d90-2dc9-4522-89ae-3593d9796241 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:44.914308 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a9d90-2dc9-4522-89ae-3593d9796241 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:44.930133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e9c40-336a-4f66-b51c-9b47395ada8a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:44.937460 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a9d90-2dc9-4522-89ae-3593d9796241 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:44.942317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-a78a9d90-2dc9-4522-89ae-3593d9796241 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 02:17:44.942317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:44.942317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:44.942317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:44.942317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:44.942317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:44.942317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:44.942317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:44.942317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:44.942317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:44.942317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:44.942317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:44.942317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:44.942317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:44.942317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:44.942317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:44.943291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:44.943291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:44.943291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:44.943291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:44.943291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:44.943291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:44.943291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:44.943291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:44.943291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:44.943291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:44.943291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:44.943291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:44.943291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:44.943291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:44.943291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:44.943291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:44.944706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:44.944706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:44.944706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:44.944706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:44.944706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:44.944706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:44.944706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:44.944706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:44.944706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:44.944706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:44.944706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 02:17:44.944706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:44.944706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 194/400] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 9 02:17:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:44.945516 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d62f00-29c4-4b7e-a3b7-b318829857d1 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:44.945516 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d62f00-29c4-4b7e-a3b7-b318829857d1 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:44.945516 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d62f00-29c4-4b7e-a3b7-b318829857d1 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:44.950797 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 195/401] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:44.950797 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d62f00-29c4-4b7e-a3b7-b318829857d1 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:44.974679 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:44.992358 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46366ca8-5800-4c06-8404-6e073696ff30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:44.993681 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46366ca8-5800-4c06-8404-6e073696ff30 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:44.994170 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46366ca8-5800-4c06-8404-6e073696ff30 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:44.994645 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46366ca8-5800-4c06-8404-6e073696ff30 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:44.995549 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46366ca8-5800-4c06-8404-6e073696ff30 None admin] RBAC: Adding query filter params (name=member) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:44.996309 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46366ca8-5800-4c06-8404-6e073696ff30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:44.998003 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46366ca8-5800-4c06-8404-6e073696ff30 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:45.008878 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 207/402] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:17:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:45.010583 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33016e-b7a0-465a-92a9-504da24a94e6 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:45.011089 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33016e-b7a0-465a-92a9-504da24a94e6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:45.011566 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33016e-b7a0-465a-92a9-504da24a94e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:45.032600 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-cc33016e-b7a0-465a-92a9-504da24a94e6 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:45.034265 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cc33016e-b7a0-465a-92a9-504da24a94e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:45.072029 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d62f00-29c4-4b7e-a3b7-b318829857d1 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:45.109069 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6120c91-db77-4ad3-a4de-b64f425f8e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:45.109599 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6120c91-db77-4ad3-a4de-b64f425f8e58 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:45.109881 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6120c91-db77-4ad3-a4de-b64f425f8e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:45.110155 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6120c91-db77-4ad3-a4de-b64f425f8e58 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:45.110820 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6120c91-db77-4ad3-a4de-b64f425f8e58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:45.111126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6120c91-db77-4ad3-a4de-b64f425f8e58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:45.112512 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6120c91-db77-4ad3-a4de-b64f425f8e58 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:45.115763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 208/403] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:45.116854 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33016e-b7a0-465a-92a9-504da24a94e6 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:45.130576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 196/404] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:17:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:45.131845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6120c91-db77-4ad3-a4de-b64f425f8e58 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:45.166946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:45.229734 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33016e-b7a0-465a-92a9-504da24a94e6 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:45.246171 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6120c91-db77-4ad3-a4de-b64f425f8e58 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:45.252305 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:45.269637 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cad6ef-4bb6-4b4e-9a04-ef5add9ffb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:45.271103 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cad6ef-4bb6-4b4e-9a04-ef5add9ffb69 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:45.271590 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cad6ef-4bb6-4b4e-9a04-ef5add9ffb69 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:45.272129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cad6ef-4bb6-4b4e-9a04-ef5add9ffb69 None admin] PATH_INFO: `/v3/groups/321ee9d5e67b491bb873ed4bce14a39e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:45.273556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cad6ef-4bb6-4b4e-9a04-ef5add9ffb69 None admin] RBAC: Authorizing `identity:get_group(group_id=321ee9d5e67b491bb873ed4bce14a39e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:45.275336 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cad6ef-4bb6-4b4e-9a04-ef5add9ffb69 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:45.277803 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 209/405] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 9 02:17:45 2022] GET /identity/v3/groups/321ee9d5e67b491bb873ed4bce14a39e => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:45.278751 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cad6ef-4bb6-4b4e-9a04-ef5add9ffb69 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:45.285126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce90206-a21b-4e03-9e2e-7b29a48c458f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:45.285771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce90206-a21b-4e03-9e2e-7b29a48c458f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:45.286629 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce90206-a21b-4e03-9e2e-7b29a48c458f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:45.286906 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce90206-a21b-4e03-9e2e-7b29a48c458f None admin] PATH_INFO: `/v3/groups/321ee9d5e67b491bb873ed4bce14a39e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:45.288059 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce90206-a21b-4e03-9e2e-7b29a48c458f None admin] RBAC: Authorizing `identity:get_group(group_id=321ee9d5e67b491bb873ed4bce14a39e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:45.289549 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce90206-a21b-4e03-9e2e-7b29a48c458f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:45.291454 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 197/406] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 9 02:17:45 2022] GET /identity/v3/groups/321ee9d5e67b491bb873ed4bce14a39e => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:45.292297 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce90206-a21b-4e03-9e2e-7b29a48c458f None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:45.404204 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:45.406262 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cad6ef-4bb6-4b4e-9a04-ef5add9ffb69 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:45.417343 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce90206-a21b-4e03-9e2e-7b29a48c458f None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:45.447846 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de7715-2f3c-4328-ac27-59e8e8440a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:45.448950 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de7715-2f3c-4328-ac27-59e8e8440a44 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:45.449469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de7715-2f3c-4328-ac27-59e8e8440a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:45.449949 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de7715-2f3c-4328-ac27-59e8e8440a44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:45.453867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f7631-1cff-4a91-a772-69818675727d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:45.454568 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f7631-1cff-4a91-a772-69818675727d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:45.454852 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f7631-1cff-4a91-a772-69818675727d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:45.455130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f7631-1cff-4a91-a772-69818675727d None admin] PATH_INFO: `/v3/projects/fcf93baab2904060974567318edbdc0b` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:45.456325 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f7631-1cff-4a91-a772-69818675727d None admin] RBAC: Authorizing `identity:get_project(project_id=fcf93baab2904060974567318edbdc0b)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:45.458348 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f7631-1cff-4a91-a772-69818675727d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:45.463729 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de7715-2f3c-4328-ac27-59e8e8440a44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:45.465013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 198/407] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:45 2022] GET /identity/v3/projects/fcf93baab2904060974567318edbdc0b => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:45.465878 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f7631-1cff-4a91-a772-69818675727d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:45.470076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-50de7715-2f3c-4328-ac27-59e8e8440a44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:17:45.470076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:45.470076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:45.470076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:45.470076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:45.470076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:45.470076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:45.470076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:45.470076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:45.470076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:45.470076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:45.470076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:45.470076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:45.470076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:45.470076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:45.470076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:45.470946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:45.470946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:45.470946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:45.470946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:45.470946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:45.470946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:45.470946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:45.470946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:45.470946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:45.470946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:45.470946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:45.470946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:45.470946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:45.470946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:45.470946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:45.470946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:45.471713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:45.471713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:45.471713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:45.471713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:45.471713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:45.471713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:45.471713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:45.471713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:45.471713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:45.471713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:45.471713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:17:45.471713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:45.474789 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 210/408] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:17:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:45.475750 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de7715-2f3c-4328-ac27-59e8e8440a44 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:45.529577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:45.575739 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f7631-1cff-4a91-a772-69818675727d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:45.588385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de7715-2f3c-4328-ac27-59e8e8440a44 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:45.611399 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21051cf1-15df-4ab7-9bc4-71a48d17f45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:45.612041 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21051cf1-15df-4ab7-9bc4-71a48d17f45a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:45.612325 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21051cf1-15df-4ab7-9bc4-71a48d17f45a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:45.612602 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21051cf1-15df-4ab7-9bc4-71a48d17f45a None admin] PATH_INFO: `/v3/projects/fcf93baab2904060974567318edbdc0b` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:45.613751 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21051cf1-15df-4ab7-9bc4-71a48d17f45a None admin] RBAC: Authorizing `identity:get_project(project_id=fcf93baab2904060974567318edbdc0b)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:45.615742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21051cf1-15df-4ab7-9bc4-71a48d17f45a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:45.618046 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 199/409] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:45 2022] GET /identity/v3/projects/fcf93baab2904060974567318edbdc0b => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:45.618975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21051cf1-15df-4ab7-9bc4-71a48d17f45a None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:45.631077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051e85f-2940-4b1d-8c34-b4edbc5c9e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:45.632159 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051e85f-2940-4b1d-8c34-b4edbc5c9e66 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:45.632644 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051e85f-2940-4b1d-8c34-b4edbc5c9e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:45.633161 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051e85f-2940-4b1d-8c34-b4edbc5c9e66 None admin] PATH_INFO: `/v3/projects/fcf93baab2904060974567318edbdc0b/groups/321ee9d5e67b491bb873ed4bce14a39e/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:45.635372 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051e85f-2940-4b1d-8c34-b4edbc5c9e66 None admin] RBAC: Authorizing `identity:create_grant(project_id=fcf93baab2904060974567318edbdc0b, group_id=321ee9d5e67b491bb873ed4bce14a39e, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:45.637102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051e85f-2940-4b1d-8c34-b4edbc5c9e66 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:45.645691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:45.655696 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 211/410] 10.222.0.16 () {58 vars in 1442 bytes} [Tue Aug 9 02:17:45 2022] PUT /identity/v3/projects/fcf93baab2904060974567318edbdc0b/groups/321ee9d5e67b491bb873ed4bce14a39e/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:17:45.656791 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051e85f-2940-4b1d-8c34-b4edbc5c9e66 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:45.773011 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21051cf1-15df-4ab7-9bc4-71a48d17f45a None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:45.774290 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051e85f-2940-4b1d-8c34-b4edbc5c9e66 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:45.785174 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:45.819131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d8cfa-c7f5-4514-9d44-07ccaa00f86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:45.820297 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d8cfa-c7f5-4514-9d44-07ccaa00f86d None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:45.820837 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d8cfa-c7f5-4514-9d44-07ccaa00f86d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:45.821322 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d8cfa-c7f5-4514-9d44-07ccaa00f86d None admin] PATH_INFO: `/v3/projects/fcf93baab2904060974567318edbdc0b/groups/321ee9d5e67b491bb873ed4bce14a39e/roles/680e2c06ab714158b756dc317a3f4e2e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:45.823815 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d8cfa-c7f5-4514-9d44-07ccaa00f86d None admin] RBAC: Authorizing `identity:create_grant(project_id=fcf93baab2904060974567318edbdc0b, group_id=321ee9d5e67b491bb873ed4bce14a39e, role_id=680e2c06ab714158b756dc317a3f4e2e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:45.825594 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d8cfa-c7f5-4514-9d44-07ccaa00f86d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:45.840445 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12cf09-99c7-4127-a0d0-758dc38f467f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:45.841114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12cf09-99c7-4127-a0d0-758dc38f467f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:45.841389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12cf09-99c7-4127-a0d0-758dc38f467f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:45.841666 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12cf09-99c7-4127-a0d0-758dc38f467f None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:45.842345 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12cf09-99c7-4127-a0d0-758dc38f467f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:45.842712 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12cf09-99c7-4127-a0d0-758dc38f467f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:45.843400 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 212/411] 10.222.0.16 () {58 vars in 1442 bytes} [Tue Aug 9 02:17:45 2022] PUT /identity/v3/projects/fcf93baab2904060974567318edbdc0b/groups/321ee9d5e67b491bb873ed4bce14a39e/roles/680e2c06ab714158b756dc317a3f4e2e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:17:45.847235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12cf09-99c7-4127-a0d0-758dc38f467f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:45.862711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 200/412] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:45.869073 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d8cfa-c7f5-4514-9d44-07ccaa00f86d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:45.941139 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e20460-cc81-42b7-9fa9-b70110a8360c None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:45.941336 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e20460-cc81-42b7-9fa9-b70110a8360c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:45.941607 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e20460-cc81-42b7-9fa9-b70110a8360c None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:45.945730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 201/413] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:45.951995 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69592c38-85af-4716-8d07-fbab0b0c2457 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:45.952289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69592c38-85af-4716-8d07-fbab0b0c2457 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:45.952556 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69592c38-85af-4716-8d07-fbab0b0c2457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:45.985480 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-69592c38-85af-4716-8d07-fbab0b0c2457 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:45.986727 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-69592c38-85af-4716-8d07-fbab0b0c2457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:46.011129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d8cfa-c7f5-4514-9d44-07ccaa00f86d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:46.053938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c29438-77c1-47f1-86a6-08956b3052c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:46.054918 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c29438-77c1-47f1-86a6-08956b3052c1 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:46.055392 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c29438-77c1-47f1-86a6-08956b3052c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:46.055883 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c29438-77c1-47f1-86a6-08956b3052c1 None admin] PATH_INFO: `/v3/groups/d16bf8903420471abe7d32aca3bf6ac9` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:46.057349 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c29438-77c1-47f1-86a6-08956b3052c1 None admin] RBAC: Authorizing `identity:get_group(group_id=d16bf8903420471abe7d32aca3bf6ac9)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:46.059038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c29438-77c1-47f1-86a6-08956b3052c1 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:46.065060 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 213/414] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 9 02:17:45 2022] GET /identity/v3/groups/d16bf8903420471abe7d32aca3bf6ac9 => generated 229 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:46.067241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c29438-77c1-47f1-86a6-08956b3052c1 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:46.073465 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 202/415] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:46.105564 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:46.107525 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69592c38-85af-4716-8d07-fbab0b0c2457 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:46.129767 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:46.209321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c29438-77c1-47f1-86a6-08956b3052c1 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:46.275133 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69592c38-85af-4716-8d07-fbab0b0c2457 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:46.277861 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbffa2-033c-44af-8900-a89b739bb984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:46.278864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbffa2-033c-44af-8900-a89b739bb984 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:46.279150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbffa2-033c-44af-8900-a89b739bb984 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:46.279426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cbffa2-033c-44af-8900-a89b739bb984 None admin] PATH_INFO: `/v3/projects/5637b6dc3c504974958d887ed2c87b3c` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:46.283547 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbffa2-033c-44af-8900-a89b739bb984 None admin] RBAC: Authorizing `identity:get_project(project_id=5637b6dc3c504974958d887ed2c87b3c)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:46.285300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cbffa2-033c-44af-8900-a89b739bb984 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:46.288501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 214/416] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:46 2022] GET /identity/v3/projects/5637b6dc3c504974958d887ed2c87b3c => generated 344 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:46.294515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbffa2-033c-44af-8900-a89b739bb984 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:46.339690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8b65d-f1a7-4f79-be9a-b003a5b93383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:46.340346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8b65d-f1a7-4f79-be9a-b003a5b93383 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:46.340625 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8b65d-f1a7-4f79-be9a-b003a5b93383 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:46.340897 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8b65d-f1a7-4f79-be9a-b003a5b93383 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:46.363003 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8b65d-f1a7-4f79-be9a-b003a5b93383 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:46.371503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-0fb8b65d-f1a7-4f79-be9a-b003a5b93383 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:46.371503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:46.371503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:46.371503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:46.371503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:46.371503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:46.371503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:46.371503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:46.371503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:46.371503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:46.371503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:46.371503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:46.371503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:46.371503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:46.371503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:46.371503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:46.372377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:46.372377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:46.372377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:46.372377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:46.372377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:46.372377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:46.372377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:46.372377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:46.372377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:46.372377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:46.372377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:46.372377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:46.372377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:46.372377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:46.372377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:46.372377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:46.373201 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:46.373201 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:46.373201 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:46.373201 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:46.373201 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:46.373201 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:46.373201 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:46.373201 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:46.373201 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:46.373201 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:46.373201 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:46.373201 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:46.375705 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 203/417] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:46.383120 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8b65d-f1a7-4f79-be9a-b003a5b93383 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:46.456769 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cbffa2-033c-44af-8900-a89b739bb984 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:46.460241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:46.497012 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f986667-676e-488c-8ad9-ae720d746e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:46.497807 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f986667-676e-488c-8ad9-ae720d746e58 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:46.498151 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f986667-676e-488c-8ad9-ae720d746e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:46.498491 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f986667-676e-488c-8ad9-ae720d746e58 None admin] PATH_INFO: `/v3/projects/5637b6dc3c504974958d887ed2c87b3c/groups/d16bf8903420471abe7d32aca3bf6ac9/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:46.500649 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f986667-676e-488c-8ad9-ae720d746e58 None admin] RBAC: Authorizing `identity:create_grant(project_id=5637b6dc3c504974958d887ed2c87b3c, group_id=d16bf8903420471abe7d32aca3bf6ac9, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:46.502319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f986667-676e-488c-8ad9-ae720d746e58 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:46.509754 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:46.521815 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 215/418] 10.222.0.16 () {58 vars in 1442 bytes} [Tue Aug 9 02:17:46 2022] PUT /identity/v3/projects/5637b6dc3c504974958d887ed2c87b3c/groups/d16bf8903420471abe7d32aca3bf6ac9/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:17:46.523142 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04a9a2-87c5-420f-b249-456912eb1911 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:46.523485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04a9a2-87c5-420f-b249-456912eb1911 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:46.523832 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04a9a2-87c5-420f-b249-456912eb1911 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:46.530155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 216/419] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:46.532855 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65c792-e02b-41fa-bda6-b1ce0b5acb28 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:46.533166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65c792-e02b-41fa-bda6-b1ce0b5acb28 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:46.533440 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65c792-e02b-41fa-bda6-b1ce0b5acb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:46.547401 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8b65d-f1a7-4f79-be9a-b003a5b93383 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:46.555970 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-4b65c792-e02b-41fa-bda6-b1ce0b5acb28 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:46.557588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4b65c792-e02b-41fa-bda6-b1ce0b5acb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:46.591095 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a30bb9-4154-4442-a436-067f9171dcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:46.591973 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a30bb9-4154-4442-a436-067f9171dcc1 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:46.592252 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a30bb9-4154-4442-a436-067f9171dcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:46.592521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a30bb9-4154-4442-a436-067f9171dcc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:46.593228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a30bb9-4154-4442-a436-067f9171dcc1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:46.593535 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a30bb9-4154-4442-a436-067f9171dcc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:46.595497 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a30bb9-4154-4442-a436-067f9171dcc1 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:46.606055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 204/420] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:17:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:46.616014 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a30bb9-4154-4442-a436-067f9171dcc1 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:46.647111 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 217/421] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:46.672317 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65c792-e02b-41fa-bda6-b1ce0b5acb28 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:46.743016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a30bb9-4154-4442-a436-067f9171dcc1 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:46.790513 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc8048-762b-42f7-88e6-180d7972d8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:46.791900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc8048-762b-42f7-88e6-180d7972d8fc None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:46.793377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc8048-762b-42f7-88e6-180d7972d8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:46.794140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc8048-762b-42f7-88e6-180d7972d8fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:46.810269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:46.831286 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:46.843367 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65c792-e02b-41fa-bda6-b1ce0b5acb28 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:46.887958 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc8048-762b-42f7-88e6-180d7972d8fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:46.889910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc8048-762b-42f7-88e6-180d7972d8fc None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:46.894318 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6cfe9-3c54-4358-84a8-2d9689a821e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:46.894966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6cfe9-3c54-4358-84a8-2d9689a821e3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:46.895283 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6cfe9-3c54-4358-84a8-2d9689a821e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:46.895560 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6cfe9-3c54-4358-84a8-2d9689a821e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:46.909580 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6cfe9-3c54-4358-84a8-2d9689a821e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:46.915486 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-28b6cfe9-3c54-4358-84a8-2d9689a821e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 02:17:46.915486 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:46.915486 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:46.915486 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:46.915486 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:46.915486 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:46.915486 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:46.915486 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:46.915486 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:46.915486 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:46.915486 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:46.915486 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:46.915486 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:46.915486 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:46.915486 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:46.915486 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:46.916394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:46.916394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:46.916394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:46.916394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:46.916394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:46.916394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:46.916394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:46.916394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:46.916394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:46.916394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:46.916394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:46.916394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:46.916394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:46.916394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:46.916394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:46.916394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:46.917265 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:46.917265 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:46.917265 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:46.917265 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:46.917265 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:46.917265 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:46.917265 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:46.917265 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:46.917265 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:46.917265 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:46.917265 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 02:17:46.917265 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:46.921154 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 218/422] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 9 02:17:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:46.923613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6cfe9-3c54-4358-84a8-2d9689a821e3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:47.081512 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 205/423] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:47.088082 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc8048-762b-42f7-88e6-180d7972d8fc None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:47.127011 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6cfe9-3c54-4358-84a8-2d9689a821e3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:47.137613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:47.199069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7cf06-69a4-471d-86cd-08f388e9e4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:47.199069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7cf06-69a4-471d-86cd-08f388e9e4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:47.199069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7cf06-69a4-471d-86cd-08f388e9e4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:47.199069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7cf06-69a4-471d-86cd-08f388e9e4b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:47.199506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7cf06-69a4-471d-86cd-08f388e9e4b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:47.199506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7cf06-69a4-471d-86cd-08f388e9e4b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:47.199506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7cf06-69a4-471d-86cd-08f388e9e4b7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:47.206482 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 219/424] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:17:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:47.213371 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc8048-762b-42f7-88e6-180d7972d8fc None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:47.214457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7cf06-69a4-471d-86cd-08f388e9e4b7 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:47.246717 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:47.281739 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e385d-d291-4eb3-8a1c-e7a547a34957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:47.282391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e385d-d291-4eb3-8a1c-e7a547a34957 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:47.282676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e385d-d291-4eb3-8a1c-e7a547a34957 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:47.282953 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e385d-d291-4eb3-8a1c-e7a547a34957 None admin] PATH_INFO: `/v3/projects/01c75d368d814248b8ba862ee53b50dc` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:47.284125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e385d-d291-4eb3-8a1c-e7a547a34957 None admin] RBAC: Authorizing `identity:get_project(project_id=01c75d368d814248b8ba862ee53b50dc)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:47.286270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e385d-d291-4eb3-8a1c-e7a547a34957 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:47.292073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 206/425] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:47 2022] GET /identity/v3/projects/01c75d368d814248b8ba862ee53b50dc => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:47.293536 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e385d-d291-4eb3-8a1c-e7a547a34957 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:47.373399 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7cf06-69a4-471d-86cd-08f388e9e4b7 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:47.440577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25524d-1115-4951-a08d-ff0a6dcb71fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:47.441222 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25524d-1115-4951-a08d-ff0a6dcb71fe None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:47.442363 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25524d-1115-4951-a08d-ff0a6dcb71fe None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:47.442363 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25524d-1115-4951-a08d-ff0a6dcb71fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:47.481211 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e385d-d291-4eb3-8a1c-e7a547a34957 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:47.492361 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:47.541771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25524d-1115-4951-a08d-ff0a6dcb71fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:47.544349 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25524d-1115-4951-a08d-ff0a6dcb71fe None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:47.549787 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae084999-41b0-4498-9fd8-cc3728efd571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:47.550676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae084999-41b0-4498-9fd8-cc3728efd571 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:47.551950 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae084999-41b0-4498-9fd8-cc3728efd571 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:47.552431 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae084999-41b0-4498-9fd8-cc3728efd571 None admin] PATH_INFO: `/v3/groups/321ee9d5e67b491bb873ed4bce14a39e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:47.556753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae084999-41b0-4498-9fd8-cc3728efd571 None admin] RBAC: Authorizing `identity:get_group(group_id=321ee9d5e67b491bb873ed4bce14a39e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:47.558482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae084999-41b0-4498-9fd8-cc3728efd571 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:47.562243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 207/426] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 9 02:17:47 2022] GET /identity/v3/groups/321ee9d5e67b491bb873ed4bce14a39e => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:47.570811 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae084999-41b0-4498-9fd8-cc3728efd571 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:47.593409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:47.680263 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae084999-41b0-4498-9fd8-cc3728efd571 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:47.716291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f6d7a-8ca4-43a6-8b7a-191695fc1836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:47.717056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f6d7a-8ca4-43a6-8b7a-191695fc1836 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:47.717443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f6d7a-8ca4-43a6-8b7a-191695fc1836 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:47.717816 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f6d7a-8ca4-43a6-8b7a-191695fc1836 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:47.718641 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f6d7a-8ca4-43a6-8b7a-191695fc1836 None admin] RBAC: Adding query filter params (group.id=321ee9d5e67b491bb873ed4bce14a39e, role.id=a463f0ebb5cf4516b0bec345d25071cb, scope.project.id=01c75d368d814248b8ba862ee53b50dc) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:47.719086 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f6d7a-8ca4-43a6-8b7a-191695fc1836 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:47.720665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f6d7a-8ca4-43a6-8b7a-191695fc1836 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:47.727741 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 208/427] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 9 02:17:47 2022] GET /identity/v3/role_assignments?group.id=321ee9d5e67b491bb873ed4bce14a39e&scope.project.id=01c75d368d814248b8ba862ee53b50dc&role.id=a463f0ebb5cf4516b0bec345d25071cb => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:47.732720 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 220/428] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:47.750616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f6d7a-8ca4-43a6-8b7a-191695fc1836 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:47.798062 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:47.870504 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f6d7a-8ca4-43a6-8b7a-191695fc1836 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:47.912526 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204b98e-e499-42ac-a5d7-2fda91d4b955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:47.913197 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204b98e-e499-42ac-a5d7-2fda91d4b955 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:47.913481 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204b98e-e499-42ac-a5d7-2fda91d4b955 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:47.913760 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204b98e-e499-42ac-a5d7-2fda91d4b955 None admin] PATH_INFO: `/v3/projects/01c75d368d814248b8ba862ee53b50dc` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:47.915672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204b98e-e499-42ac-a5d7-2fda91d4b955 None admin] RBAC: Authorizing `identity:get_project(project_id=01c75d368d814248b8ba862ee53b50dc)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:47.917210 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204b98e-e499-42ac-a5d7-2fda91d4b955 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:47.919202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 209/429] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:47 2022] GET /identity/v3/projects/01c75d368d814248b8ba862ee53b50dc => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:47.924757 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25524d-1115-4951-a08d-ff0a6dcb71fe None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:48.031412 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25524d-1115-4951-a08d-ff0a6dcb71fe None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:48.051408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:48.078340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e25ce-1c60-4305-a1fb-ce65792549af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:48.079003 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e25ce-1c60-4305-a1fb-ce65792549af None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:48.079292 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e25ce-1c60-4305-a1fb-ce65792549af None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:48.079569 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e25ce-1c60-4305-a1fb-ce65792549af None admin] PATH_INFO: `/v3/groups/321ee9d5e67b491bb873ed4bce14a39e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:48.081760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e25ce-1c60-4305-a1fb-ce65792549af None admin] RBAC: Authorizing `identity:get_group(group_id=321ee9d5e67b491bb873ed4bce14a39e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:48.083847 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e25ce-1c60-4305-a1fb-ce65792549af None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:48.085518 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 221/430] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 9 02:17:47 2022] GET /identity/v3/groups/321ee9d5e67b491bb873ed4bce14a39e => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:48.091428 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204b98e-e499-42ac-a5d7-2fda91d4b955 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:48.097645 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ddf1b-090e-40ae-a099-ab4b253cf4b4 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:48.097645 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ddf1b-090e-40ae-a099-ab4b253cf4b4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:48.097971 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ddf1b-090e-40ae-a099-ab4b253cf4b4 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:48.099510 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 222/431] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:48.104442 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e723c1d-80fa-47fc-bd2a-b9cadd2f7f6c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:48.104720 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e723c1d-80fa-47fc-bd2a-b9cadd2f7f6c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:48.104989 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e723c1d-80fa-47fc-bd2a-b9cadd2f7f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:48.126642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5e723c1d-80fa-47fc-bd2a-b9cadd2f7f6c None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:48.127861 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5e723c1d-80fa-47fc-bd2a-b9cadd2f7f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:48.214000 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 223/432] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 02:17:48.230802 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204b98e-e499-42ac-a5d7-2fda91d4b955 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:48.237128 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e723c1d-80fa-47fc-bd2a-b9cadd2f7f6c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:48.238000 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:48.275355 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e9e1e-c93f-496b-9ff7-e05e97b089b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:48.275976 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e9e1e-c93f-496b-9ff7-e05e97b089b8 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:48.276262 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e9e1e-c93f-496b-9ff7-e05e97b089b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:48.276539 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e9e1e-c93f-496b-9ff7-e05e97b089b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:48.277558 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e9e1e-c93f-496b-9ff7-e05e97b089b8 None admin] RBAC: Adding query filter params (group.id=321ee9d5e67b491bb873ed4bce14a39e, role.id=680e2c06ab714158b756dc317a3f4e2e, scope.project.id=01c75d368d814248b8ba862ee53b50dc) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:48.277878 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e9e1e-c93f-496b-9ff7-e05e97b089b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:48.279323 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e9e1e-c93f-496b-9ff7-e05e97b089b8 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:48.289131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 210/433] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 9 02:17:48 2022] GET /identity/v3/role_assignments?group.id=321ee9d5e67b491bb873ed4bce14a39e&scope.project.id=01c75d368d814248b8ba862ee53b50dc&role.id=680e2c06ab714158b756dc317a3f4e2e => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:48.370693 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e723c1d-80fa-47fc-bd2a-b9cadd2f7f6c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:48.387734 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:48.410458 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbcaf1-7de7-4f9b-88a7-976c76b3e887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:48.411259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbcaf1-7de7-4f9b-88a7-976c76b3e887 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:48.411609 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbcaf1-7de7-4f9b-88a7-976c76b3e887 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:48.411956 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbcaf1-7de7-4f9b-88a7-976c76b3e887 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:48.424188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbcaf1-7de7-4f9b-88a7-976c76b3e887 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:48.429897 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-d7fbcaf1-7de7-4f9b-88a7-976c76b3e887 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:48.429897 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:48.429897 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:48.429897 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:48.429897 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:48.429897 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:48.429897 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:48.429897 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:48.429897 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:48.429897 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:48.429897 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:48.429897 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:48.429897 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:48.429897 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:48.429897 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:48.429897 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:48.431095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:48.431095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:48.431095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:48.431095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:48.431095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:48.431095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:48.431095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:48.431095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:48.431095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:48.431095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:48.431095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:48.431095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:48.431095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:48.431095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:48.431095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:48.431095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:48.432077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:48.432077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:48.432077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:48.432077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:48.432077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:48.432077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:48.432077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:48.432077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:48.432077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:48.432077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:48.432077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 02:17:48.432077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:48.434206 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 224/434] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:48.438884 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e9e1e-c93f-496b-9ff7-e05e97b089b8 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:48.544813 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2f320-f788-4365-b4fe-826c83a710a1 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:48.544813 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2f320-f788-4365-b4fe-826c83a710a1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:48.544813 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2f320-f788-4365-b4fe-826c83a710a1 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:48.544813 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 225/435] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:48.550505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12707407-a8fe-4e54-9cab-e5c2dfaa54ab None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:48.551047 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12707407-a8fe-4e54-9cab-e5c2dfaa54ab None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:48.552094 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12707407-a8fe-4e54-9cab-e5c2dfaa54ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:48.574047 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-12707407-a8fe-4e54-9cab-e5c2dfaa54ab None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:48.575567 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-12707407-a8fe-4e54-9cab-e5c2dfaa54ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:48.579111 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e9e1e-c93f-496b-9ff7-e05e97b089b8 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:48.629203 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb3baf-41f9-4ae1-8bac-006590ed55bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:48.630225 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb3baf-41f9-4ae1-8bac-006590ed55bc None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:48.630708 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb3baf-41f9-4ae1-8bac-006590ed55bc None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:48.631180 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb3baf-41f9-4ae1-8bac-006590ed55bc None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:48.632073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb3baf-41f9-4ae1-8bac-006590ed55bc None admin] RBAC: Adding query filter params (name=member) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:48.632575 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb3baf-41f9-4ae1-8bac-006590ed55bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:48.634199 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb3baf-41f9-4ae1-8bac-006590ed55bc None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:48.643656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 211/436] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:17:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:48.649148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb3baf-41f9-4ae1-8bac-006590ed55bc None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:48.662402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 226/437] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 02:17:48.685837 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12707407-a8fe-4e54-9cab-e5c2dfaa54ab None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:48.691546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:48.781616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb3baf-41f9-4ae1-8bac-006590ed55bc None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:48.822330 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12707407-a8fe-4e54-9cab-e5c2dfaa54ab None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:48.825784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:48.833549 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f26857-08c8-4280-be83-006c22e8205e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:48.834370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f26857-08c8-4280-be83-006c22e8205e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:48.834637 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f26857-08c8-4280-be83-006c22e8205e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:48.834905 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f26857-08c8-4280-be83-006c22e8205e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:48.866602 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7dcf4-b10a-41ff-8afe-acec17c37c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:48.868352 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7dcf4-b10a-41ff-8afe-acec17c37c1a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:48.868812 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7dcf4-b10a-41ff-8afe-acec17c37c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:48.869287 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7dcf4-b10a-41ff-8afe-acec17c37c1a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:48.882033 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7dcf4-b10a-41ff-8afe-acec17c37c1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:48.886717 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-90a7dcf4-b10a-41ff-8afe-acec17c37c1a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 02:17:48.886717 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:48.886717 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:48.886717 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:48.886717 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:48.886717 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:48.886717 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:48.886717 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:48.886717 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:48.886717 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:48.886717 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:48.886717 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:48.886717 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:48.886717 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:48.886717 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:48.886717 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:48.887588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:48.887588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:48.887588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:48.887588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:48.887588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:48.887588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:48.887588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:48.887588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:48.887588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:48.887588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:48.887588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:48.887588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:48.887588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:48.887588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:48.887588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:48.887588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:48.888380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:48.888380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:48.888380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:48.888380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:48.888380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:48.888380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:48.888380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:48.888380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:48.888380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:48.888380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:48.888380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 02:17:48.888380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:48.888380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 227/438] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 9 02:17:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:17:48.893576 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7dcf4-b10a-41ff-8afe-acec17c37c1a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:48.911525 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f26857-08c8-4280-be83-006c22e8205e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:48.912978 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f26857-08c8-4280-be83-006c22e8205e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:48.945994 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:49.002086 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7dcf4-b10a-41ff-8afe-acec17c37c1a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:49.028370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 212/439] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 02:17:49.029649 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab59c21-f354-43da-9681-37d96e33c47e None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:49.029934 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab59c21-f354-43da-9681-37d96e33c47e None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:49.030205 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab59c21-f354-43da-9681-37d96e33c47e None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:49.031422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 213/440] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:49.034917 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab59c21-f354-43da-9681-37d96e33c47e None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:49.041149 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3496e76-b244-473d-9b4d-1d8973bc15f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:49.041759 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3496e76-b244-473d-9b4d-1d8973bc15f7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:49.042032 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3496e76-b244-473d-9b4d-1d8973bc15f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:49.042298 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3496e76-b244-473d-9b4d-1d8973bc15f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:49.043018 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3496e76-b244-473d-9b4d-1d8973bc15f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:49.043324 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3496e76-b244-473d-9b4d-1d8973bc15f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:49.044688 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3496e76-b244-473d-9b4d-1d8973bc15f7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:49.052907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 228/441] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:17:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:49.054131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412a037-8475-4923-bc63-e8b336f2eada None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:49.054414 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412a037-8475-4923-bc63-e8b336f2eada None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:49.054683 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412a037-8475-4923-bc63-e8b336f2eada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:49.071441 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d412a037-8475-4923-bc63-e8b336f2eada None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:49.072693 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d412a037-8475-4923-bc63-e8b336f2eada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:49.092389 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:49.141437 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab59c21-f354-43da-9681-37d96e33c47e None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:49.144287 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 229/442] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:49.145657 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412a037-8475-4923-bc63-e8b336f2eada None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:49.177897 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:49.183033 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557489b-de5e-4e83-85e9-857c73d25c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:49.183664 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557489b-de5e-4e83-85e9-857c73d25c37 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:49.183944 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557489b-de5e-4e83-85e9-857c73d25c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:49.184215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557489b-de5e-4e83-85e9-857c73d25c37 None admin] PATH_INFO: `/v3/projects/fcf93baab2904060974567318edbdc0b` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:49.185430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557489b-de5e-4e83-85e9-857c73d25c37 None admin] RBAC: Authorizing `identity:get_project(project_id=fcf93baab2904060974567318edbdc0b)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:49.186862 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557489b-de5e-4e83-85e9-857c73d25c37 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:49.188478 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 214/443] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:49 2022] GET /identity/v3/projects/fcf93baab2904060974567318edbdc0b => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:49.189257 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557489b-de5e-4e83-85e9-857c73d25c37 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:49.243419 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412a037-8475-4923-bc63-e8b336f2eada None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:49.277539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817a837-c917-4386-8866-e5de50b13fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:49.278143 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817a837-c917-4386-8866-e5de50b13fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:49.278418 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817a837-c917-4386-8866-e5de50b13fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:49.278689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817a837-c917-4386-8866-e5de50b13fd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:49.286822 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557489b-de5e-4e83-85e9-857c73d25c37 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:49.303786 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:49.319687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274eec99-54dd-4b09-8833-e49c0bb77f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:49.320309 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274eec99-54dd-4b09-8833-e49c0bb77f35 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:49.320671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274eec99-54dd-4b09-8833-e49c0bb77f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:49.320900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274eec99-54dd-4b09-8833-e49c0bb77f35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:49.330797 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274eec99-54dd-4b09-8833-e49c0bb77f35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:49.335495 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-274eec99-54dd-4b09-8833-e49c0bb77f35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:17:49.335495 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:49.335495 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:49.335495 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:49.335495 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:49.335495 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:49.335495 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:49.335495 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:49.335495 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:49.335495 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:49.335495 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:49.335495 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:49.335495 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:49.335495 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:49.335495 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:49.335495 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:49.336443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:49.336443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:49.336443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:49.336443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:49.336443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:49.336443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:49.336443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:49.336443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:49.336443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:49.336443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:49.336443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:49.336443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:49.336443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:49.336443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:49.336443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:49.336443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:49.337269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:49.337269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:49.337269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:49.337269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:49.337269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:49.337269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:49.337269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:49.337269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:49.337269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:49.337269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:49.337269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:17:49.337269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:49.337269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 215/444] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:17:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:49.337909 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274eec99-54dd-4b09-8833-e49c0bb77f35 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:49.351600 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817a837-c917-4386-8866-e5de50b13fd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:49.353110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817a837-c917-4386-8866-e5de50b13fd2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:49.394874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:49.436177 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274eec99-54dd-4b09-8833-e49c0bb77f35 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:49.457249 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 230/445] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:49.458021 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817a837-c917-4386-8866-e5de50b13fd2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:49.478293 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784ce1e-3ecc-421a-a090-2bba88fcc271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:49.478918 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784ce1e-3ecc-421a-a090-2bba88fcc271 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:49.479199 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784ce1e-3ecc-421a-a090-2bba88fcc271 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:49.479472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784ce1e-3ecc-421a-a090-2bba88fcc271 None admin] PATH_INFO: `/v3/groups/321ee9d5e67b491bb873ed4bce14a39e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:49.480591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b784ce1e-3ecc-421a-a090-2bba88fcc271 None admin] RBAC: Authorizing `identity:get_group(group_id=321ee9d5e67b491bb873ed4bce14a39e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:49.482070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b784ce1e-3ecc-421a-a090-2bba88fcc271 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:49.483641 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 216/446] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 9 02:17:49 2022] GET /identity/v3/groups/321ee9d5e67b491bb873ed4bce14a39e => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:49.484395 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784ce1e-3ecc-421a-a090-2bba88fcc271 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:49.516510 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:49.560505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817a837-c917-4386-8866-e5de50b13fd2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:49.581986 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784ce1e-3ecc-421a-a090-2bba88fcc271 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:49.593323 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c6723-5d53-4c87-9048-9c7e92f456e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:49.593920 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c6723-5d53-4c87-9048-9c7e92f456e4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:49.594196 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c6723-5d53-4c87-9048-9c7e92f456e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:49.594465 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c6723-5d53-4c87-9048-9c7e92f456e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:49.595119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c6723-5d53-4c87-9048-9c7e92f456e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:49.595446 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c6723-5d53-4c87-9048-9c7e92f456e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:49.596890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c6723-5d53-4c87-9048-9c7e92f456e4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:49.605536 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 231/447] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:49.606308 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c6723-5d53-4c87-9048-9c7e92f456e4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:49.613312 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:49.621999 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df83336-cbbc-4c29-bca5-c42d2d8ce084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:49.622626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df83336-cbbc-4c29-bca5-c42d2d8ce084 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:49.622907 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df83336-cbbc-4c29-bca5-c42d2d8ce084 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:49.623180 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df83336-cbbc-4c29-bca5-c42d2d8ce084 None admin] PATH_INFO: `/v3/projects/fcf93baab2904060974567318edbdc0b` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:49.624310 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df83336-cbbc-4c29-bca5-c42d2d8ce084 None admin] RBAC: Authorizing `identity:get_project(project_id=fcf93baab2904060974567318edbdc0b)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:49.625779 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df83336-cbbc-4c29-bca5-c42d2d8ce084 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:49.627401 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 217/448] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:49 2022] GET /identity/v3/projects/fcf93baab2904060974567318edbdc0b => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:49.628152 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df83336-cbbc-4c29-bca5-c42d2d8ce084 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:49.708010 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c6723-5d53-4c87-9048-9c7e92f456e4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:49.724425 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df83336-cbbc-4c29-bca5-c42d2d8ce084 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:49.724742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:49.741839 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe9b7c-6589-45e0-b48e-7913639adf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:49.742711 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe9b7c-6589-45e0-b48e-7913639adf3a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:49.742990 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe9b7c-6589-45e0-b48e-7913639adf3a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:49.743265 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe9b7c-6589-45e0-b48e-7913639adf3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:49.743989 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe9b7c-6589-45e0-b48e-7913639adf3a None admin] RBAC: Adding query filter params (group.id=321ee9d5e67b491bb873ed4bce14a39e, role.id=a463f0ebb5cf4516b0bec345d25071cb, scope.project.id=fcf93baab2904060974567318edbdc0b) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:49.744298 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe9b7c-6589-45e0-b48e-7913639adf3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:49.745763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe9b7c-6589-45e0-b48e-7913639adf3a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:49.751471 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 232/449] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 9 02:17:49 2022] GET /identity/v3/role_assignments?group.id=321ee9d5e67b491bb873ed4bce14a39e&scope.project.id=fcf93baab2904060974567318edbdc0b&role.id=a463f0ebb5cf4516b0bec345d25071cb => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:49.752247 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe9b7c-6589-45e0-b48e-7913639adf3a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:49.760242 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9fc145-5465-400a-bd69-394060e9335d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:49.761283 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fc145-5465-400a-bd69-394060e9335d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:49.761725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fc145-5465-400a-bd69-394060e9335d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:49.762006 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fc145-5465-400a-bd69-394060e9335d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:49.838278 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:49.847726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9fc145-5465-400a-bd69-394060e9335d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:49.849840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9fc145-5465-400a-bd69-394060e9335d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:49.867957 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe9b7c-6589-45e0-b48e-7913639adf3a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:49.904020 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b895b6-5707-47b0-a855-f03fa4fcbabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:49.904666 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b895b6-5707-47b0-a855-f03fa4fcbabd None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:49.904946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b895b6-5707-47b0-a855-f03fa4fcbabd None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:49.905277 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b895b6-5707-47b0-a855-f03fa4fcbabd None admin] PATH_INFO: `/v3/groups/321ee9d5e67b491bb873ed4bce14a39e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:49.906859 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b895b6-5707-47b0-a855-f03fa4fcbabd None admin] RBAC: Authorizing `identity:get_group(group_id=321ee9d5e67b491bb873ed4bce14a39e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:49.908309 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b895b6-5707-47b0-a855-f03fa4fcbabd None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:49.909905 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 233/450] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 9 02:17:49 2022] GET /identity/v3/groups/321ee9d5e67b491bb873ed4bce14a39e => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:49.916608 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b895b6-5707-47b0-a855-f03fa4fcbabd None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:49.966478 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 218/451] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:49.973907 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9fc145-5465-400a-bd69-394060e9335d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:49.981006 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:50.042531 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b895b6-5707-47b0-a855-f03fa4fcbabd None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:50.081118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd9459-b6ac-49c2-977e-909d089c3b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:50.082171 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd9459-b6ac-49c2-977e-909d089c3b7f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:50.083014 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd9459-b6ac-49c2-977e-909d089c3b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:50.083441 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd9459-b6ac-49c2-977e-909d089c3b7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:50.084180 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd9459-b6ac-49c2-977e-909d089c3b7f None admin] RBAC: Adding query filter params (group.id=321ee9d5e67b491bb873ed4bce14a39e, role.id=680e2c06ab714158b756dc317a3f4e2e, scope.project.id=fcf93baab2904060974567318edbdc0b) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:50.084487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd9459-b6ac-49c2-977e-909d089c3b7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:50.086031 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd9459-b6ac-49c2-977e-909d089c3b7f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:50.089786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:50.094639 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 234/452] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 9 02:17:49 2022] GET /identity/v3/role_assignments?group.id=321ee9d5e67b491bb873ed4bce14a39e&scope.project.id=fcf93baab2904060974567318edbdc0b&role.id=680e2c06ab714158b756dc317a3f4e2e => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:17:50.096955 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9fc145-5465-400a-bd69-394060e9335d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:50.136996 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5676a-6a70-4bfe-8681-e47ca98678e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:50.137650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5676a-6a70-4bfe-8681-e47ca98678e8 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:50.137930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5676a-6a70-4bfe-8681-e47ca98678e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:50.138199 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5676a-6a70-4bfe-8681-e47ca98678e8 None admin] PATH_INFO: `/v3/projects/5637b6dc3c504974958d887ed2c87b3c` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:50.139369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5676a-6a70-4bfe-8681-e47ca98678e8 None admin] RBAC: Authorizing `identity:get_project(project_id=5637b6dc3c504974958d887ed2c87b3c)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:50.140828 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5676a-6a70-4bfe-8681-e47ca98678e8 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:50.142550 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 219/453] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:17:49 2022] GET /identity/v3/projects/5637b6dc3c504974958d887ed2c87b3c => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:50.149102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd9459-b6ac-49c2-977e-909d089c3b7f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:50.253309 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd9459-b6ac-49c2-977e-909d089c3b7f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:50.267730 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:50.289654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c0f23-f0e3-4c50-8009-961bb84ab2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:50.290284 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c0f23-f0e3-4c50-8009-961bb84ab2ca None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:50.290557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c0f23-f0e3-4c50-8009-961bb84ab2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:50.290825 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c0f23-f0e3-4c50-8009-961bb84ab2ca None admin] PATH_INFO: `/v3/groups/d16bf8903420471abe7d32aca3bf6ac9` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:50.291913 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c0f23-f0e3-4c50-8009-961bb84ab2ca None admin] RBAC: Authorizing `identity:get_group(group_id=d16bf8903420471abe7d32aca3bf6ac9)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:50.293377 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c0f23-f0e3-4c50-8009-961bb84ab2ca None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:50.294929 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 235/454] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 9 02:17:50 2022] GET /identity/v3/groups/d16bf8903420471abe7d32aca3bf6ac9 => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:50.300761 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5676a-6a70-4bfe-8681-e47ca98678e8 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:50.399475 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5676a-6a70-4bfe-8681-e47ca98678e8 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:50.437633 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fdae2-6eb1-4225-8fed-f07d354f91ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:50.438226 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fdae2-6eb1-4225-8fed-f07d354f91ae None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:50.438512 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fdae2-6eb1-4225-8fed-f07d354f91ae None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:50.438793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fdae2-6eb1-4225-8fed-f07d354f91ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:50.439502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fdae2-6eb1-4225-8fed-f07d354f91ae None admin] RBAC: Adding query filter params (group.id=d16bf8903420471abe7d32aca3bf6ac9, role.id=e2095c5a29d74c33b9dcb16f8e5343bf, scope.project.id=5637b6dc3c504974958d887ed2c87b3c) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:50.439806 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fdae2-6eb1-4225-8fed-f07d354f91ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:50.441244 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fdae2-6eb1-4225-8fed-f07d354f91ae None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:50.447610 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 220/455] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 9 02:17:50 2022] GET /identity/v3/role_assignments?group.id=d16bf8903420471abe7d32aca3bf6ac9&scope.project.id=5637b6dc3c504974958d887ed2c87b3c&role.id=e2095c5a29d74c33b9dcb16f8e5343bf => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:52.999434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fc5a1-7008-4410-bf48-0ba365983aa3 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:53.000254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fc5a1-7008-4410-bf48-0ba365983aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:53.000675 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fc5a1-7008-4410-bf48-0ba365983aa3 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:53.002185 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 236/456] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:53.007278 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cce636-6e89-444f-bf45-af852643f3ca None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:53.008049 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cce636-6e89-444f-bf45-af852643f3ca None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:53.008544 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cce636-6e89-444f-bf45-af852643f3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:53.037990 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c9cce636-6e89-444f-bf45-af852643f3ca None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:53.039537 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c9cce636-6e89-444f-bf45-af852643f3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:53.071720 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:53.085469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514e177-63f3-4b3a-bc3b-b60eb10b532f None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:53.085748 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514e177-63f3-4b3a-bc3b-b60eb10b532f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:53.086217 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514e177-63f3-4b3a-bc3b-b60eb10b532f None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:53.089088 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 237/457] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:53.093369 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910abef2-03f7-4c51-bcdc-cc2bea3d04ca None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:53.093909 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910abef2-03f7-4c51-bcdc-cc2bea3d04ca None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:53.094380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910abef2-03f7-4c51-bcdc-cc2bea3d04ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:53.129688 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-910abef2-03f7-4c51-bcdc-cc2bea3d04ca None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:53.132275 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-910abef2-03f7-4c51-bcdc-cc2bea3d04ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:53.151045 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 221/458] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:53.175872 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cce636-6e89-444f-bf45-af852643f3ca None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:53.271887 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 238/459] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:53.273349 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cc253-32e7-43b2-a464-5f2a707637e4 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:53.273642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cc253-32e7-43b2-a464-5f2a707637e4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:53.273922 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cc253-32e7-43b2-a464-5f2a707637e4 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:53.281174 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 239/460] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:53.290777 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05aa0c-7d4f-49c6-ac67-4962cf18408b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:53.291244 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05aa0c-7d4f-49c6-ac67-4962cf18408b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:53.291695 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05aa0c-7d4f-49c6-ac67-4962cf18408b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:53.317696 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-fd05aa0c-7d4f-49c6-ac67-4962cf18408b None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:53.319215 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fd05aa0c-7d4f-49c6-ac67-4962cf18408b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:53.324034 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cce636-6e89-444f-bf45-af852643f3ca None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:53.361291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308f47a-1b27-46d2-be24-9350787ce91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:53.362182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308f47a-1b27-46d2-be24-9350787ce91b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:53.362605 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308f47a-1b27-46d2-be24-9350787ce91b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:53.363016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308f47a-1b27-46d2-be24-9350787ce91b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:53.374391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308f47a-1b27-46d2-be24-9350787ce91b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:53.376013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308f47a-1b27-46d2-be24-9350787ce91b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:53.391480 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 240/461] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 02:17:53.391941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-e308f47a-1b27-46d2-be24-9350787ce91b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:17:53.391941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:53.391941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:53.391941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:53.391941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:53.391941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:53.391941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:53.391941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:53.391941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:53.391941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:53.391941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:53.391941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:53.391941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:17:53.391941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:17:53.391941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:17:53.391941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:17:53.393174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:53.393174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:53.393174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:53.393174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:53.393174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:53.393174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:53.393174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:53.393174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:53.393174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:53.393174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:53.393174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:53.393174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:53.393174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:53.393174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:53.393174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:53.393174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:53.393174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:17:53.394466 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:17:53.394466 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:17:53.394466 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:53.394466 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 222/462] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:17:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:17:53.395246 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05aa0c-7d4f-49c6-ac67-4962cf18408b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:53.406045 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308f47a-1b27-46d2-be24-9350787ce91b None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:53.419790 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:53.442891 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:53.501779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05aa0c-7d4f-49c6-ac67-4962cf18408b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:53.519283 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308f47a-1b27-46d2-be24-9350787ce91b None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:53.538181 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcda2e6-28cb-45ff-89a4-3d60f438014d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:53.538983 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcda2e6-28cb-45ff-89a4-3d60f438014d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:53.539488 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcda2e6-28cb-45ff-89a4-3d60f438014d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:53.539965 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcda2e6-28cb-45ff-89a4-3d60f438014d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:53.550733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcda2e6-28cb-45ff-89a4-3d60f438014d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:53.552506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcda2e6-28cb-45ff-89a4-3d60f438014d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:53.558021 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4905a9-00a5-4b50-9cbe-a17bca3472b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:53.558804 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4905a9-00a5-4b50-9cbe-a17bca3472b4 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:53.559227 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4905a9-00a5-4b50-9cbe-a17bca3472b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:53.559668 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4905a9-00a5-4b50-9cbe-a17bca3472b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:53.560592 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4905a9-00a5-4b50-9cbe-a17bca3472b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:53.561061 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4905a9-00a5-4b50-9cbe-a17bca3472b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:53.562656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4905a9-00a5-4b50-9cbe-a17bca3472b4 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:53.568346 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-5fcda2e6-28cb-45ff-89a4-3d60f438014d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:17:53.568346 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:53.568346 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:53.568346 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:53.568346 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:53.568346 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:53.568346 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:53.568346 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:53.568346 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:53.568346 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:53.568346 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:53.568346 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:53.568346 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:17:53.568346 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:17:53.568346 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:17:53.568346 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:17:53.569536 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:53.569536 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:53.569536 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:53.569536 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:53.569536 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:53.569536 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:53.569536 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:53.569536 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:53.569536 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:53.569536 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:53.569536 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:53.569536 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:53.569536 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:53.569536 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:53.569536 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:53.569536 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:53.569536 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:17:53.570571 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:17:53.570571 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:17:53.570571 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:53.576489 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 241/463] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:17:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:53.576489 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcda2e6-28cb-45ff-89a4-3d60f438014d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:53.583928 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 223/464] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:53.585228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4905a9-00a5-4b50-9cbe-a17bca3472b4 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:53.661973 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:53.676555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:53.683808 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcda2e6-28cb-45ff-89a4-3d60f438014d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:53.698541 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4905a9-00a5-4b50-9cbe-a17bca3472b4 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:53.718611 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd7e78-35ee-41a8-a255-05b941c00c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:53.719241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd7e78-35ee-41a8-a255-05b941c00c2a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:53.719521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd7e78-35ee-41a8-a255-05b941c00c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:53.719795 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd7e78-35ee-41a8-a255-05b941c00c2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:53.731580 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd7e78-35ee-41a8-a255-05b941c00c2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:53.733286 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd7e78-35ee-41a8-a255-05b941c00c2a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:53.738630 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471cd37d-4e0a-4f18-8df3-4813cc1db41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:53.739247 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cd37d-4e0a-4f18-8df3-4813cc1db41a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:53.739530 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cd37d-4e0a-4f18-8df3-4813cc1db41a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:53.739804 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cd37d-4e0a-4f18-8df3-4813cc1db41a None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:53.740455 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471cd37d-4e0a-4f18-8df3-4813cc1db41a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:53.740762 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471cd37d-4e0a-4f18-8df3-4813cc1db41a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:53.742422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471cd37d-4e0a-4f18-8df3-4813cc1db41a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:53.749319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-52dd7e78-35ee-41a8-a255-05b941c00c2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:17:53.749319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:53.749319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:53.749319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:53.749319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:53.749319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:53.749319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:53.749319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:53.749319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:53.749319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:53.749319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:53.749319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:53.749319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:17:53.749319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:17:53.749319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:17:53.749319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:17:53.750354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:53.750354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:53.750354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:53.750354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:53.750354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:53.750354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:53.750354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:53.750354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:53.750354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:53.750354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:53.750354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:53.750354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:53.750354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:53.750354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:53.750354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:53.750354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:53.750354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:17:53.751375 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:17:53.751375 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:17:53.751375 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:53.752714 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 242/465] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:17:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:53.753631 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd7e78-35ee-41a8-a255-05b941c00c2a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:53.758607 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 224/466] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:53.758607 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697cde8-6574-4059-b480-b52d561dc58b None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:53.758607 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697cde8-6574-4059-b480-b52d561dc58b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:53.758607 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697cde8-6574-4059-b480-b52d561dc58b None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:53.758607 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 225/467] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:53.759271 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697cde8-6574-4059-b480-b52d561dc58b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:53.868400 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697cde8-6574-4059-b480-b52d561dc58b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:53.869169 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd7e78-35ee-41a8-a255-05b941c00c2a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:53.903059 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:53.905765 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878fc45-9d07-49eb-bf6a-43ba07761257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:53.906394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878fc45-9d07-49eb-bf6a-43ba07761257 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:53.906700 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878fc45-9d07-49eb-bf6a-43ba07761257 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:53.907045 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878fc45-9d07-49eb-bf6a-43ba07761257 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:53.907555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878fc45-9d07-49eb-bf6a-43ba07761257 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:53.908980 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878fc45-9d07-49eb-bf6a-43ba07761257 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:53.909829 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b43ef-52bc-4584-b244-1f9b9a05a37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:53.910457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b43ef-52bc-4584-b244-1f9b9a05a37a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:53.910735 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b43ef-52bc-4584-b244-1f9b9a05a37a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:53.911005 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b43ef-52bc-4584-b244-1f9b9a05a37a None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:53.911647 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b43ef-52bc-4584-b244-1f9b9a05a37a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:53.911952 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b43ef-52bc-4584-b244-1f9b9a05a37a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:53.913341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b43ef-52bc-4584-b244-1f9b9a05a37a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:53.925786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 226/468] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:53.926552 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b43ef-52bc-4584-b244-1f9b9a05a37a None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:53.935344 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 243/469] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 9 02:17:53 2022] POST /identity/v3/users => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:17:53.937375 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db03958-ebdc-42ff-b09b-34398da5f2f6 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:53.938350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db03958-ebdc-42ff-b09b-34398da5f2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:53.938855 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db03958-ebdc-42ff-b09b-34398da5f2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:53.948865 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:53.970983 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2db03958-ebdc-42ff-b09b-34398da5f2f6 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:53.972796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2db03958-ebdc-42ff-b09b-34398da5f2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:54.049178 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b43ef-52bc-4584-b244-1f9b9a05a37a None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:54.073381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 244/470] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:54.076828 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db03958-ebdc-42ff-b09b-34398da5f2f6 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:54.091077 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bdea5-290f-40a5-ae6a-be919d5c45f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:54.092790 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bdea5-290f-40a5-ae6a-be919d5c45f8 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:54.093721 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bdea5-290f-40a5-ae6a-be919d5c45f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:54.094183 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bdea5-290f-40a5-ae6a-be919d5c45f8 None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:54.095375 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282bdea5-290f-40a5-ae6a-be919d5c45f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:54.097905 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282bdea5-290f-40a5-ae6a-be919d5c45f8 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:54.124301 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 227/471] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 9 02:17:53 2022] POST /identity/v3/users => generated 248 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:17:54.125582 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9a5c9-6850-4fbe-ac75-16d69b6c5c1d None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:54.125839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9a5c9-6850-4fbe-ac75-16d69b6c5c1d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:54.126111 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9a5c9-6850-4fbe-ac75-16d69b6c5c1d None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:54.127348 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 228/472] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:54.128078 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9a5c9-6850-4fbe-ac75-16d69b6c5c1d None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:54.187497 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:54.211179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db03958-ebdc-42ff-b09b-34398da5f2f6 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:54.254683 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:54.261887 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd58c07-7941-4a62-a776-5e1b0efd6951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:54.262753 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd58c07-7941-4a62-a776-5e1b0efd6951 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:54.262944 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9a5c9-6850-4fbe-ac75-16d69b6c5c1d None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:54.263072 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd58c07-7941-4a62-a776-5e1b0efd6951 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:54.263298 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd58c07-7941-4a62-a776-5e1b0efd6951 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:54.263958 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd58c07-7941-4a62-a776-5e1b0efd6951 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:54.266697 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd58c07-7941-4a62-a776-5e1b0efd6951 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:54.297191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 245/473] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 9 02:17:54 2022] POST /identity/v3/users => generated 248 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:17:54.298907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbf426-6a07-4dc1-b7e5-fb4b784d0f81 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:54.299252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbf426-6a07-4dc1-b7e5-fb4b784d0f81 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:54.300057 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbf426-6a07-4dc1-b7e5-fb4b784d0f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:54.314094 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f2a72-d8cb-4946-9266-abb75679a88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:54.315158 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f2a72-d8cb-4946-9266-abb75679a88d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:54.315684 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f2a72-d8cb-4946-9266-abb75679a88d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:54.316153 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f2a72-d8cb-4946-9266-abb75679a88d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:54.325504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-dafbf426-6a07-4dc1-b7e5-fb4b784d0f81 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:54.327942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-dafbf426-6a07-4dc1-b7e5-fb4b784d0f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:54.333544 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f2a72-d8cb-4946-9266-abb75679a88d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:54.336353 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f2a72-d8cb-4946-9266-abb75679a88d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:54.357483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-ea9f2a72-d8cb-4946-9266-abb75679a88d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:17:54.357483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:54.357483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:54.357483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:54.357483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:54.357483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:54.357483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:54.357483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:54.357483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:54.357483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:54.357483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:54.357483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:54.357483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:17:54.357483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:17:54.357483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:17:54.357483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:17:54.358626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:54.358626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:54.358626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:54.358626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:54.358626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:54.358626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:54.358626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:54.358626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:54.358626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:54.358626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:54.358626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:54.358626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:54.358626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:54.358626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:54.358626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:54.358626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:54.358626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:17:54.359526 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:17:54.359526 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:17:54.359526 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:54.362388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 229/474] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:17:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:54.369922 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f2a72-d8cb-4946-9266-abb75679a88d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:54.423573 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 246/475] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:54.462670 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbf426-6a07-4dc1-b7e5-fb4b784d0f81 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:54.491599 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:54.496516 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f2a72-d8cb-4946-9266-abb75679a88d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:54.544388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614541b3-bd59-40d8-b83a-e346a8478608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:54.545006 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614541b3-bd59-40d8-b83a-e346a8478608 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:54.545314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614541b3-bd59-40d8-b83a-e346a8478608 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:54.545594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614541b3-bd59-40d8-b83a-e346a8478608 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:54.546256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614541b3-bd59-40d8-b83a-e346a8478608 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:54.546565 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614541b3-bd59-40d8-b83a-e346a8478608 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:54.547959 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614541b3-bd59-40d8-b83a-e346a8478608 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:54.562180 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 230/476] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:54.568406 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614541b3-bd59-40d8-b83a-e346a8478608 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:54.602226 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbf426-6a07-4dc1-b7e5-fb4b784d0f81 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:54.624626 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:54.669779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3c700-dd6b-462c-a450-a1643ff7afbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:54.670707 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3c700-dd6b-462c-a450-a1643ff7afbe None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:54.671195 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3c700-dd6b-462c-a450-a1643ff7afbe None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:54.671661 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3c700-dd6b-462c-a450-a1643ff7afbe None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:54.672542 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3c700-dd6b-462c-a450-a1643ff7afbe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:54.674257 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3c700-dd6b-462c-a450-a1643ff7afbe None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:54.678897 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614541b3-bd59-40d8-b83a-e346a8478608 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:54.693634 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.sql.core [None req-b7d3c700-dd6b-462c-a450-a1643ff7afbe None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 09 02:17:54.693634 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 09 02:17:54.693634 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [parameters: {'id': 'bb49609a3399403c94225630b511fafb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 09 02:17:54.693634 dv-cinder-852461-1-smb devstack@keystone.service[80285]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80285) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 09 02:17:54.717105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a84f67-479e-477d-a136-2aef8daa0357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:54.717714 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a84f67-479e-477d-a136-2aef8daa0357 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:54.717991 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a84f67-479e-477d-a136-2aef8daa0357 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:54.718260 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a84f67-479e-477d-a136-2aef8daa0357 None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:54.718966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a84f67-479e-477d-a136-2aef8daa0357 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:54.719293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-b7d3c700-dd6b-462c-a450-a1643ff7afbe None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 09 02:17:54.719293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:54.719293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 02:17:54.719293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 02:17:54.719293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 02:17:54.719293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 02:17:54.719293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 02:17:54.719293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 02:17:54.719293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 02:17:54.719293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application conn.query(q) Aug 09 02:17:54.719293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 02:17:54.719293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 02:17:54.719293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 02:17:54.719293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application result.read() Aug 09 02:17:54.719293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 02:17:54.720090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 02:17:54.720090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 02:17:54.720090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 02:17:54.720090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 02:17:54.720090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 02:17:54.720090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 02:17:54.720090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 02:17:54.720090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 09 02:17:54.720090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:54.720090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 09 02:17:54.720090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:54.720090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:54.720090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 09 02:17:54.720090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 09 02:17:54.720090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 09 02:17:54.720090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return ref.to_dict() Aug 09 02:17:54.720090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 02:17:54.720090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application next(self.gen) Aug 09 02:17:54.720966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 09 02:17:54.720966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application yield resource Aug 09 02:17:54.720966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 02:17:54.720966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application next(self.gen) Aug 09 02:17:54.720966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 09 02:17:54.720966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.session.rollback() Aug 09 02:17:54.720966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 02:17:54.720966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.force_reraise() Aug 09 02:17:54.720966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 02:17:54.720966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise self.value Aug 09 02:17:54.720966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 09 02:17:54.720966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 09 02:17:54.720966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 09 02:17:54.720966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application session.commit() Aug 09 02:17:54.720966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 09 02:17:54.720966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 09 02:17:54.720966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 09 02:17:54.721884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._prepare_impl() Aug 09 02:17:54.721884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 09 02:17:54.721884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.session.flush() Aug 09 02:17:54.721884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 02:17:54.721884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._flush(objects) Aug 09 02:17:54.721884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 02:17:54.721884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 09 02:17:54.721884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 02:17:54.721884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application compat.raise_( Aug 09 02:17:54.721884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 02:17:54.721884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception Aug 09 02:17:54.721884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 02:17:54.721884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application flush_context.execute() Aug 09 02:17:54.721884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 02:17:54.721884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rec.execute(self) Aug 09 02:17:54.721884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 02:17:54.721884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 09 02:17:54.722797 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 02:17:54.722797 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 09 02:17:54.722797 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 09 02:17:54.722797 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 09 02:17:54.722797 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 02:17:54.722797 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 02:17:54.722797 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 02:17:54.722797 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 09 02:17:54.722797 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 02:17:54.722797 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 09 02:17:54.722797 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 02:17:54.722797 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 09 02:17:54.722797 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 02:17:54.722797 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 02:17:54.722797 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 02:17:54.722797 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception Aug 09 02:17:54.723758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 02:17:54.723758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 02:17:54.723758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 02:17:54.723758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 02:17:54.723758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 02:17:54.723758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 02:17:54.723758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 02:17:54.723758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application conn.query(q) Aug 09 02:17:54.723758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 02:17:54.723758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 02:17:54.723758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 02:17:54.723758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application result.read() Aug 09 02:17:54.723758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 02:17:54.723758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 02:17:54.723758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 02:17:54.723758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 02:17:54.724555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 02:17:54.724555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 02:17:54.724555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 02:17:54.724555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 02:17:54.724555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 09 02:17:54.724555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 09 02:17:54.724555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [parameters: {'id': 'bb49609a3399403c94225630b511fafb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 09 02:17:54.724555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 02:17:54.724555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:54.724555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:17:54.724555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:54.724555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:54.724555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:54.724555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:54.724555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:54.724555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:54.725385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:54.725385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:54.725385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:54.725385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:54.725385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:54.725385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:54.725385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 09 02:17:54.725385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 09 02:17:54.725385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:54.725385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:54.725385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 09 02:17:54.725385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 09 02:17:54.725385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 09 02:17:54.725385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 09 02:17:54.725385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 09 02:17:54.725385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:54.726208 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a84f67-479e-477d-a136-2aef8daa0357 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:54.733429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 247/477] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Aug 9 02:17:54 2022] POST /identity/v3/roles => generated 144 bytes in 268 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:54.741136 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3c700-dd6b-462c-a450-a1643ff7afbe None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:54.757369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 231/478] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 9 02:17:54 2022] POST /identity/v3/users => generated 249 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:17:54.856426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3c700-dd6b-462c-a450-a1643ff7afbe None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:54.901257 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e52055-98e4-4fde-88b0-59a96331eb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:54.902018 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e52055-98e4-4fde-88b0-59a96331eb8c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:54.902296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e52055-98e4-4fde-88b0-59a96331eb8c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:54.902890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e52055-98e4-4fde-88b0-59a96331eb8c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:54.926444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e52055-98e4-4fde-88b0-59a96331eb8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:54.931579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-42e52055-98e4-4fde-88b0-59a96331eb8c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 02:17:54.931579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:54.931579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:54.931579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:54.931579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:54.931579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:54.931579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:54.931579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:54.931579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:54.931579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:54.931579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:54.931579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:54.931579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:54.931579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:54.931579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:54.931579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:54.932487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:54.932487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:54.932487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:54.932487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:54.932487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:54.932487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:54.932487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:54.932487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:54.932487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:54.932487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:54.932487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:54.932487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:54.932487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:54.932487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:54.932487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:54.932487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:54.933865 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:54.933865 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:54.933865 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:54.933865 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:54.933865 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:54.933865 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:54.933865 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:54.933865 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:54.933865 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:54.933865 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:54.933865 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 02:17:54.933865 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:54.933865 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 248/479] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 9 02:17:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:54.939000 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a84f67-479e-477d-a136-2aef8daa0357 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:54.981751 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:55.079522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a84f67-479e-477d-a136-2aef8daa0357 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:55.115144 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7679b-67a5-419d-8799-a3c50ba8d9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:55.116133 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7679b-67a5-419d-8799-a3c50ba8d9e4 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:55.116620 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7679b-67a5-419d-8799-a3c50ba8d9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:55.117375 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7679b-67a5-419d-8799-a3c50ba8d9e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:55.118248 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7679b-67a5-419d-8799-a3c50ba8d9e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:55.118763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7679b-67a5-419d-8799-a3c50ba8d9e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:55.120444 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7679b-67a5-419d-8799-a3c50ba8d9e4 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:55.130095 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 232/480] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:17:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:56.412578 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64726e35-3c68-41fe-9d2b-af640dab9708 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:56.413625 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64726e35-3c68-41fe-9d2b-af640dab9708 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:56.414127 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64726e35-3c68-41fe-9d2b-af640dab9708 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:56.415875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 249/481] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:56.421542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ce336-5114-4784-af03-51eaaddf246b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:56.422338 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ce336-5114-4784-af03-51eaaddf246b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:56.422813 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ce336-5114-4784-af03-51eaaddf246b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:56.442266 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-df7ce336-5114-4784-af03-51eaaddf246b None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:56.443765 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-df7ce336-5114-4784-af03-51eaaddf246b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:56.517853 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 233/482] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 02:17:56.557364 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64726e35-3c68-41fe-9d2b-af640dab9708 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:56.618871 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:56.692085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64726e35-3c68-41fe-9d2b-af640dab9708 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:56.734742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91218da-9110-4e10-b1b7-db13907a40c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:56.735384 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91218da-9110-4e10-b1b7-db13907a40c6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:56.735666 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91218da-9110-4e10-b1b7-db13907a40c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:56.735937 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91218da-9110-4e10-b1b7-db13907a40c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:56.751350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91218da-9110-4e10-b1b7-db13907a40c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:56.757613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-d91218da-9110-4e10-b1b7-db13907a40c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:17:56.757613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:56.757613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:56.757613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:56.757613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:56.757613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:56.757613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:56.757613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:56.757613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:56.757613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:56.757613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:56.757613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:56.757613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:56.757613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:56.757613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:56.757613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:56.758543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:56.758543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:56.758543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:56.758543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:56.758543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:56.758543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:56.758543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:56.758543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:56.758543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:56.758543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:56.758543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:56.758543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:56.758543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:56.758543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:56.758543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:56.758543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:56.759340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:56.759340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:56.759340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:56.759340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:56.759340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:56.759340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:56.759340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:56.759340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:56.759340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:56.759340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:56.759340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:17:56.759340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:56.759340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 250/483] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 9 02:17:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:56.766602 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ce336-5114-4784-af03-51eaaddf246b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:56.777550 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:56.789646 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21195eb-c913-407a-8880-cad5b9be72b0 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:56.790167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21195eb-c913-407a-8880-cad5b9be72b0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:56.790398 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21195eb-c913-407a-8880-cad5b9be72b0 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:56.792569 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 251/484] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:56.797252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c8dd7-33ff-42d8-8ae7-c78620899a54 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:56.797534 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c8dd7-33ff-42d8-8ae7-c78620899a54 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:56.797811 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c8dd7-33ff-42d8-8ae7-c78620899a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:56.817288 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-1d0c8dd7-33ff-42d8-8ae7-c78620899a54 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:56.818512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1d0c8dd7-33ff-42d8-8ae7-c78620899a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:56.919399 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 252/485] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 02:17:56.939317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ce336-5114-4784-af03-51eaaddf246b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:56.952690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c8dd7-33ff-42d8-8ae7-c78620899a54 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:57.017352 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:57.030117 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3cce6-fd50-4bad-ae7c-fb3ede01aaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:57.030732 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3cce6-fd50-4bad-ae7c-fb3ede01aaa6 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:57.031016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3cce6-fd50-4bad-ae7c-fb3ede01aaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:57.031272 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3cce6-fd50-4bad-ae7c-fb3ede01aaa6 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:57.031941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3cce6-fd50-4bad-ae7c-fb3ede01aaa6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:57.032246 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3cce6-fd50-4bad-ae7c-fb3ede01aaa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:57.033638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3cce6-fd50-4bad-ae7c-fb3ede01aaa6 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:57.042524 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 234/486] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 9 02:17:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:57.043793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9c455-2fa6-4057-a4e9-713ea559988c None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:57.044081 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9c455-2fa6-4057-a4e9-713ea559988c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:57.044354 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9c455-2fa6-4057-a4e9-713ea559988c None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:57.045579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 235/487] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:57.049971 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9c455-2fa6-4057-a4e9-713ea559988c None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:57.076744 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c8dd7-33ff-42d8-8ae7-c78620899a54 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:57.123632 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fc63e-7f87-4a43-af7a-6f1688f862ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:57.124498 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fc63e-7f87-4a43-af7a-6f1688f862ec None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:57.124797 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fc63e-7f87-4a43-af7a-6f1688f862ec None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:57.125094 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fc63e-7f87-4a43-af7a-6f1688f862ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:57.126960 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:57.139540 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fc63e-7f87-4a43-af7a-6f1688f862ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:57.145938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-204fc63e-7f87-4a43-af7a-6f1688f862ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:17:57.145938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:57.145938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:57.145938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:57.145938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:57.145938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:57.145938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:57.145938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:57.145938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:57.145938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:57.145938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:57.145938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:57.145938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:57.145938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:57.145938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:57.145938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:57.146829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:57.146829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:57.146829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:57.146829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:57.146829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:57.146829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:57.146829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:57.146829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:57.146829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:57.146829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:57.146829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:57.146829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:57.146829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:57.146829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:57.146829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:57.146829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:57.147608 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:57.147608 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:57.147608 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:57.147608 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:57.147608 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:57.147608 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:57.147608 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:57.147608 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:57.147608 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:57.147608 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:57.147608 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:17:57.147608 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:57.147608 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 253/488] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 9 02:17:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:17:57.153275 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffafa16-2dcc-45c2-bc03-5c227612f373 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:57.153275 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffafa16-2dcc-45c2-bc03-5c227612f373 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:57.153275 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffafa16-2dcc-45c2-bc03-5c227612f373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:57.171818 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9ffafa16-2dcc-45c2-bc03-5c227612f373 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:57.173275 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9ffafa16-2dcc-45c2-bc03-5c227612f373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:57.173745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9c455-2fa6-4057-a4e9-713ea559988c None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:57.210719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a96d84-4112-42ac-992a-54a05df1789d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:57.211710 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a96d84-4112-42ac-992a-54a05df1789d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:57.212164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a96d84-4112-42ac-992a-54a05df1789d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:57.212623 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a96d84-4112-42ac-992a-54a05df1789d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:57.224273 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a96d84-4112-42ac-992a-54a05df1789d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:57.226032 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a96d84-4112-42ac-992a-54a05df1789d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:57.242362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-95a96d84-4112-42ac-992a-54a05df1789d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:17:57.242362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:57.242362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:57.242362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:57.242362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:57.242362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:57.242362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:57.242362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:57.242362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:57.242362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:57.242362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:57.242362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:57.242362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:17:57.242362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:17:57.242362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:17:57.242362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:17:57.243279 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:57.243279 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:57.243279 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:57.243279 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:57.243279 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:57.243279 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:57.243279 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:57.243279 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:57.243279 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:57.243279 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:57.243279 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:57.243279 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:57.243279 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:57.243279 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:57.243279 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:57.243279 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:57.243279 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:17:57.244077 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:17:57.244077 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:17:57.244077 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:57.246416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 236/489] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:17:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:57.247361 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a96d84-4112-42ac-992a-54a05df1789d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:57.265065 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 254/490] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:57.265065 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffafa16-2dcc-45c2-bc03-5c227612f373 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:57.286479 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:57.376764 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a96d84-4112-42ac-992a-54a05df1789d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:57.382204 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffafa16-2dcc-45c2-bc03-5c227612f373 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:57.405407 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:57.420206 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09777b93-b167-4cf9-bb0b-b3fd3bf274ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:57.421446 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09777b93-b167-4cf9-bb0b-b3fd3bf274ea None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:57.421926 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09777b93-b167-4cf9-bb0b-b3fd3bf274ea None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:57.422371 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09777b93-b167-4cf9-bb0b-b3fd3bf274ea None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:57.422822 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2546c-5fb6-46f1-82ad-917519ce38f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:57.423499 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2546c-5fb6-46f1-82ad-917519ce38f3 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:57.423849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2546c-5fb6-46f1-82ad-917519ce38f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:57.424098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09777b93-b167-4cf9-bb0b-b3fd3bf274ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:57.424195 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2546c-5fb6-46f1-82ad-917519ce38f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:57.424658 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09777b93-b167-4cf9-bb0b-b3fd3bf274ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:57.424995 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2546c-5fb6-46f1-82ad-917519ce38f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:57.425395 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2546c-5fb6-46f1-82ad-917519ce38f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:57.427164 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09777b93-b167-4cf9-bb0b-b3fd3bf274ea None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:57.427490 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2546c-5fb6-46f1-82ad-917519ce38f3 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:57.436659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 237/491] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 9 02:17:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:57.437743 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2546c-5fb6-46f1-82ad-917519ce38f3 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:57.455522 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 255/492] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:57.456618 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09777b93-b167-4cf9-bb0b-b3fd3bf274ea None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:57.546111 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:57.557244 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2546c-5fb6-46f1-82ad-917519ce38f3 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:57.567061 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09777b93-b167-4cf9-bb0b-b3fd3bf274ea None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:57.591726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15a61e-d634-43a8-b38a-f506c0c1d0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:57.592364 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15a61e-d634-43a8-b38a-f506c0c1d0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:57.592645 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15a61e-d634-43a8-b38a-f506c0c1d0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:57.592919 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15a61e-d634-43a8-b38a-f506c0c1d0e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:57.604632 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbaf416-6168-4721-a61a-668a3e395ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:57.604903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15a61e-d634-43a8-b38a-f506c0c1d0e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:57.605287 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaf416-6168-4721-a61a-668a3e395ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:57.605567 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaf416-6168-4721-a61a-668a3e395ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:57.605837 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaf416-6168-4721-a61a-668a3e395ef5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:57.610070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-ec15a61e-d634-43a8-b38a-f506c0c1d0e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:17:57.610070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:57.610070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:57.610070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:57.610070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:57.610070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:57.610070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:57.610070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:57.610070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:57.610070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:57.610070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:57.610070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:57.610070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:57.610070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:57.610070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:57.610070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:57.610900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:57.610900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:57.610900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:57.610900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:57.610900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:57.610900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:57.610900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:57.610900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:57.610900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:57.610900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:57.610900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:57.610900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:57.610900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:57.610900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:57.610900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:57.610900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:57.617565 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:57.617565 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:57.617565 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:57.617565 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:57.617565 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:57.617565 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:57.617565 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:57.617565 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:57.617565 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:57.617565 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:57.617565 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:17:57.617565 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:57.617565 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 238/493] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 9 02:17:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:57.617565 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15a61e-d634-43a8-b38a-f506c0c1d0e0 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:57.622711 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbaf416-6168-4721-a61a-668a3e395ef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:57.624289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbaf416-6168-4721-a61a-668a3e395ef5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:57.639952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-acbaf416-6168-4721-a61a-668a3e395ef5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:17:57.639952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:57.639952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:57.639952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:57.639952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:57.639952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:57.639952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:57.639952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:57.639952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:57.639952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:57.639952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:57.639952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:57.639952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:17:57.639952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:17:57.639952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:17:57.639952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:17:57.640817 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:57.640817 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:57.640817 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:57.640817 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:57.640817 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:57.640817 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:57.640817 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:57.640817 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:57.640817 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:57.640817 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:57.640817 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:57.640817 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:57.640817 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:57.640817 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:57.640817 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:57.640817 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:57.640817 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:17:57.641706 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:17:57.641706 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:17:57.641706 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:57.641706 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 256/494] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:17:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:57.642328 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8507f60-00ea-4919-b19a-ddbbf48aedb3 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:57.642602 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8507f60-00ea-4919-b19a-ddbbf48aedb3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:57.642875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8507f60-00ea-4919-b19a-ddbbf48aedb3 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:57.647976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 257/495] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:57.647976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8507f60-00ea-4919-b19a-ddbbf48aedb3 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:57.664602 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:57.725986 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15a61e-d634-43a8-b38a-f506c0c1d0e0 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:57.757292 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8507f60-00ea-4919-b19a-ddbbf48aedb3 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:57.759484 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca325a-2927-4f72-9379-b35a0fdfa6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:57.760112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca325a-2927-4f72-9379-b35a0fdfa6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:57.760388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca325a-2927-4f72-9379-b35a0fdfa6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:57.760658 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca325a-2927-4f72-9379-b35a0fdfa6b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:57.767894 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca325a-2927-4f72-9379-b35a0fdfa6b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:57.769373 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca325a-2927-4f72-9379-b35a0fdfa6b1 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:57.781391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-18ca325a-2927-4f72-9379-b35a0fdfa6b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 02:17:57.781391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:57.781391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:57.781391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:57.781391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:57.781391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:57.781391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:57.781391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:57.781391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:57.781391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:57.781391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:57.781391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:57.781391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:17:57.781391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:17:57.781391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:17:57.781391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:17:57.782313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:57.782313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:57.782313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:17:57.782313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:17:57.782313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:17:57.782313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:17:57.782313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:57.782313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:57.782313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:57.782313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:57.782313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:57.782313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:57.782313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:57.782313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:57.782313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:57.782313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:57.782313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:57.782313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:57.788489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:57.788489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:57.788489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:17:57.788489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:17:57.788489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:17:57.788489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:17:57.788489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:17:57.788489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:17:57.788489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 02:17:57.788489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:57.788489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 239/496] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 9 02:17:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:57.788489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca325a-2927-4f72-9379-b35a0fdfa6b1 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:57.790688 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75ac1a-0602-46d0-82e5-cb00829d7e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:57.791299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75ac1a-0602-46d0-82e5-cb00829d7e75 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:57.791573 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75ac1a-0602-46d0-82e5-cb00829d7e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:57.791845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75ac1a-0602-46d0-82e5-cb00829d7e75 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:57.792541 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75ac1a-0602-46d0-82e5-cb00829d7e75 None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:57.792842 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75ac1a-0602-46d0-82e5-cb00829d7e75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:57.794293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75ac1a-0602-46d0-82e5-cb00829d7e75 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:57.795665 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:57.803743 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 258/497] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 9 02:17:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:57.804683 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b31e0-e76d-4f81-9a02-43368f89b69f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:57.804963 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b31e0-e76d-4f81-9a02-43368f89b69f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:57.805264 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b31e0-e76d-4f81-9a02-43368f89b69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:57.821935 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9f9b31e0-e76d-4f81-9a02-43368f89b69f None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:57.823118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9f9b31e0-e76d-4f81-9a02-43368f89b69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:57.885428 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca325a-2927-4f72-9379-b35a0fdfa6b1 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:57.886927 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:57.890328 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 259/498] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:57.891610 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e1b9c-2ece-49a0-8b8b-908350c4736b None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:57.891903 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e1b9c-2ece-49a0-8b8b-908350c4736b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:57.892183 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e1b9c-2ece-49a0-8b8b-908350c4736b None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:57.893619 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 260/499] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:17:57.894160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e1b9c-2ece-49a0-8b8b-908350c4736b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:57.929332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05084a01-a5e8-4f72-b4d1-a3c526a95bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:57.929938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05084a01-a5e8-4f72-b4d1-a3c526a95bda None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:57.930215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05084a01-a5e8-4f72-b4d1-a3c526a95bda None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:57.930493 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05084a01-a5e8-4f72-b4d1-a3c526a95bda None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:57.931140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05084a01-a5e8-4f72-b4d1-a3c526a95bda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:57.931446 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05084a01-a5e8-4f72-b4d1-a3c526a95bda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:57.932821 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05084a01-a5e8-4f72-b4d1-a3c526a95bda None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:57.944259 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 240/500] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:57.945059 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05084a01-a5e8-4f72-b4d1-a3c526a95bda None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:58.011436 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e1b9c-2ece-49a0-8b8b-908350c4736b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:58.038501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:58.044440 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05084a01-a5e8-4f72-b4d1-a3c526a95bda None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:58.047709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f3419-b5c1-4f98-9239-99ca268573f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:58.048313 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f3419-b5c1-4f98-9239-99ca268573f5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:58.048589 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f3419-b5c1-4f98-9239-99ca268573f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:58.048855 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f3419-b5c1-4f98-9239-99ca268573f5 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:58.049615 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f3419-b5c1-4f98-9239-99ca268573f5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:58.049922 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f3419-b5c1-4f98-9239-99ca268573f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:58.051403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f3419-b5c1-4f98-9239-99ca268573f5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:58.077945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72032d12-f2aa-4ec7-b0bd-3c02a4a3fe0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:58.078506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72032d12-f2aa-4ec7-b0bd-3c02a4a3fe0c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:58.078784 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72032d12-f2aa-4ec7-b0bd-3c02a4a3fe0c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:58.079052 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72032d12-f2aa-4ec7-b0bd-3c02a4a3fe0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:58.086973 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 261/501] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 9 02:17:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:58.088242 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff0772-dd53-408c-a340-700f02548b58 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:58.088534 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff0772-dd53-408c-a340-700f02548b58 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:58.088806 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff0772-dd53-408c-a340-700f02548b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:58.093787 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72032d12-f2aa-4ec7-b0bd-3c02a4a3fe0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:58.095232 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72032d12-f2aa-4ec7-b0bd-3c02a4a3fe0c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:58.106542 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ffff0772-dd53-408c-a340-700f02548b58 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:17:58.107737 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ffff0772-dd53-408c-a340-700f02548b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:17:58.110148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-72032d12-f2aa-4ec7-b0bd-3c02a4a3fe0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:17:58.110148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:58.110148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:58.110148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:58.110148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:58.110148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:58.110148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:58.110148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:58.110148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:58.110148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:58.110148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:58.110148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:58.110148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:17:58.110148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:17:58.110148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:17:58.110148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:17:58.111016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:58.111016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:58.111016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:58.111016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:58.111016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:58.111016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:58.111016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:58.111016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:58.111016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:58.111016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:58.111016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:58.111016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:58.111016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:58.111016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:58.111016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:58.111016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:58.111016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:17:58.111903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:17:58.111903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:17:58.111903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:58.111903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 241/502] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:17:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:58.112127 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72032d12-f2aa-4ec7-b0bd-3c02a4a3fe0c None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:58.130403 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:58.176148 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 262/503] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:17:58.176977 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff0772-dd53-408c-a340-700f02548b58 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:58.230688 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72032d12-f2aa-4ec7-b0bd-3c02a4a3fe0c None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:58.264191 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0fbe0-d1e3-422c-ba63-449ed0a6af9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:58.264815 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0fbe0-d1e3-422c-ba63-449ed0a6af9f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:58.265127 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0fbe0-d1e3-422c-ba63-449ed0a6af9f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:58.265408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0fbe0-d1e3-422c-ba63-449ed0a6af9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:58.275991 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0fbe0-d1e3-422c-ba63-449ed0a6af9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:17:58.276859 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff0772-dd53-408c-a340-700f02548b58 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:58.281070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-c8b0fbe0-d1e3-422c-ba63-449ed0a6af9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:17:58.281070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:58.281070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:58.281070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:58.281070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:58.281070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:58.281070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:58.281070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:58.281070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:58.281070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:58.281070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:58.281070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:58.281070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:17:58.281070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:17:58.281070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:17:58.281070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:17:58.282154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:17:58.282154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:17:58.282154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:17:58.282154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:17:58.282154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:58.282154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:58.282154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:58.282154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:58.282154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:58.282154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:58.282154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:58.282154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:58.282154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:58.282154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:58.282154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:58.282154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:58.282945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:58.282945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:58.282945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:58.282945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:58.282945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:17:58.282945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:17:58.282945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:17:58.282945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:17:58.282945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:17:58.282945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:17:58.282945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:17:58.282945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:58.282945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 242/504] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 9 02:17:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:58.283591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0fbe0-d1e3-422c-ba63-449ed0a6af9f None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:58.290603 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:58.310788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca985d-012d-4a24-bec3-0cbc1e27962b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:58.311419 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca985d-012d-4a24-bec3-0cbc1e27962b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:58.311703 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca985d-012d-4a24-bec3-0cbc1e27962b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:58.311982 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca985d-012d-4a24-bec3-0cbc1e27962b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:58.319468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca985d-012d-4a24-bec3-0cbc1e27962b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:58.320919 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca985d-012d-4a24-bec3-0cbc1e27962b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:58.334256 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-1cca985d-012d-4a24-bec3-0cbc1e27962b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 02:17:58.334256 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:58.334256 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:58.334256 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:58.334256 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:58.334256 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:58.334256 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:58.334256 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:58.334256 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:58.334256 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:58.334256 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:58.334256 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:58.334256 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:17:58.334256 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:17:58.334256 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:17:58.334256 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:17:58.335321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:58.335321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:58.335321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:17:58.335321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:17:58.335321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:17:58.335321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:17:58.335321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:58.335321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:58.335321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:58.335321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:58.335321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:58.335321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:58.335321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:58.335321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:58.335321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:58.335321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:58.335321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:58.335321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:58.336241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:58.336241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:58.336241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:17:58.336241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:17:58.336241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:17:58.336241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:17:58.336241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:17:58.336241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:17:58.336241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 02:17:58.336241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:58.336241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 263/505] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:58.336241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca985d-012d-4a24-bec3-0cbc1e27962b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:58.363300 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:58.388878 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0fbe0-d1e3-422c-ba63-449ed0a6af9f None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:58.421800 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e642ff1-bfcb-4c4a-9f4a-74c6db814684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:58.422395 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e642ff1-bfcb-4c4a-9f4a-74c6db814684 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:58.422676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e642ff1-bfcb-4c4a-9f4a-74c6db814684 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:58.422946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e642ff1-bfcb-4c4a-9f4a-74c6db814684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:58.434795 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca985d-012d-4a24-bec3-0cbc1e27962b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:58.469427 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ac956-d076-4111-9c35-3a9ff41d57e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:58.470023 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ac956-d076-4111-9c35-3a9ff41d57e2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:58.470309 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ac956-d076-4111-9c35-3a9ff41d57e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:58.470583 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ac956-d076-4111-9c35-3a9ff41d57e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:58.471228 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ac956-d076-4111-9c35-3a9ff41d57e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:58.471537 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ac956-d076-4111-9c35-3a9ff41d57e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:58.472925 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ac956-d076-4111-9c35-3a9ff41d57e2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:58.484328 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 264/506] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:58.485128 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ac956-d076-4111-9c35-3a9ff41d57e2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:58.490168 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e642ff1-bfcb-4c4a-9f4a-74c6db814684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:58.491609 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e642ff1-bfcb-4c4a-9f4a-74c6db814684 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:58.521272 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:58.563377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:58.586603 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ac956-d076-4111-9c35-3a9ff41d57e2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:58.590068 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 243/507] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:58.590884 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e642ff1-bfcb-4c4a-9f4a-74c6db814684 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:58.622906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de8874-5243-490d-af5d-290d9446e7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:58.623779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de8874-5243-490d-af5d-290d9446e7bf None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:58.624058 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de8874-5243-490d-af5d-290d9446e7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:58.624333 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de8874-5243-490d-af5d-290d9446e7bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:58.634757 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de8874-5243-490d-af5d-290d9446e7bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:58.636259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de8874-5243-490d-af5d-290d9446e7bf None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:58.650554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-50de8874-5243-490d-af5d-290d9446e7bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:17:58.650554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:58.650554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:58.650554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:58.650554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:58.650554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:58.650554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:58.650554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:58.650554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:58.650554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:58.650554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:58.650554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:58.650554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:17:58.650554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:17:58.650554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:17:58.650554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:17:58.651409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:58.651409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:58.651409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:58.651409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:58.651409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:58.651409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:58.651409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:58.651409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:58.651409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:58.651409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:58.651409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:58.651409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:58.651409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:58.651409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:58.651409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:58.651409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:58.651409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:17:58.652248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:17:58.652248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:17:58.652248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:58.652248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 265/508] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:17:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:58.652983 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de8874-5243-490d-af5d-290d9446e7bf None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:58.691008 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e642ff1-bfcb-4c4a-9f4a-74c6db814684 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:58.723818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327471b-22cc-4234-b2be-97b2a13038ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:58.724413 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327471b-22cc-4234-b2be-97b2a13038ee None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:58.724697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327471b-22cc-4234-b2be-97b2a13038ee None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:58.724973 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327471b-22cc-4234-b2be-97b2a13038ee None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:58.725665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327471b-22cc-4234-b2be-97b2a13038ee None admin] RBAC: Adding query filter params (name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:58.725975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327471b-22cc-4234-b2be-97b2a13038ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:58.727349 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327471b-22cc-4234-b2be-97b2a13038ee None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:58.735175 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 244/509] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 9 02:17:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:58.735796 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327471b-22cc-4234-b2be-97b2a13038ee None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:58.740191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:58.756755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de8874-5243-490d-af5d-290d9446e7bf None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:58.771617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:58.791736 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdb4b2-9c08-4dce-a088-4ab6b52f5c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:58.792337 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdb4b2-9c08-4dce-a088-4ab6b52f5c01 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:58.792618 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdb4b2-9c08-4dce-a088-4ab6b52f5c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:58.792893 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdb4b2-9c08-4dce-a088-4ab6b52f5c01 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:58.793657 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdb4b2-9c08-4dce-a088-4ab6b52f5c01 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:58.793963 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdb4b2-9c08-4dce-a088-4ab6b52f5c01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:58.795392 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdb4b2-9c08-4dce-a088-4ab6b52f5c01 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:58.812314 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 266/510] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 9 02:17:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:58.813127 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdb4b2-9c08-4dce-a088-4ab6b52f5c01 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:58.838110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327471b-22cc-4234-b2be-97b2a13038ee None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:58.870932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1799b-1a7d-49ed-a55c-e3536a72e91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:58.871554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1799b-1a7d-49ed-a55c-e3536a72e91b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:58.871832 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1799b-1a7d-49ed-a55c-e3536a72e91b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:58.872102 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1799b-1a7d-49ed-a55c-e3536a72e91b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:58.879928 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1799b-1a7d-49ed-a55c-e3536a72e91b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:58.881433 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1799b-1a7d-49ed-a55c-e3536a72e91b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:58.892380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-e4f1799b-1a7d-49ed-a55c-e3536a72e91b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 09 02:17:58.892380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:58.892380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:58.892380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:58.892380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:58.892380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:58.892380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:58.892380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:58.892380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:58.892380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:58.892380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:58.892380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:58.892380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:17:58.892380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:17:58.892380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:17:58.892380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:17:58.898334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:58.898334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:58.898334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:17:58.898334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:17:58.898334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:17:58.898334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:17:58.898334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:58.898334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:58.898334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:58.898334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:58.898334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:58.898334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:58.898334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:58.898334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:58.898334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:58.898334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:58.898334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:58.898334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:58.899542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:58.899542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:58.899542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:17:58.899542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:17:58.899542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:17:58.899542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:17:58.899542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:17:58.899542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:17:58.899542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 09 02:17:58.899542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:17:58.899542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 245/511] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:17:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:58.899542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1799b-1a7d-49ed-a55c-e3536a72e91b None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:58.912407 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdb4b2-9c08-4dce-a088-4ab6b52f5c01 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:58.948990 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47337c0-2455-49f8-944f-c8c1f8745a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:58.949644 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47337c0-2455-49f8-944f-c8c1f8745a5b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:58.950269 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47337c0-2455-49f8-944f-c8c1f8745a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:58.950269 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47337c0-2455-49f8-944f-c8c1f8745a5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:58.960228 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47337c0-2455-49f8-944f-c8c1f8745a5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:58.961708 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47337c0-2455-49f8-944f-c8c1f8745a5b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:58.964224 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:58.977927 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-d47337c0-2455-49f8-944f-c8c1f8745a5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:17:58.977927 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:58.977927 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:58.977927 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:58.977927 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:58.977927 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:58.977927 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:58.977927 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:58.977927 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:58.977927 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:58.977927 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:58.977927 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:58.977927 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:17:58.977927 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:17:58.977927 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:17:58.977927 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:17:58.978856 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:58.978856 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:58.978856 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:58.978856 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:58.978856 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:58.978856 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:58.978856 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:58.978856 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:58.978856 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:58.978856 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:58.978856 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:58.978856 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:58.978856 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:58.978856 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:58.978856 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:58.978856 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:58.978856 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:17:58.980196 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:17:58.980196 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:17:58.980196 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:58.980196 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 267/512] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:17:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:58.980196 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47337c0-2455-49f8-944f-c8c1f8745a5b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:58.998035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:59.005314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1799b-1a7d-49ed-a55c-e3536a72e91b None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:59.039573 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624d450-8d44-45ef-986d-a2ad5f1a8dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:59.040174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624d450-8d44-45ef-986d-a2ad5f1a8dcc None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:59.040456 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624d450-8d44-45ef-986d-a2ad5f1a8dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:59.040736 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624d450-8d44-45ef-986d-a2ad5f1a8dcc None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:59.041414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624d450-8d44-45ef-986d-a2ad5f1a8dcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:59.041726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624d450-8d44-45ef-986d-a2ad5f1a8dcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:59.043095 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624d450-8d44-45ef-986d-a2ad5f1a8dcc None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:59.055294 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 246/513] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:59.055927 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624d450-8d44-45ef-986d-a2ad5f1a8dcc None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:59.082542 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47337c0-2455-49f8-944f-c8c1f8745a5b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:59.115800 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bd700-1e8e-4135-8227-023d98f2d8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:59.116348 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bd700-1e8e-4135-8227-023d98f2d8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:59.116624 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bd700-1e8e-4135-8227-023d98f2d8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:59.117171 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bd700-1e8e-4135-8227-023d98f2d8f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:59.127350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03bd700-1e8e-4135-8227-023d98f2d8f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:59.128812 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03bd700-1e8e-4135-8227-023d98f2d8f0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:59.142760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-f03bd700-1e8e-4135-8227-023d98f2d8f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:17:59.142760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:59.142760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:59.142760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:59.142760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:59.142760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:59.142760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:59.142760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:59.142760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:59.142760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:59.142760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:59.142760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:59.142760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:17:59.142760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:17:59.142760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:17:59.142760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:17:59.143864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:59.143864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:59.143864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:59.143864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:59.143864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:59.143864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:59.143864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:59.143864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:59.143864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:59.143864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:59.143864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:59.143864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:59.143864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:59.143864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:59.143864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:59.143864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:59.143864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:17:59.145282 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:17:59.145282 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:17:59.145282 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:59.145282 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 268/514] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:17:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:59.145282 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bd700-1e8e-4135-8227-023d98f2d8f0 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:59.160550 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624d450-8d44-45ef-986d-a2ad5f1a8dcc None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:59.192499 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:59.194696 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bde67b-639f-4fdb-9e36-573e2a9711ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:59.195383 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bde67b-639f-4fdb-9e36-573e2a9711ad None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:59.195664 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bde67b-639f-4fdb-9e36-573e2a9711ad None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:59.195990 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bde67b-639f-4fdb-9e36-573e2a9711ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:59.219580 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:59.246907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bd700-1e8e-4135-8227-023d98f2d8f0 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:59.262046 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bde67b-639f-4fdb-9e36-573e2a9711ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:59.263504 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bde67b-639f-4fdb-9e36-573e2a9711ad None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:59.279617 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96652fd-0309-4d15-bbf9-9418d1badc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:59.280213 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96652fd-0309-4d15-bbf9-9418d1badc3e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:59.280493 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96652fd-0309-4d15-bbf9-9418d1badc3e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:59.280773 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96652fd-0309-4d15-bbf9-9418d1badc3e None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:59.281528 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96652fd-0309-4d15-bbf9-9418d1badc3e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:59.281837 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96652fd-0309-4d15-bbf9-9418d1badc3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:59.283269 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96652fd-0309-4d15-bbf9-9418d1badc3e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:59.300268 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 269/515] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 9 02:17:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:59.301667 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96652fd-0309-4d15-bbf9-9418d1badc3e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:59.363907 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 247/516] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:59.364830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bde67b-639f-4fdb-9e36-573e2a9711ad None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:59.401961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96652fd-0309-4d15-bbf9-9418d1badc3e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:59.409132 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:59.418441 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:59.439699 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbbc86-12e8-421d-ae44-8b3eb4ef9f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:59.440304 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbbc86-12e8-421d-ae44-8b3eb4ef9f2a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:59.440887 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbbc86-12e8-421d-ae44-8b3eb4ef9f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:59.441250 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbbc86-12e8-421d-ae44-8b3eb4ef9f2a None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:59.442041 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbbc86-12e8-421d-ae44-8b3eb4ef9f2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:59.442343 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbbc86-12e8-421d-ae44-8b3eb4ef9f2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:59.443695 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbbc86-12e8-421d-ae44-8b3eb4ef9f2a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:59.454798 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 270/517] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:59.455632 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbbc86-12e8-421d-ae44-8b3eb4ef9f2a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:59.461942 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bde67b-639f-4fdb-9e36-573e2a9711ad None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:59.496120 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa684c-8aea-4ef3-bb4f-bca9d9c52bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:59.496708 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa684c-8aea-4ef3-bb4f-bca9d9c52bc2 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:59.496988 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa684c-8aea-4ef3-bb4f-bca9d9c52bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:59.497289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa684c-8aea-4ef3-bb4f-bca9d9c52bc2 None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:59.497920 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa684c-8aea-4ef3-bb4f-bca9d9c52bc2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:59.499387 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa684c-8aea-4ef3-bb4f-bca9d9c52bc2 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:59.519619 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 248/518] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 9 02:17:59 2022] POST /identity/v3/users => generated 247 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:17:59.533237 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa684c-8aea-4ef3-bb4f-bca9d9c52bc2 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:59.581469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbbc86-12e8-421d-ae44-8b3eb4ef9f2a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:59.623314 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb956f-ca29-4feb-af7a-a2d339a44f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:59.623963 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb956f-ca29-4feb-af7a-a2d339a44f49 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:59.624245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb956f-ca29-4feb-af7a-a2d339a44f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:59.624520 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb956f-ca29-4feb-af7a-a2d339a44f49 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:59.625218 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb956f-ca29-4feb-af7a-a2d339a44f49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:17:59.625524 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb956f-ca29-4feb-af7a-a2d339a44f49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:59.626980 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb956f-ca29-4feb-af7a-a2d339a44f49 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:59.631745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa684c-8aea-4ef3-bb4f-bca9d9c52bc2 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:59.647053 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 271/519] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:17:59.647053 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb956f-ca29-4feb-af7a-a2d339a44f49 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:59.648423 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:59.674013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83eb6a7-71c6-4091-8683-86b97dea312b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:59.674611 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83eb6a7-71c6-4091-8683-86b97dea312b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:59.674897 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83eb6a7-71c6-4091-8683-86b97dea312b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:59.675176 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83eb6a7-71c6-4091-8683-86b97dea312b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:59.680892 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:59.754467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83eb6a7-71c6-4091-8683-86b97dea312b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:59.755918 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83eb6a7-71c6-4091-8683-86b97dea312b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:59.768706 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb956f-ca29-4feb-af7a-a2d339a44f49 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:59.803758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a57e31-ceb1-4622-a4c1-7aeda938a679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:59.804392 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a57e31-ceb1-4622-a4c1-7aeda938a679 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:59.804673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a57e31-ceb1-4622-a4c1-7aeda938a679 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:59.804948 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a57e31-ceb1-4622-a4c1-7aeda938a679 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:17:59.815014 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a57e31-ceb1-4622-a4c1-7aeda938a679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:17:59.817069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a57e31-ceb1-4622-a4c1-7aeda938a679 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:17:59.831416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-65a57e31-ceb1-4622-a4c1-7aeda938a679 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:17:59.831416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:17:59.831416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:17:59.831416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:17:59.831416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:17:59.831416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:17:59.831416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:17:59.831416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:17:59.831416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:17:59.831416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:17:59.831416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:17:59.831416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:17:59.831416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:17:59.831416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:17:59.831416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:17:59.831416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:17:59.832906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:17:59.832906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:17:59.832906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:17:59.832906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:17:59.832906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:17:59.832906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:17:59.832906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:17:59.832906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:17:59.832906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:17:59.832906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:17:59.832906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:17:59.832906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:17:59.832906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:17:59.832906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:17:59.832906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:17:59.832906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:17:59.832906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:17:59.834430 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:17:59.834430 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:17:59.834430 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:17:59.834430 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 272/520] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:17:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:17:59.834430 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a57e31-ceb1-4622-a4c1-7aeda938a679 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:59.867356 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 249/521] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:17:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:17:59.868592 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83eb6a7-71c6-4091-8683-86b97dea312b None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:17:59.883874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:59.926248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:17:59.951528 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a57e31-ceb1-4622-a4c1-7aeda938a679 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:59.986789 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83eb6a7-71c6-4091-8683-86b97dea312b None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:17:59.993907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580a1aa-de38-4b7f-9bb5-598f256ccf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:17:59.996495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580a1aa-de38-4b7f-9bb5-598f256ccf1a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:17:59.996495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580a1aa-de38-4b7f-9bb5-598f256ccf1a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:17:59.996495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580a1aa-de38-4b7f-9bb5-598f256ccf1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:00.005714 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580a1aa-de38-4b7f-9bb5-598f256ccf1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:00.007183 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580a1aa-de38-4b7f-9bb5-598f256ccf1a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:00.018857 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-6580a1aa-de38-4b7f-9bb5-598f256ccf1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:00.018857 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:00.018857 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:00.018857 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:00.018857 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:00.018857 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:00.018857 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:00.018857 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:00.018857 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:00.018857 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:00.018857 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:00.018857 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:00.018857 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:00.018857 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:00.018857 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:00.020468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:00.020468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:00.020468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:00.020468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:00.020468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:00.020468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:00.020468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:00.020468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:00.020468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:00.020468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:00.020468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:00.020468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:00.020468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:00.020468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:00.020468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:00.020468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:00.020468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:00.021501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:00.021501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:00.021501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:00.021501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:00.021501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:00.021501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:00.021501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:00.021501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:00.021501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 273/522] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:17:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:00.021501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580a1aa-de38-4b7f-9bb5-598f256ccf1a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:00.035395 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd1ab7-6403-4138-9cbc-1d04579344be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:00.036027 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd1ab7-6403-4138-9cbc-1d04579344be None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:00.036324 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd1ab7-6403-4138-9cbc-1d04579344be None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:00.036584 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd1ab7-6403-4138-9cbc-1d04579344be None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:00.045168 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd1ab7-6403-4138-9cbc-1d04579344be None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:00.046634 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd1ab7-6403-4138-9cbc-1d04579344be None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:00.058202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-5ccd1ab7-6403-4138-9cbc-1d04579344be None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 02:18:00.058202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:00.058202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:00.058202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:00.058202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:00.058202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:00.058202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:00.058202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:00.058202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:00.058202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:00.058202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:00.058202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:00.058202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:18:00.058202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:18:00.058202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:18:00.058202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:18:00.059098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:00.059098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:00.059098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:18:00.059098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:00.059098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:18:00.059098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:00.059098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:00.059098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:00.059098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:00.059098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:00.059098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:00.059098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:00.059098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:00.059098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:00.059098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:00.059098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:00.059098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:00.059098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:00.064786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:00.064786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:00.064786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:18:00.064786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:18:00.064786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:18:00.064786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:18:00.064786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:18:00.064786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:18:00.064786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 02:18:00.064786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:00.064786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 250/523] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 9 02:17:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:00.064786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd1ab7-6403-4138-9cbc-1d04579344be None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:00.141687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:00.142070 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580a1aa-de38-4b7f-9bb5-598f256ccf1a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:00.175102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b0041-f6cf-4f1b-b9f9-8588da7e4983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:00.176209 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b0041-f6cf-4f1b-b9f9-8588da7e4983 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:00.176464 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd1ab7-6403-4138-9cbc-1d04579344be None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:00.176585 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b0041-f6cf-4f1b-b9f9-8588da7e4983 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:00.176738 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b0041-f6cf-4f1b-b9f9-8588da7e4983 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:00.177398 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b0041-f6cf-4f1b-b9f9-8588da7e4983 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:00.177697 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b0041-f6cf-4f1b-b9f9-8588da7e4983 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:00.179060 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b0041-f6cf-4f1b-b9f9-8588da7e4983 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:00.186149 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:00.196557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 274/524] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:00.196557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b0041-f6cf-4f1b-b9f9-8588da7e4983 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:00.220126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f21e32-8e78-4e43-ac5d-1609e8a4c62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:00.220750 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f21e32-8e78-4e43-ac5d-1609e8a4c62b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:00.221473 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f21e32-8e78-4e43-ac5d-1609e8a4c62b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:00.221751 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f21e32-8e78-4e43-ac5d-1609e8a4c62b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:00.236997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f21e32-8e78-4e43-ac5d-1609e8a4c62b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:00.239004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f21e32-8e78-4e43-ac5d-1609e8a4c62b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:00.255725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-a5f21e32-8e78-4e43-ac5d-1609e8a4c62b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:00.255725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:00.255725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:00.255725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:00.255725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:00.255725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:00.255725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:00.255725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:00.255725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:00.255725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:00.255725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:00.255725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:00.255725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:00.255725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:00.255725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:00.255725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:00.256672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:00.256672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:00.256672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:00.256672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:00.256672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:00.256672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:00.256672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:00.256672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:00.256672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:00.256672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:00.256672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:00.256672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:00.256672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:00.256672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:00.256672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:00.256672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:00.256672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:00.258012 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:00.258012 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:00.258012 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:00.258012 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 251/525] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:00.258012 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f21e32-8e78-4e43-ac5d-1609e8a4c62b None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:00.317470 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b0041-f6cf-4f1b-b9f9-8588da7e4983 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:00.350136 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1d02c-bf7f-4dc3-8930-da3156a62f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:00.350746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1d02c-bf7f-4dc3-8930-da3156a62f89 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:00.351019 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1d02c-bf7f-4dc3-8930-da3156a62f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:00.351290 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1d02c-bf7f-4dc3-8930-da3156a62f89 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:00.351979 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1d02c-bf7f-4dc3-8930-da3156a62f89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:00.352282 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1d02c-bf7f-4dc3-8930-da3156a62f89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:00.353724 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1d02c-bf7f-4dc3-8930-da3156a62f89 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:00.364591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f21e32-8e78-4e43-ac5d-1609e8a4c62b None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:00.371247 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 275/526] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:00.372047 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1d02c-bf7f-4dc3-8930-da3156a62f89 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:00.393908 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:00.406270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9680594-d00f-4f68-9d78-555a0d93cf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:00.406991 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9680594-d00f-4f68-9d78-555a0d93cf6c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:00.407297 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9680594-d00f-4f68-9d78-555a0d93cf6c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:00.407655 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9680594-d00f-4f68-9d78-555a0d93cf6c None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:00.408385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9680594-d00f-4f68-9d78-555a0d93cf6c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:00.408696 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9680594-d00f-4f68-9d78-555a0d93cf6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:00.410204 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9680594-d00f-4f68-9d78-555a0d93cf6c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:00.430805 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:00.453342 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 252/527] 10.222.0.16 () {56 vars in 1139 bytes} [Tue Aug 9 02:18:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:00.453342 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9680594-d00f-4f68-9d78-555a0d93cf6c None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:00.484388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1d02c-bf7f-4dc3-8930-da3156a62f89 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:00.527683 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6ed92-780d-482a-a7a3-7d53dc515f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:00.528654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6ed92-780d-482a-a7a3-7d53dc515f2c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:00.528936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6ed92-780d-482a-a7a3-7d53dc515f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:00.529237 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6ed92-780d-482a-a7a3-7d53dc515f2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:00.536929 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec6ed92-780d-482a-a7a3-7d53dc515f2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:00.538422 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec6ed92-780d-482a-a7a3-7d53dc515f2c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:00.550395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-6ec6ed92-780d-482a-a7a3-7d53dc515f2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:00.550395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:00.550395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:00.550395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:00.550395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:00.550395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:00.550395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:00.550395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:00.550395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:00.550395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:00.550395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:00.550395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:00.550395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:00.550395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:00.550395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:00.551928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:00.551928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:00.551928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:00.551928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:00.551928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:00.551928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:00.551928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:00.551928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:00.551928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:00.551928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:00.551928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:00.551928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:00.551928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:00.551928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:00.551928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:00.551928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:00.551928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:00.553076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:00.553076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:00.553076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:00.553076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:00.553076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:00.553076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:00.553076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:00.553076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:00.553601 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9680594-d00f-4f68-9d78-555a0d93cf6c None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:00.556676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 276/528] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:00.557621 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6ed92-780d-482a-a7a3-7d53dc515f2c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:00.591708 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d87fc-0b0c-4259-81f8-6d86d4963596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:00.592602 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d87fc-0b0c-4259-81f8-6d86d4963596 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:00.593194 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d87fc-0b0c-4259-81f8-6d86d4963596 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:00.593612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d87fc-0b0c-4259-81f8-6d86d4963596 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:00.594469 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d87fc-0b0c-4259-81f8-6d86d4963596 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:00.594962 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d87fc-0b0c-4259-81f8-6d86d4963596 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:00.596484 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d87fc-0b0c-4259-81f8-6d86d4963596 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:00.609875 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 253/529] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:00.610871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d87fc-0b0c-4259-81f8-6d86d4963596 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:00.658254 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:00.666902 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6ed92-780d-482a-a7a3-7d53dc515f2c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:00.685900 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:00.705635 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddaf8ab-2d24-49da-84aa-0ba2b0644d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:00.706244 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddaf8ab-2d24-49da-84aa-0ba2b0644d9a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:00.706553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddaf8ab-2d24-49da-84aa-0ba2b0644d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:00.706830 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddaf8ab-2d24-49da-84aa-0ba2b0644d9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:00.707558 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddaf8ab-2d24-49da-84aa-0ba2b0644d9a None admin] RBAC: Adding query filter params (role.id=d521e5f58e7e4cd48ceed4404113cbd5, scope.project.id=105476dcda7f48c28224d33c05860d6f, user.id=78fff294b9794a26aa1bbc231fa1133c) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:00.707868 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddaf8ab-2d24-49da-84aa-0ba2b0644d9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:00.709339 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddaf8ab-2d24-49da-84aa-0ba2b0644d9a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:00.720139 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d87fc-0b0c-4259-81f8-6d86d4963596 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:00.722760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 277/530] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:18:00 2022] GET /identity/v3/role_assignments?user.id=78fff294b9794a26aa1bbc231fa1133c&scope.project.id=105476dcda7f48c28224d33c05860d6f&role.id=d521e5f58e7e4cd48ceed4404113cbd5 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:00.723578 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddaf8ab-2d24-49da-84aa-0ba2b0644d9a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:00.764822 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8483d8-0408-4713-8c24-e566dd8ac095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:00.765862 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8483d8-0408-4713-8c24-e566dd8ac095 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:00.766292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8483d8-0408-4713-8c24-e566dd8ac095 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:00.766870 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8483d8-0408-4713-8c24-e566dd8ac095 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:00.846119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddaf8ab-2d24-49da-84aa-0ba2b0644d9a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:00.849254 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8483d8-0408-4713-8c24-e566dd8ac095 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:00.851108 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8483d8-0408-4713-8c24-e566dd8ac095 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:00.884930 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adabb8-229f-436c-9bde-b5a8a0b6d4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:00.885602 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adabb8-229f-436c-9bde-b5a8a0b6d4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:00.886574 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adabb8-229f-436c-9bde-b5a8a0b6d4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:00.886574 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adabb8-229f-436c-9bde-b5a8a0b6d4f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:00.886836 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1adabb8-229f-436c-9bde-b5a8a0b6d4f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:00.887141 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1adabb8-229f-436c-9bde-b5a8a0b6d4f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:00.888595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1adabb8-229f-436c-9bde-b5a8a0b6d4f2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:00.901828 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 278/531] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:00.902128 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:00.902849 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adabb8-229f-436c-9bde-b5a8a0b6d4f2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:00.946971 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:00.968918 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 254/532] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:18:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:18:00.970052 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8483d8-0408-4713-8c24-e566dd8ac095 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:01.006277 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adabb8-229f-436c-9bde-b5a8a0b6d4f2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:01.042168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a5739-ce20-4a81-81e8-fb442a0cd534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:01.042801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a5739-ce20-4a81-81e8-fb442a0cd534 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:01.043084 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a5739-ce20-4a81-81e8-fb442a0cd534 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:01.043443 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a5739-ce20-4a81-81e8-fb442a0cd534 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:01.050770 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a5739-ce20-4a81-81e8-fb442a0cd534 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:01.051835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a5739-ce20-4a81-81e8-fb442a0cd534 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:01.063126 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-850a5739-ce20-4a81-81e8-fb442a0cd534 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:01.063126 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:01.063126 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:01.063126 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:01.063126 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:01.063126 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:01.063126 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:01.063126 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:01.063126 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:01.063126 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:01.063126 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:01.063126 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:01.063126 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:01.063126 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:01.063126 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:01.063976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:01.063976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:01.063976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:01.063976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:01.063976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:01.063976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:01.063976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:01.063976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:01.063976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:01.063976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:01.063976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:01.063976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:01.063976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:01.063976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:01.063976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:01.063976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:01.063976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:01.064816 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:01.064816 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:01.064816 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:01.064816 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:01.064816 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:01.064816 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:01.064816 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:01.064816 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:01.068953 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 279/533] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:01.069822 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a5739-ce20-4a81-81e8-fb442a0cd534 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:01.090139 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8483d8-0408-4713-8c24-e566dd8ac095 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:01.129288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bbd13-77bf-4d87-b5d7-10b7d7ce7c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:01.130229 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bbd13-77bf-4d87-b5d7-10b7d7ce7c8b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:01.130732 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bbd13-77bf-4d87-b5d7-10b7d7ce7c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:01.131141 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bbd13-77bf-4d87-b5d7-10b7d7ce7c8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:01.132052 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239bbd13-77bf-4d87-b5d7-10b7d7ce7c8b None admin] RBAC: Adding query filter params (role.id=d521e5f58e7e4cd48ceed4404113cbd5, scope.project.id=105476dcda7f48c28224d33c05860d6f, user.id=9500a1b1de2344f78580bed52cc302a2) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:01.132615 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239bbd13-77bf-4d87-b5d7-10b7d7ce7c8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:01.134305 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239bbd13-77bf-4d87-b5d7-10b7d7ce7c8b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:01.140394 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 255/534] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:18:00 2022] GET /identity/v3/role_assignments?user.id=9500a1b1de2344f78580bed52cc302a2&scope.project.id=105476dcda7f48c28224d33c05860d6f&role.id=d521e5f58e7e4cd48ceed4404113cbd5 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:01.141726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bbd13-77bf-4d87-b5d7-10b7d7ce7c8b None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:01.151826 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:01.175186 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a5739-ce20-4a81-81e8-fb442a0cd534 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:01.176914 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:01.212748 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee9c5e-c6b1-4638-9831-dc7898989cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:01.213512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee9c5e-c6b1-4638-9831-dc7898989cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:01.213630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee9c5e-c6b1-4638-9831-dc7898989cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:01.213874 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee9c5e-c6b1-4638-9831-dc7898989cf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:01.225608 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee9c5e-c6b1-4638-9831-dc7898989cf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:01.227293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee9c5e-c6b1-4638-9831-dc7898989cf1 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:01.242619 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-12ee9c5e-c6b1-4638-9831-dc7898989cf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:01.242619 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:01.242619 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:01.242619 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:01.242619 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:01.242619 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:01.242619 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:01.242619 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:01.242619 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:01.242619 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:01.242619 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:01.242619 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:01.242619 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:01.242619 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:01.242619 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:01.242619 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:01.243771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:01.243771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:01.243771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:01.243771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:01.243771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:01.243771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:01.243771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:01.243771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:01.243771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:01.243771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:01.243771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:01.243771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:01.243771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:01.243771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:01.243771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:01.243771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:01.243771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:01.244986 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:01.244986 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:01.244986 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:01.244986 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 280/535] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:01.249252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee9c5e-c6b1-4638-9831-dc7898989cf1 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:01.264584 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bbd13-77bf-4d87-b5d7-10b7d7ce7c8b None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:01.303797 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfbf04-6128-4dd6-9470-2d8568d6df86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:01.304887 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfbf04-6128-4dd6-9470-2d8568d6df86 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:01.305389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfbf04-6128-4dd6-9470-2d8568d6df86 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:01.305864 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfbf04-6128-4dd6-9470-2d8568d6df86 None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:01.306776 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cfbf04-6128-4dd6-9470-2d8568d6df86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:01.307414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cfbf04-6128-4dd6-9470-2d8568d6df86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:01.309206 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cfbf04-6128-4dd6-9470-2d8568d6df86 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:01.330442 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 256/536] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:01.340290 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfbf04-6128-4dd6-9470-2d8568d6df86 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:01.364400 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee9c5e-c6b1-4638-9831-dc7898989cf1 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:01.418221 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ec937-b80f-4ec6-a94f-f6b0933c47fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:01.419151 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ec937-b80f-4ec6-a94f-f6b0933c47fb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:01.419906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ec937-b80f-4ec6-a94f-f6b0933c47fb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:01.420190 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ec937-b80f-4ec6-a94f-f6b0933c47fb None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:01.421889 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ec937-b80f-4ec6-a94f-f6b0933c47fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:01.422318 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ec937-b80f-4ec6-a94f-f6b0933c47fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:01.423742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ec937-b80f-4ec6-a94f-f6b0933c47fb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:01.437357 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 281/537] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:18:01.446087 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ec937-b80f-4ec6-a94f-f6b0933c47fb None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:01.469867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:01.479217 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:01.538557 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfbf04-6128-4dd6-9470-2d8568d6df86 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:01.612322 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9966540-ec18-425d-b8b5-676cf7666ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:01.613522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9966540-ec18-425d-b8b5-676cf7666ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:01.613749 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9966540-ec18-425d-b8b5-676cf7666ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:01.617042 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9966540-ec18-425d-b8b5-676cf7666ff4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:01.617042 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9966540-ec18-425d-b8b5-676cf7666ff4 None admin] RBAC: Adding query filter params (role.id=d521e5f58e7e4cd48ceed4404113cbd5, scope.project.id=105476dcda7f48c28224d33c05860d6f, user.id=63645a88f5924a57b5b828aacd856902) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:01.617042 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9966540-ec18-425d-b8b5-676cf7666ff4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:01.617042 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9966540-ec18-425d-b8b5-676cf7666ff4 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:01.623148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 257/538] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:18:01 2022] GET /identity/v3/role_assignments?user.id=63645a88f5924a57b5b828aacd856902&scope.project.id=105476dcda7f48c28224d33c05860d6f&role.id=d521e5f58e7e4cd48ceed4404113cbd5 => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:01.624481 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fe8f5-21ac-4646-87da-ef085f11c8ed None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:01.624767 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fe8f5-21ac-4646-87da-ef085f11c8ed None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:01.625053 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fe8f5-21ac-4646-87da-ef085f11c8ed None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:01.634959 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ec937-b80f-4ec6-a94f-f6b0933c47fb None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:01.635591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 258/539] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:01 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:01.641990 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7094d-273a-4257-b757-3bb5bd684c62 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:01.642281 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7094d-273a-4257-b757-3bb5bd684c62 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:01.642533 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7094d-273a-4257-b757-3bb5bd684c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:01.675061 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-8bb7094d-273a-4257-b757-3bb5bd684c62 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:01.676848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8bb7094d-273a-4257-b757-3bb5bd684c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:01.678375 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9bca8-01ee-421e-82ab-7a015698e8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:01.679024 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9bca8-01ee-421e-82ab-7a015698e8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:01.679306 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9bca8-01ee-421e-82ab-7a015698e8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:01.679580 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9bca8-01ee-421e-82ab-7a015698e8f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:01.686942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9bca8-01ee-421e-82ab-7a015698e8f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:01.688421 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9bca8-01ee-421e-82ab-7a015698e8f5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:01.701457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-eeb9bca8-01ee-421e-82ab-7a015698e8f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:01.701457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:01.701457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:01.701457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:01.701457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:01.701457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:01.701457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:01.701457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:01.701457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:01.701457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:01.701457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:01.701457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:01.701457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:01.701457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:01.701457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:01.703539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:01.703539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:01.703539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:01.703539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:01.703539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:01.703539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:01.703539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:01.703539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:01.703539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:01.703539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:01.703539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:01.703539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:01.703539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:01.703539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:01.703539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:01.703539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:01.703539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:01.705594 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:01.705594 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:01.705594 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:01.705594 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:01.705594 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:01.705594 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:01.705594 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:01.705594 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:01.705594 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 282/540] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:01.720444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9bca8-01ee-421e-82ab-7a015698e8f5 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:01.813692 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:01.821295 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 259/541] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 02:18:01.859085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9bca8-01ee-421e-82ab-7a015698e8f5 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:01.864103 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7094d-273a-4257-b757-3bb5bd684c62 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:01.899161 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b99645-6400-49ae-9ebf-d6b7c5664cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:01.900152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b99645-6400-49ae-9ebf-d6b7c5664cab None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:01.900433 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b99645-6400-49ae-9ebf-d6b7c5664cab None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:01.900703 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b99645-6400-49ae-9ebf-d6b7c5664cab None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:01.901444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b99645-6400-49ae-9ebf-d6b7c5664cab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:01.901789 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b99645-6400-49ae-9ebf-d6b7c5664cab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:01.903240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b99645-6400-49ae-9ebf-d6b7c5664cab None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:01.916837 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 283/542] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:01.923338 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b99645-6400-49ae-9ebf-d6b7c5664cab None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:02.014141 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:02.060784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b99645-6400-49ae-9ebf-d6b7c5664cab None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:02.082032 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7094d-273a-4257-b757-3bb5bd684c62 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:02.098418 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1d354-fe35-4b87-a960-ff5a40af7bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:02.101209 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1d354-fe35-4b87-a960-ff5a40af7bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:02.102984 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1d354-fe35-4b87-a960-ff5a40af7bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:02.104125 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1d354-fe35-4b87-a960-ff5a40af7bc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:02.106748 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1d354-fe35-4b87-a960-ff5a40af7bc5 None admin] RBAC: Adding query filter params (role.id=d521e5f58e7e4cd48ceed4404113cbd5, scope.project.id=105476dcda7f48c28224d33c05860d6f, user.id=d608fede6f5e4b339f8de0354cc0562b) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:02.107869 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1d354-fe35-4b87-a960-ff5a40af7bc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:02.109779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1d354-fe35-4b87-a960-ff5a40af7bc5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:02.114586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:02.123133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 284/543] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:18:01 2022] GET /identity/v3/role_assignments?user.id=d608fede6f5e4b339f8de0354cc0562b&scope.project.id=105476dcda7f48c28224d33c05860d6f&role.id=d521e5f58e7e4cd48ceed4404113cbd5 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:18:02.148421 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39893b41-7977-4d23-9a46-5f3091b1d4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:02.149352 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39893b41-7977-4d23-9a46-5f3091b1d4ef None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:02.149799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39893b41-7977-4d23-9a46-5f3091b1d4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:02.150267 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39893b41-7977-4d23-9a46-5f3091b1d4ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:02.169346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39893b41-7977-4d23-9a46-5f3091b1d4ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:18:02.174577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-39893b41-7977-4d23-9a46-5f3091b1d4ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:02.174577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:02.174577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:02.174577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:02.174577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:02.174577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:02.174577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:02.174577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:02.174577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:02.174577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:02.174577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:02.174577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:02.174577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:18:02.174577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:18:02.174577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:18:02.174577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:18:02.176355 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:18:02.176355 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:18:02.176355 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:18:02.176355 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:18:02.176355 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:02.176355 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:02.176355 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:02.176355 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:02.176355 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:02.176355 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:02.176355 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:02.176355 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:02.176355 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:02.176355 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:02.176355 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:02.176355 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:02.177473 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:02.177473 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:02.177473 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:02.177473 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:02.177473 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:18:02.177473 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:18:02.177473 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:18:02.177473 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:18:02.177473 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:18:02.177473 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:18:02.177473 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:02.177473 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:02.179774 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 260/544] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 9 02:18:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:18:02.189405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1d354-fe35-4b87-a960-ff5a40af7bc5 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:02.316411 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1d354-fe35-4b87-a960-ff5a40af7bc5 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:02.360395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87158d32-0b9c-433c-b5f3-87af93398dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:02.361369 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87158d32-0b9c-433c-b5f3-87af93398dea None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:02.361844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87158d32-0b9c-433c-b5f3-87af93398dea None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:02.362266 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87158d32-0b9c-433c-b5f3-87af93398dea None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:02.363167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87158d32-0b9c-433c-b5f3-87af93398dea None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:02.363641 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87158d32-0b9c-433c-b5f3-87af93398dea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:02.365233 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87158d32-0b9c-433c-b5f3-87af93398dea None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:02.379895 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 285/545] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 9 02:18:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:02.381347 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39893b41-7977-4d23-9a46-5f3091b1d4ef None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:02.521626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39893b41-7977-4d23-9a46-5f3091b1d4ef None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:02.545800 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:02.570769 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d474fa7-d3ff-4d95-8562-8d3947c0596e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:02.571337 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d474fa7-d3ff-4d95-8562-8d3947c0596e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:02.571618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d474fa7-d3ff-4d95-8562-8d3947c0596e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:02.571898 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d474fa7-d3ff-4d95-8562-8d3947c0596e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:02.586335 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d474fa7-d3ff-4d95-8562-8d3947c0596e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:02.587809 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d474fa7-d3ff-4d95-8562-8d3947c0596e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:02.609345 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-7d474fa7-d3ff-4d95-8562-8d3947c0596e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:02.609345 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:02.609345 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:02.609345 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:02.609345 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:02.609345 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:02.609345 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:02.609345 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:02.609345 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:02.609345 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:02.609345 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:02.609345 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:02.609345 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:02.609345 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:02.609345 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:02.609345 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:02.610304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:02.610304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:02.610304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:02.610304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:02.610304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:02.610304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:02.610304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:02.610304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:02.610304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:02.610304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:02.610304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:02.610304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:02.610304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:02.610304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:02.610304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:02.610304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:02.610304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:02.611365 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:02.611365 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:02.611365 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:02.611365 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 261/546] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:02.617734 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87158d32-0b9c-433c-b5f3-87af93398dea None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:02.708047 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:02.768326 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87158d32-0b9c-433c-b5f3-87af93398dea None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:02.811975 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6ced2-993e-49d2-831c-d2fecefaec48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:02.812585 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6ced2-993e-49d2-831c-d2fecefaec48 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:02.812868 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6ced2-993e-49d2-831c-d2fecefaec48 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:02.813169 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6ced2-993e-49d2-831c-d2fecefaec48 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:02.813816 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6ced2-993e-49d2-831c-d2fecefaec48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:02.814123 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6ced2-993e-49d2-831c-d2fecefaec48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:02.815624 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6ced2-993e-49d2-831c-d2fecefaec48 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:02.833291 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 286/547] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:02.838841 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d474fa7-d3ff-4d95-8562-8d3947c0596e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:02.996661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d474fa7-d3ff-4d95-8562-8d3947c0596e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:03.045901 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60adec0-b5be-40f1-a254-5de4b462b26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:03.046538 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60adec0-b5be-40f1-a254-5de4b462b26e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:03.046823 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60adec0-b5be-40f1-a254-5de4b462b26e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:03.047099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60adec0-b5be-40f1-a254-5de4b462b26e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:03.066657 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60adec0-b5be-40f1-a254-5de4b462b26e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:03.068120 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60adec0-b5be-40f1-a254-5de4b462b26e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:03.072893 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad37131-ceaf-4849-9833-388e51ee6364 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:03.073245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad37131-ceaf-4849-9833-388e51ee6364 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:03.073527 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad37131-ceaf-4849-9833-388e51ee6364 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:03.075130 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 287/548] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:03.080408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7df15-2846-4c84-8e57-54f9441ffdd0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:03.080700 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7df15-2846-4c84-8e57-54f9441ffdd0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:03.080979 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7df15-2846-4c84-8e57-54f9441ffdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:03.083088 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-b60adec0-b5be-40f1-a254-5de4b462b26e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 02:18:03.083088 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:03.083088 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:03.083088 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:03.083088 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:03.083088 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:03.083088 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:03.083088 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:03.083088 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:03.083088 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:03.083088 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:03.083088 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:03.083088 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:18:03.083088 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:18:03.083088 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:18:03.083088 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:18:03.083975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:03.083975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:03.083975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:18:03.083975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:03.083975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:18:03.083975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:03.083975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:03.083975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:03.083975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:03.083975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:03.083975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:03.083975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:03.083975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:03.083975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:03.083975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:03.083975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:03.083975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:03.083975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:03.086974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:03.086974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:03.086974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:18:03.086974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:18:03.086974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:18:03.086974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:18:03.086974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:18:03.086974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:18:03.086974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 02:18:03.086974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:03.086974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 262/549] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:18:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:03.093882 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60adec0-b5be-40f1-a254-5de4b462b26e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:03.118917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-3aa7df15-2846-4c84-8e57-54f9441ffdd0 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:03.120141 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3aa7df15-2846-4c84-8e57-54f9441ffdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:03.147445 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:03.246630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 288/550] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:18:03.272210 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7df15-2846-4c84-8e57-54f9441ffdd0 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:03.276882 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60adec0-b5be-40f1-a254-5de4b462b26e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:03.313746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8166d-873a-49de-933b-a7144424b52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:03.314359 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8166d-873a-49de-933b-a7144424b52c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:03.314643 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8166d-873a-49de-933b-a7144424b52c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:03.314917 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8166d-873a-49de-933b-a7144424b52c None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:03.316210 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8166d-873a-49de-933b-a7144424b52c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:03.316519 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8166d-873a-49de-933b-a7144424b52c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:03.320083 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8166d-873a-49de-933b-a7144424b52c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:03.356149 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 263/551] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Aug 9 02:18:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:03.373418 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:03.375224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8166d-873a-49de-933b-a7144424b52c None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:03.463539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7df15-2846-4c84-8e57-54f9441ffdd0 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:03.541992 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3a7d2-b771-464a-903c-54e5a1152d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:03.543550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3a7d2-b771-464a-903c-54e5a1152d07 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:03.543750 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:03.544032 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3a7d2-b771-464a-903c-54e5a1152d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:03.544330 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3a7d2-b771-464a-903c-54e5a1152d07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:03.558514 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8166d-873a-49de-933b-a7144424b52c None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:03.559884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3a7d2-b771-464a-903c-54e5a1152d07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:18:03.565879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-a1a3a7d2-b771-464a-903c-54e5a1152d07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:03.565879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:03.565879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:03.565879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:03.565879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:03.565879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:03.565879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:03.565879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:03.565879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:03.565879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:03.565879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:03.565879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:03.565879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:18:03.565879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:18:03.565879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:18:03.565879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:18:03.566760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:18:03.566760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:18:03.566760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:18:03.566760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:18:03.566760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:03.566760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:03.566760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:03.566760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:03.566760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:03.566760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:03.566760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:03.566760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:03.566760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:03.566760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:03.566760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:03.566760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:03.567735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:03.567735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:03.567735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:03.567735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:03.567735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:18:03.567735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:18:03.567735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:18:03.567735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:18:03.567735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:18:03.567735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:18:03.567735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:03.567735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:03.567735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 289/552] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 9 02:18:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:18:03.568902 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea6b02-6399-4d74-bb10-63276f92707a None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:03.569232 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea6b02-6399-4d74-bb10-63276f92707a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:03.569788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea6b02-6399-4d74-bb10-63276f92707a None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:03.571378 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 290/553] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:03.572971 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea6b02-6399-4d74-bb10-63276f92707a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:03.605496 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5dd17-cb86-45b4-aa70-81d2b333af19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:03.606721 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5dd17-cb86-45b4-aa70-81d2b333af19 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:03.607220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5dd17-cb86-45b4-aa70-81d2b333af19 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:03.607495 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5dd17-cb86-45b4-aa70-81d2b333af19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:03.690856 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea6b02-6399-4d74-bb10-63276f92707a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:03.702735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:03.707033 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5dd17-cb86-45b4-aa70-81d2b333af19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:03.710047 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5dd17-cb86-45b4-aa70-81d2b333af19 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:03.733485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2f546-6583-416e-90a0-0b397b182e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:03.734137 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2f546-6583-416e-90a0-0b397b182e01 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:03.734359 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2f546-6583-416e-90a0-0b397b182e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:03.734627 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2f546-6583-416e-90a0-0b397b182e01 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:03.735316 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f2f546-6583-416e-90a0-0b397b182e01 None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:03.735616 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f2f546-6583-416e-90a0-0b397b182e01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:03.736979 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f2f546-6583-416e-90a0-0b397b182e01 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:03.752259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 291/554] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 9 02:18:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:03.754611 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9c4e6-63ac-46f5-afdd-3660d640c0de None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:03.755404 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9c4e6-63ac-46f5-afdd-3660d640c0de None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:03.755933 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9c4e6-63ac-46f5-afdd-3660d640c0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:03.779529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-38a9c4e6-63ac-46f5-afdd-3660d640c0de None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:03.781390 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-38a9c4e6-63ac-46f5-afdd-3660d640c0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:03.819416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:03.831845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 264/555] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:18:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:18:03.832747 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5dd17-cb86-45b4-aa70-81d2b333af19 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:03.875161 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 292/556] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:18:03.876371 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9c4e6-63ac-46f5-afdd-3660d640c0de None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:03.970410 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5dd17-cb86-45b4-aa70-81d2b333af19 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:03.997581 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9c4e6-63ac-46f5-afdd-3660d640c0de None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:03.999233 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:04.023753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75a230-2081-468d-a7fe-0f79f67fd91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:04.024385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75a230-2081-468d-a7fe-0f79f67fd91c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:04.024660 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75a230-2081-468d-a7fe-0f79f67fd91c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:04.024929 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75a230-2081-468d-a7fe-0f79f67fd91c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:04.036658 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75a230-2081-468d-a7fe-0f79f67fd91c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:04.038561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75a230-2081-468d-a7fe-0f79f67fd91c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:04.044234 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9797d9c-f5b4-4659-862d-94c00d9be6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:04.045164 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9797d9c-f5b4-4659-862d-94c00d9be6fd None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:04.046193 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9797d9c-f5b4-4659-862d-94c00d9be6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:04.046671 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9797d9c-f5b4-4659-862d-94c00d9be6fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:04.054044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-1a75a230-2081-468d-a7fe-0f79f67fd91c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:04.054044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:04.054044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:04.054044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:04.054044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:04.054044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:04.054044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:04.054044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:04.054044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:04.054044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:04.054044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:04.054044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:04.054044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:04.054044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:04.054044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:04.054044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:04.055080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:04.055080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:04.055080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:04.055080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:04.055080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:04.055080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:04.055080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:04.055080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:04.055080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:04.055080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:04.055080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:04.055080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:04.055080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:04.055080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:04.055080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:04.055080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:04.055080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:04.055921 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:04.055921 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:04.055921 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:04.055921 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 265/557] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:04.056570 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75a230-2081-468d-a7fe-0f79f67fd91c None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:04.062970 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9797d9c-f5b4-4659-862d-94c00d9be6fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:04.064442 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9797d9c-f5b4-4659-862d-94c00d9be6fd None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:04.079520 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-c9797d9c-f5b4-4659-862d-94c00d9be6fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:04.079520 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:04.079520 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:04.079520 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:04.079520 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:04.079520 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:04.079520 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:04.079520 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:04.079520 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:04.079520 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:04.079520 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:04.079520 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:04.079520 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:04.079520 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:04.079520 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:04.079520 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:04.080915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:04.080915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:04.080915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:04.080915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:04.080915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:04.080915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:04.080915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:04.080915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:04.080915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:04.080915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:04.080915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:04.080915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:04.080915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:04.080915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:04.080915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:04.080915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:04.080915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:04.082373 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:04.082373 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:04.082373 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:04.082373 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 293/558] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:04.082603 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9797d9c-f5b4-4659-862d-94c00d9be6fd None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:04.115392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:04.190157 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75a230-2081-468d-a7fe-0f79f67fd91c None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:04.193962 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9797d9c-f5b4-4659-862d-94c00d9be6fd None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:04.233390 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecd464-c871-4b53-9b32-6c4e438d959f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:04.233994 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecd464-c871-4b53-9b32-6c4e438d959f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:04.234273 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecd464-c871-4b53-9b32-6c4e438d959f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:04.234463 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e40ff4-159d-4779-aae5-96bc99ecc982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:04.234592 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecd464-c871-4b53-9b32-6c4e438d959f None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:04.235052 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e40ff4-159d-4779-aae5-96bc99ecc982 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:04.235152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fecd464-c871-4b53-9b32-6c4e438d959f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:04.235334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e40ff4-159d-4779-aae5-96bc99ecc982 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:04.235442 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fecd464-c871-4b53-9b32-6c4e438d959f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:04.235604 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e40ff4-159d-4779-aae5-96bc99ecc982 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:04.236805 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fecd464-c871-4b53-9b32-6c4e438d959f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:04.247846 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e40ff4-159d-4779-aae5-96bc99ecc982 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:18:04.253579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 294/559] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:04.253579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecd464-c871-4b53-9b32-6c4e438d959f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:04.254105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-56e40ff4-159d-4779-aae5-96bc99ecc982 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:04.254105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:04.254105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:04.254105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:04.254105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:04.254105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:04.254105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:04.254105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:04.254105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:04.254105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:04.254105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:04.254105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:04.254105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:18:04.254105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:18:04.254105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:18:04.254105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:18:04.255221 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:18:04.255221 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:18:04.255221 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:18:04.255221 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:18:04.255221 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:04.255221 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:04.255221 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:04.255221 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:04.255221 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:04.255221 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:04.255221 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:04.255221 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:04.255221 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:04.255221 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:04.255221 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:04.255221 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:04.256113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:04.256113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:04.256113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:04.256113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:04.256113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:18:04.256113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:18:04.256113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:18:04.256113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:18:04.256113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:18:04.256113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:18:04.256113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:04.256113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:04.256113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 266/560] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 9 02:18:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:04.256113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586268f-7f94-4186-b850-e4021bf2d146 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:04.256848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586268f-7f94-4186-b850-e4021bf2d146 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:04.256848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586268f-7f94-4186-b850-e4021bf2d146 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:04.258088 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 267/561] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:04.258794 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586268f-7f94-4186-b850-e4021bf2d146 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:04.279952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:04.365860 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586268f-7f94-4186-b850-e4021bf2d146 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:04.368156 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:04.370848 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecd464-c871-4b53-9b32-6c4e438d959f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:04.402498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80da33e-821f-4f59-852d-54abb2e9e033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:04.403127 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80da33e-821f-4f59-852d-54abb2e9e033 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:04.403409 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80da33e-821f-4f59-852d-54abb2e9e033 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:04.403681 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80da33e-821f-4f59-852d-54abb2e9e033 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:04.410349 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074251d-70f7-48dd-9e78-ac979ce91df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:04.411089 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074251d-70f7-48dd-9e78-ac979ce91df6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:04.411191 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80da33e-821f-4f59-852d-54abb2e9e033 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:04.411371 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074251d-70f7-48dd-9e78-ac979ce91df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:04.411644 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074251d-70f7-48dd-9e78-ac979ce91df6 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:04.412288 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074251d-70f7-48dd-9e78-ac979ce91df6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:04.412567 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80da33e-821f-4f59-852d-54abb2e9e033 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:04.412662 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074251d-70f7-48dd-9e78-ac979ce91df6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:04.413956 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074251d-70f7-48dd-9e78-ac979ce91df6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:04.423522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-d80da33e-821f-4f59-852d-54abb2e9e033 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 02:18:04.423522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:04.423522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:04.423522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:04.423522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:04.423522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:04.423522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:04.423522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:04.423522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:04.423522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:04.423522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:04.423522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:04.423522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:18:04.423522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:18:04.423522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:18:04.423522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:18:04.424597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:04.424597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:04.424597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:18:04.424597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:04.424597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:18:04.424597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:04.424597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:04.424597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:04.424597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:04.424597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:04.424597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:04.424597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:04.424597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:04.424597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:04.424597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:04.424597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:04.424597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:04.424597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:04.425540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:04.425540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:04.425540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:18:04.425540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:18:04.425540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:18:04.425540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:18:04.425540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:18:04.425540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:18:04.425540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 02:18:04.425540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:04.433547 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 295/562] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:04.433736 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 268/563] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 9 02:18:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:04.433736 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80da33e-821f-4f59-852d-54abb2e9e033 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:04.433898 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16080cb7-5b6e-4269-8ebd-8a60716221cb None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:04.433898 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16080cb7-5b6e-4269-8ebd-8a60716221cb None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:04.433898 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16080cb7-5b6e-4269-8ebd-8a60716221cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:04.453044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-16080cb7-5b6e-4269-8ebd-8a60716221cb None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:04.454583 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-16080cb7-5b6e-4269-8ebd-8a60716221cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:04.528159 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 296/564] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:18:04.529044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16080cb7-5b6e-4269-8ebd-8a60716221cb None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:04.538204 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:04.542347 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80da33e-821f-4f59-852d-54abb2e9e033 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:04.575570 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a8339-ea29-4415-9028-59db26f9a11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:04.576174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a8339-ea29-4415-9028-59db26f9a11f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:04.576449 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a8339-ea29-4415-9028-59db26f9a11f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:04.576719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a8339-ea29-4415-9028-59db26f9a11f None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:04.577407 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a8339-ea29-4415-9028-59db26f9a11f None admin] RBAC: Adding query filter params (name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:04.577711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a8339-ea29-4415-9028-59db26f9a11f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:04.579058 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a8339-ea29-4415-9028-59db26f9a11f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:04.587389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 269/565] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 9 02:18:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:04.588168 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a8339-ea29-4415-9028-59db26f9a11f None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:04.614460 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:04.636899 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16080cb7-5b6e-4269-8ebd-8a60716221cb None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:04.670589 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41607c-39ad-4bb2-b783-35a48a3d12e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:04.671186 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41607c-39ad-4bb2-b783-35a48a3d12e0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:04.671460 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41607c-39ad-4bb2-b783-35a48a3d12e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:04.671730 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41607c-39ad-4bb2-b783-35a48a3d12e0 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:04.672442 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41607c-39ad-4bb2-b783-35a48a3d12e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:04.672745 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41607c-39ad-4bb2-b783-35a48a3d12e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:04.674223 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41607c-39ad-4bb2-b783-35a48a3d12e0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:04.687664 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a8339-ea29-4415-9028-59db26f9a11f None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:04.691627 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 297/566] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 9 02:18:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:04.692840 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19748e9a-bc04-4c7e-bfe5-16f58b5f7e92 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:04.693149 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19748e9a-bc04-4c7e-bfe5-16f58b5f7e92 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:04.693421 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19748e9a-bc04-4c7e-bfe5-16f58b5f7e92 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:04.694766 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 298/567] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:04.695349 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19748e9a-bc04-4c7e-bfe5-16f58b5f7e92 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:04.722860 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44a577-fe8b-4d34-ae0c-589adff5569e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:04.723417 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44a577-fe8b-4d34-ae0c-589adff5569e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:04.723699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44a577-fe8b-4d34-ae0c-589adff5569e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:04.723974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44a577-fe8b-4d34-ae0c-589adff5569e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:04.730608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44a577-fe8b-4d34-ae0c-589adff5569e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:04.732055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44a577-fe8b-4d34-ae0c-589adff5569e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:04.744569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-0b44a577-fe8b-4d34-ae0c-589adff5569e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:04.744569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:04.744569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:04.744569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:04.744569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:04.744569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:04.744569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:04.744569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:04.744569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:04.744569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:04.744569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:04.744569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:04.744569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:04.744569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:04.744569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:04.745459 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:04.745459 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:04.745459 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:04.745459 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:04.745459 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:04.745459 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:04.745459 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:04.745459 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:04.745459 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:04.745459 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:04.745459 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:04.745459 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:04.745459 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:04.745459 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:04.745459 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:04.745459 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:04.745459 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:04.746520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:04.746520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:04.746520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:04.746520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:04.746520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:04.746520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:04.746520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:04.746520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:04.746520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 270/568] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:04.746520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44a577-fe8b-4d34-ae0c-589adff5569e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:04.759363 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:04.800906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19748e9a-bc04-4c7e-bfe5-16f58b5f7e92 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:04.830470 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:04.835579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c845c4-7ab9-463f-ac16-f4b466ba8737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:04.836209 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c845c4-7ab9-463f-ac16-f4b466ba8737 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:04.836487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c845c4-7ab9-463f-ac16-f4b466ba8737 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:04.836760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c845c4-7ab9-463f-ac16-f4b466ba8737 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:04.846698 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c845c4-7ab9-463f-ac16-f4b466ba8737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:18:04.847861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44a577-fe8b-4d34-ae0c-589adff5569e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:04.851380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-99c845c4-7ab9-463f-ac16-f4b466ba8737 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:04.851380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:04.851380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:04.851380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:04.851380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:04.851380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:04.851380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:04.851380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:04.851380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:04.851380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:04.851380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:04.851380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:04.851380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:18:04.851380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:18:04.851380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:18:04.851380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:18:04.852476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:18:04.852476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:18:04.852476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:18:04.852476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:18:04.852476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:04.852476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:04.852476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:04.852476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:04.852476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:04.852476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:04.852476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:04.852476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:04.852476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:04.852476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:04.852476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:04.852476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:04.853656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:04.853656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:04.853656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:04.853656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:04.853656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:18:04.853656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:18:04.853656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:18:04.853656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:18:04.853656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:18:04.853656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:18:04.853656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:04.853656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:04.853656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 299/569] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 9 02:18:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:04.853656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c845c4-7ab9-463f-ac16-f4b466ba8737 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:04.886863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b19d1d-9474-40d7-8555-39bfdabad3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:04.887483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b19d1d-9474-40d7-8555-39bfdabad3ce None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:04.887760 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b19d1d-9474-40d7-8555-39bfdabad3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:04.888028 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b19d1d-9474-40d7-8555-39bfdabad3ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:04.898272 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b19d1d-9474-40d7-8555-39bfdabad3ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:04.899720 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b19d1d-9474-40d7-8555-39bfdabad3ce None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:04.913572 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-00b19d1d-9474-40d7-8555-39bfdabad3ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:04.913572 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:04.913572 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:04.913572 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:04.913572 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:04.913572 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:04.913572 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:04.913572 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:04.913572 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:04.913572 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:04.913572 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:04.913572 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:04.913572 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:04.913572 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:04.913572 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:04.913572 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:04.914638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:04.914638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:04.914638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:04.914638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:04.914638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:04.914638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:04.914638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:04.914638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:04.914638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:04.914638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:04.914638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:04.914638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:04.914638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:04.914638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:04.914638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:04.914638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:04.914638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:04.915519 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:04.915519 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:04.915519 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:04.915519 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 271/570] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:04.915751 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274f11b-7cfd-4583-8d8f-fa44b5980d52 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:04.916110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274f11b-7cfd-4583-8d8f-fa44b5980d52 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:04.916325 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274f11b-7cfd-4583-8d8f-fa44b5980d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:04.933948 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-9274f11b-7cfd-4583-8d8f-fa44b5980d52 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:04.935142 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9274f11b-7cfd-4583-8d8f-fa44b5980d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:04.958258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c845c4-7ab9-463f-ac16-f4b466ba8737 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:04.985237 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:04.998743 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dde70-fcb2-4436-9328-cac634ff04f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:04.999367 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dde70-fcb2-4436-9328-cac634ff04f7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:04.999646 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dde70-fcb2-4436-9328-cac634ff04f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:04.999918 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dde70-fcb2-4436-9328-cac634ff04f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:05.001319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 272/571] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:18:05.002162 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274f11b-7cfd-4583-8d8f-fa44b5980d52 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:05.022083 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602dde70-fcb2-4436-9328-cac634ff04f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:05.023570 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602dde70-fcb2-4436-9328-cac634ff04f7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:05.038457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-602dde70-fcb2-4436-9328-cac634ff04f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:05.038457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:05.038457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:05.038457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:05.038457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:05.038457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:05.038457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:05.038457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:05.038457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:05.038457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:05.038457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:05.038457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:05.038457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:05.038457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:05.038457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:05.038457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:05.039654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:05.039654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:05.039654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:05.039654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:05.039654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:05.039654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:05.039654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:05.039654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:05.039654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:05.039654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:05.039654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:05.039654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:05.039654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:05.039654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:05.039654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:05.039654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:05.039654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:05.040551 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:05.040551 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:05.040551 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:05.040551 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 300/572] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:05.040773 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dde70-fcb2-4436-9328-cac634ff04f7 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:05.066685 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:05.101009 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274f11b-7cfd-4583-8d8f-fa44b5980d52 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:05.134164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c3be6-1a13-4745-801c-e34cdc2e01f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:05.134762 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c3be6-1a13-4745-801c-e34cdc2e01f5 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:05.135042 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c3be6-1a13-4745-801c-e34cdc2e01f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:05.135316 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c3be6-1a13-4745-801c-e34cdc2e01f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:05.136008 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c3be6-1a13-4745-801c-e34cdc2e01f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:05.136313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c3be6-1a13-4745-801c-e34cdc2e01f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:05.137757 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c3be6-1a13-4745-801c-e34cdc2e01f5 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:05.138717 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dde70-fcb2-4436-9328-cac634ff04f7 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:05.148862 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 273/573] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:05.149677 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c3be6-1a13-4745-801c-e34cdc2e01f5 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:05.173255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6240598-c113-4caa-acec-de32f213a0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:05.174118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6240598-c113-4caa-acec-de32f213a0cb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:05.174118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6240598-c113-4caa-acec-de32f213a0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:05.174385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6240598-c113-4caa-acec-de32f213a0cb None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:05.175607 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6240598-c113-4caa-acec-de32f213a0cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:05.175910 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6240598-c113-4caa-acec-de32f213a0cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:05.177302 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6240598-c113-4caa-acec-de32f213a0cb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:05.184968 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 301/574] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 9 02:18:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:05.185903 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6240598-c113-4caa-acec-de32f213a0cb None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:05.219309 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:05.249583 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c3be6-1a13-4745-801c-e34cdc2e01f5 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:05.273722 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:05.282961 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f6261-3694-48af-9f0e-34045dcd16c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:05.283557 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f6261-3694-48af-9f0e-34045dcd16c3 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:05.283834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f6261-3694-48af-9f0e-34045dcd16c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:05.284104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f6261-3694-48af-9f0e-34045dcd16c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:05.285333 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f6261-3694-48af-9f0e-34045dcd16c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:05.285636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f6261-3694-48af-9f0e-34045dcd16c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:05.285912 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6240598-c113-4caa-acec-de32f213a0cb None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:05.287007 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f6261-3694-48af-9f0e-34045dcd16c3 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:05.298964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 274/575] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:05.299729 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f6261-3694-48af-9f0e-34045dcd16c3 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:05.323797 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525d810-3f05-49fa-9c9e-0d451634f8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:05.324497 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525d810-3f05-49fa-9c9e-0d451634f8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:05.324782 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525d810-3f05-49fa-9c9e-0d451634f8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:05.325079 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525d810-3f05-49fa-9c9e-0d451634f8f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:05.335640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2525d810-3f05-49fa-9c9e-0d451634f8f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:18:05.341707 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-2525d810-3f05-49fa-9c9e-0d451634f8f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:05.341707 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:05.341707 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:05.341707 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:05.341707 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:05.341707 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:05.341707 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:05.341707 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:05.341707 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:05.341707 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:05.341707 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:05.341707 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:05.341707 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:18:05.341707 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:18:05.341707 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:18:05.341707 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:18:05.342746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:18:05.342746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:18:05.342746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:18:05.342746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:18:05.342746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:05.342746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:05.342746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:05.342746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:05.342746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:05.342746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:05.342746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:05.342746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:05.342746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:05.342746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:05.342746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:05.342746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:05.343936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:05.343936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:05.343936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:05.343936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:05.343936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:18:05.343936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:18:05.343936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:18:05.343936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:18:05.343936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:18:05.343936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:18:05.343936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:05.343936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:05.343936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 302/576] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 9 02:18:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:05.343936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525d810-3f05-49fa-9c9e-0d451634f8f0 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:05.400167 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f6261-3694-48af-9f0e-34045dcd16c3 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:05.433410 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42ce22-81e4-4116-820f-8772c4821fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:05.434008 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42ce22-81e4-4116-820f-8772c4821fdb None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:05.434287 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42ce22-81e4-4116-820f-8772c4821fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:05.434557 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42ce22-81e4-4116-820f-8772c4821fdb None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:05.435195 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42ce22-81e4-4116-820f-8772c4821fdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:05.435506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42ce22-81e4-4116-820f-8772c4821fdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:05.435928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:05.436858 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42ce22-81e4-4116-820f-8772c4821fdb None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:05.442600 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525d810-3f05-49fa-9c9e-0d451634f8f0 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:05.447989 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 275/577] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:05.448771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42ce22-81e4-4116-820f-8772c4821fdb None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:05.480921 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f9cde-7392-423a-b28e-69d0ea687df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:05.481548 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f9cde-7392-423a-b28e-69d0ea687df3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:05.481834 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f9cde-7392-423a-b28e-69d0ea687df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:05.482109 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f9cde-7392-423a-b28e-69d0ea687df3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:05.482831 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f9cde-7392-423a-b28e-69d0ea687df3 None admin] RBAC: Adding query filter params (role.id=d521e5f58e7e4cd48ceed4404113cbd5, scope.project.id=105476dcda7f48c28224d33c05860d6f, user.id=9151f210d29542dcb41ea3bc03390350) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:05.483144 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f9cde-7392-423a-b28e-69d0ea687df3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:05.484569 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f9cde-7392-423a-b28e-69d0ea687df3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:05.489937 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 303/578] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:18:05 2022] GET /identity/v3/role_assignments?user.id=9151f210d29542dcb41ea3bc03390350&scope.project.id=105476dcda7f48c28224d33c05860d6f&role.id=d521e5f58e7e4cd48ceed4404113cbd5 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:05.490802 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f9cde-7392-423a-b28e-69d0ea687df3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:05.495304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:05.558464 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42ce22-81e4-4116-820f-8772c4821fdb None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:05.596313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe45e2-00f4-47d8-8dcf-af1ae9dcd5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:05.597886 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe45e2-00f4-47d8-8dcf-af1ae9dcd5bb None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:05.598320 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe45e2-00f4-47d8-8dcf-af1ae9dcd5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:05.598795 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe45e2-00f4-47d8-8dcf-af1ae9dcd5bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:05.605068 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f9cde-7392-423a-b28e-69d0ea687df3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:05.610946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe45e2-00f4-47d8-8dcf-af1ae9dcd5bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:05.612479 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe45e2-00f4-47d8-8dcf-af1ae9dcd5bb None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:05.628522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-9cbe45e2-00f4-47d8-8dcf-af1ae9dcd5bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:05.628522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:05.628522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:05.628522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:05.628522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:05.628522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:05.628522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:05.628522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:05.628522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:05.628522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:05.628522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:05.628522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:05.628522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:05.628522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:05.628522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:05.628522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:05.629880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:05.629880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:05.629880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:05.629880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:05.629880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:05.629880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:05.629880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:05.629880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:05.629880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:05.629880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:05.629880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:05.629880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:05.629880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:05.629880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:05.629880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:05.629880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:05.629880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:05.630758 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:05.630758 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:05.630758 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:05.630758 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 276/579] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:05.630758 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe45e2-00f4-47d8-8dcf-af1ae9dcd5bb None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:05.650954 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60b19d-6ea5-47fe-9091-6b70ceea6a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:05.651626 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60b19d-6ea5-47fe-9091-6b70ceea6a95 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:05.651906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60b19d-6ea5-47fe-9091-6b70ceea6a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:05.652178 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60b19d-6ea5-47fe-9091-6b70ceea6a95 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:05.660677 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60b19d-6ea5-47fe-9091-6b70ceea6a95 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:05.662167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60b19d-6ea5-47fe-9091-6b70ceea6a95 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:05.673944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-3c60b19d-6ea5-47fe-9091-6b70ceea6a95 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 02:18:05.673944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:05.673944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:05.673944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:05.673944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:05.673944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:05.673944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:05.673944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:05.673944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:05.673944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:05.673944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:05.673944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:05.673944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:18:05.673944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:18:05.673944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:18:05.673944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:18:05.674917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:05.674917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:05.674917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:18:05.674917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:05.674917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:18:05.674917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:05.674917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:05.674917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:05.674917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:05.674917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:05.674917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:05.674917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:05.674917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:05.674917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:05.674917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:05.674917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:05.674917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:05.674917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:05.675879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:05.675879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:05.675879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:18:05.675879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:18:05.675879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:18:05.675879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:18:05.675879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:18:05.675879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:18:05.675879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 02:18:05.675879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:05.679967 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 304/580] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:18:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:05.680770 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60b19d-6ea5-47fe-9091-6b70ceea6a95 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:05.703063 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:05.740042 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:05.744832 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe45e2-00f4-47d8-8dcf-af1ae9dcd5bb None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:05.787579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfc39f-9ffa-4f25-94fc-c9968a70a119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:05.788205 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfc39f-9ffa-4f25-94fc-c9968a70a119 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:05.788486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfc39f-9ffa-4f25-94fc-c9968a70a119 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:05.788762 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfc39f-9ffa-4f25-94fc-c9968a70a119 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:05.789498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cfc39f-9ffa-4f25-94fc-c9968a70a119 None admin] RBAC: Adding query filter params (name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:05.789805 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cfc39f-9ffa-4f25-94fc-c9968a70a119 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:05.791178 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cfc39f-9ffa-4f25-94fc-c9968a70a119 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:05.793975 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60b19d-6ea5-47fe-9091-6b70ceea6a95 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:05.799486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 277/581] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 9 02:18:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:05.800338 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfc39f-9ffa-4f25-94fc-c9968a70a119 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:05.834736 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1e245-3bc6-4766-9e33-19541361fec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:05.835294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1e245-3bc6-4766-9e33-19541361fec7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:05.835578 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1e245-3bc6-4766-9e33-19541361fec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:05.835858 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1e245-3bc6-4766-9e33-19541361fec7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:05.842685 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1e245-3bc6-4766-9e33-19541361fec7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:05.844135 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1e245-3bc6-4766-9e33-19541361fec7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:05.855449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-13d1e245-3bc6-4766-9e33-19541361fec7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:05.855449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:05.855449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:05.855449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:05.855449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:05.855449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:05.855449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:05.855449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:05.855449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:05.855449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:05.855449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:05.855449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:05.855449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:05.855449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:05.855449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:05.856481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:05.856481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:05.856481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:05.856481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:05.856481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:05.856481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:05.856481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:05.856481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:05.856481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:05.856481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:05.856481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:05.856481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:05.856481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:05.856481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:05.856481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:05.856481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:05.856481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:05.857814 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:05.857814 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:05.857814 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:05.857814 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:05.857814 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:05.857814 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:05.857814 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:05.857814 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:05.857814 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 305/582] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:05.857814 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1e245-3bc6-4766-9e33-19541361fec7 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:05.915198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfc39f-9ffa-4f25-94fc-c9968a70a119 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:05.947002 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:05.950499 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72debea-27b6-44b9-a9dc-b06a11743f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:05.951152 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72debea-27b6-44b9-a9dc-b06a11743f09 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:05.951440 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72debea-27b6-44b9-a9dc-b06a11743f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:05.951716 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72debea-27b6-44b9-a9dc-b06a11743f09 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:05.952461 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72debea-27b6-44b9-a9dc-b06a11743f09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:05.952772 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72debea-27b6-44b9-a9dc-b06a11743f09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:05.954280 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72debea-27b6-44b9-a9dc-b06a11743f09 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:05.966943 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 278/583] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:05.967747 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72debea-27b6-44b9-a9dc-b06a11743f09 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:05.973909 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1e245-3bc6-4766-9e33-19541361fec7 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:05.995988 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:06.012762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611836fa-96d9-47d0-9f95-5c50f9089521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:06.013396 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611836fa-96d9-47d0-9f95-5c50f9089521 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:06.013677 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611836fa-96d9-47d0-9f95-5c50f9089521 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:06.013946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611836fa-96d9-47d0-9f95-5c50f9089521 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:06.014673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611836fa-96d9-47d0-9f95-5c50f9089521 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:06.014978 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611836fa-96d9-47d0-9f95-5c50f9089521 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:06.016426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611836fa-96d9-47d0-9f95-5c50f9089521 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:06.039156 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 306/584] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 9 02:18:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:06.039156 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611836fa-96d9-47d0-9f95-5c50f9089521 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:06.083398 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72debea-27b6-44b9-a9dc-b06a11743f09 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:06.122176 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1afc72a-6489-4aba-acef-ecb0e685bb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:06.122724 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afc72a-6489-4aba-acef-ecb0e685bb71 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:06.122999 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afc72a-6489-4aba-acef-ecb0e685bb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:06.123265 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afc72a-6489-4aba-acef-ecb0e685bb71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:06.134315 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1afc72a-6489-4aba-acef-ecb0e685bb71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:06.135759 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1afc72a-6489-4aba-acef-ecb0e685bb71 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:06.148261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611836fa-96d9-47d0-9f95-5c50f9089521 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:06.150206 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-c1afc72a-6489-4aba-acef-ecb0e685bb71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:06.150206 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:06.150206 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:06.150206 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:06.150206 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:06.150206 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:06.150206 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:06.150206 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:06.150206 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:06.150206 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:06.150206 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:06.150206 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:06.150206 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:06.150206 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:06.150206 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:06.150206 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:06.151110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:06.151110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:06.151110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:06.151110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:06.151110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:06.151110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:06.151110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:06.151110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:06.151110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:06.151110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:06.151110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:06.151110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:06.151110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:06.151110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:06.151110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:06.151110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:06.151110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:06.151969 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:06.151969 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:06.151969 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:06.151969 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 279/585] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:06.152571 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1afc72a-6489-4aba-acef-ecb0e685bb71 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:06.188727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1b6a0-db1d-4b3f-925c-e013cc90f4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:06.189352 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1b6a0-db1d-4b3f-925c-e013cc90f4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:06.189637 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1b6a0-db1d-4b3f-925c-e013cc90f4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:06.189904 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1b6a0-db1d-4b3f-925c-e013cc90f4e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:06.191266 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1b6a0-db1d-4b3f-925c-e013cc90f4e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:06.191576 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1b6a0-db1d-4b3f-925c-e013cc90f4e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:06.193008 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1b6a0-db1d-4b3f-925c-e013cc90f4e7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:06.200132 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:06.206145 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 307/586] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:06.207037 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1b6a0-db1d-4b3f-925c-e013cc90f4e7 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:06.231233 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:06.264906 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1afc72a-6489-4aba-acef-ecb0e685bb71 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:06.301822 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9020d-31df-494d-aae6-31a18d227f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:06.302458 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9020d-31df-494d-aae6-31a18d227f80 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:06.302741 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9020d-31df-494d-aae6-31a18d227f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:06.303015 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9020d-31df-494d-aae6-31a18d227f80 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:06.310499 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9020d-31df-494d-aae6-31a18d227f80 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:06.311949 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9020d-31df-494d-aae6-31a18d227f80 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:06.320636 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1b6a0-db1d-4b3f-925c-e013cc90f4e7 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:06.323711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-43f9020d-31df-494d-aae6-31a18d227f80 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 09 02:18:06.323711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:06.323711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:06.323711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:06.323711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:06.323711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:06.323711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:06.323711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:06.323711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:06.323711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:06.323711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:06.323711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:06.323711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:18:06.323711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:18:06.323711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:18:06.323711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:18:06.324616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:06.324616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:06.324616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:18:06.324616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:06.324616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:18:06.324616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:06.324616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:06.324616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:06.324616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:06.324616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:06.324616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:06.324616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:06.324616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:06.324616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:06.324616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:06.324616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:06.324616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:06.324616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:06.325554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:06.325554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:06.325554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:18:06.325554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:18:06.325554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:18:06.325554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:18:06.325554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:18:06.325554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:18:06.325554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 09 02:18:06.325554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:06.329509 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 280/587] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:18:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:06.330397 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9020d-31df-494d-aae6-31a18d227f80 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:06.355699 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1d537-0e33-4ced-9f6e-ca4e080c7d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:06.356333 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1d537-0e33-4ced-9f6e-ca4e080c7d0d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:06.356617 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1d537-0e33-4ced-9f6e-ca4e080c7d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:06.356893 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1d537-0e33-4ced-9f6e-ca4e080c7d0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:06.369070 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b1d537-0e33-4ced-9f6e-ca4e080c7d0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:06.370518 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b1d537-0e33-4ced-9f6e-ca4e080c7d0d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:06.385360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-40b1d537-0e33-4ced-9f6e-ca4e080c7d0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:06.385360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:06.385360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:06.385360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:06.385360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:06.385360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:06.385360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:06.385360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:06.385360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:06.385360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:06.385360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:06.385360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:06.385360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:06.385360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:06.385360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:06.385360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:06.386311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:06.386311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:06.386311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:06.386311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:06.386311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:06.386311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:06.386311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:06.386311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:06.386311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:06.386311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:06.386311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:06.386311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:06.386311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:06.386311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:06.386311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:06.386311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:06.386311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:06.387179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:06.387179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:06.387179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:06.387179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 308/588] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:06.388271 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1d537-0e33-4ced-9f6e-ca4e080c7d0d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:06.442833 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9020d-31df-494d-aae6-31a18d227f80 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:06.443475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:06.474161 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:06.481677 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68658f72-f60c-46b0-9776-b0fecb253197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:06.482292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68658f72-f60c-46b0-9776-b0fecb253197 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:06.482576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68658f72-f60c-46b0-9776-b0fecb253197 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:06.482851 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68658f72-f60c-46b0-9776-b0fecb253197 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:06.483561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68658f72-f60c-46b0-9776-b0fecb253197 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:06.483866 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68658f72-f60c-46b0-9776-b0fecb253197 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:06.485322 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68658f72-f60c-46b0-9776-b0fecb253197 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:06.502689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1d537-0e33-4ced-9f6e-ca4e080c7d0d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:06.502885 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 281/589] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:06.502885 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68658f72-f60c-46b0-9776-b0fecb253197 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:06.538935 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dabca7-3270-473f-bd75-25fd000395b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:06.539590 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dabca7-3270-473f-bd75-25fd000395b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:06.539873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dabca7-3270-473f-bd75-25fd000395b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:06.540147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dabca7-3270-473f-bd75-25fd000395b8 None admin] PATH_INFO: `/v3/projects/105476dcda7f48c28224d33c05860d6f/users/78fff294b9794a26aa1bbc231fa1133c/roles/d521e5f58e7e4cd48ceed4404113cbd5` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:06.559262 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dabca7-3270-473f-bd75-25fd000395b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=105476dcda7f48c28224d33c05860d6f, user_id=78fff294b9794a26aa1bbc231fa1133c, role_id=d521e5f58e7e4cd48ceed4404113cbd5)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:06.561003 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dabca7-3270-473f-bd75-25fd000395b8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:06.577579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 309/590] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 9 02:18:06 2022] PUT /identity/v3/projects/105476dcda7f48c28224d33c05860d6f/users/78fff294b9794a26aa1bbc231fa1133c/roles/d521e5f58e7e4cd48ceed4404113cbd5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:18:06.578049 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dabca7-3270-473f-bd75-25fd000395b8 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:06.616340 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68658f72-f60c-46b0-9776-b0fecb253197 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:06.657087 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba2288-7246-4f6d-beb2-c85cf09f4fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:06.657796 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba2288-7246-4f6d-beb2-c85cf09f4fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:06.658179 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba2288-7246-4f6d-beb2-c85cf09f4fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:06.658555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba2288-7246-4f6d-beb2-c85cf09f4fc8 None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:06.660069 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba2288-7246-4f6d-beb2-c85cf09f4fc8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:06.660507 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba2288-7246-4f6d-beb2-c85cf09f4fc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:06.662242 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba2288-7246-4f6d-beb2-c85cf09f4fc8 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:06.688452 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 282/591] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 9 02:18:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:06.689577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba2288-7246-4f6d-beb2-c85cf09f4fc8 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:06.704468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:06.709283 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dabca7-3270-473f-bd75-25fd000395b8 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:06.753285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18f15d-b26f-4fa1-9662-a6dc49740c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:06.754182 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18f15d-b26f-4fa1-9662-a6dc49740c52 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:06.754757 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18f15d-b26f-4fa1-9662-a6dc49740c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:06.755192 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18f15d-b26f-4fa1-9662-a6dc49740c52 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:06.756052 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18f15d-b26f-4fa1-9662-a6dc49740c52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:06.756363 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18f15d-b26f-4fa1-9662-a6dc49740c52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:06.757796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18f15d-b26f-4fa1-9662-a6dc49740c52 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:06.759364 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:06.773278 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 310/592] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:06.774500 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18f15d-b26f-4fa1-9662-a6dc49740c52 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:06.822024 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba2288-7246-4f6d-beb2-c85cf09f4fc8 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:06.861535 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecd327-80f1-4db1-8593-edb29d967965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:06.862320 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecd327-80f1-4db1-8593-edb29d967965 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:06.862714 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecd327-80f1-4db1-8593-edb29d967965 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:06.862996 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecd327-80f1-4db1-8593-edb29d967965 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:06.870861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fecd327-80f1-4db1-8593-edb29d967965 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:06.872432 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fecd327-80f1-4db1-8593-edb29d967965 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:06.884782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-0fecd327-80f1-4db1-8593-edb29d967965 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 02:18:06.884782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:06.884782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:06.884782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:06.884782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:06.884782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:06.884782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:06.884782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:06.884782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:06.884782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:06.884782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:06.884782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:06.884782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:18:06.884782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:18:06.884782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:18:06.884782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:18:06.885745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:06.885745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:06.885745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:18:06.885745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:06.885745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:18:06.885745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:06.885745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:06.885745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:06.885745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:06.885745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:06.885745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:06.885745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:06.885745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:06.885745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:06.885745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:06.885745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:06.885745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:06.885745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:06.887093 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:06.887093 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:06.887093 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:18:06.887093 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:18:06.887093 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:18:06.887093 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:18:06.887093 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:18:06.887093 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:18:06.887093 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 02:18:06.887093 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:06.887093 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 283/593] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 9 02:18:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:06.887093 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecd327-80f1-4db1-8593-edb29d967965 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:06.895063 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18f15d-b26f-4fa1-9662-a6dc49740c52 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:06.932034 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5ecd0-58c7-4e5e-a1d4-f105724ff369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:06.932591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5ecd0-58c7-4e5e-a1d4-f105724ff369 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:06.932873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5ecd0-58c7-4e5e-a1d4-f105724ff369 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:06.933171 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5ecd0-58c7-4e5e-a1d4-f105724ff369 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:06.945778 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5ecd0-58c7-4e5e-a1d4-f105724ff369 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:06.947259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5ecd0-58c7-4e5e-a1d4-f105724ff369 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:06.963299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-96b5ecd0-58c7-4e5e-a1d4-f105724ff369 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:06.963299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:06.963299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:06.963299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:06.963299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:06.963299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:06.963299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:06.963299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:06.963299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:06.963299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:06.963299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:06.963299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:06.963299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:06.963299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:06.963299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:06.963299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:06.965799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:06.965799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:06.965799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:06.965799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:06.965799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:06.965799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:06.965799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:06.965799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:06.965799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:06.965799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:06.965799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:06.965799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:06.965799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:06.965799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:06.965799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:06.965799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:06.965799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:06.967901 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:06.967901 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:06.967901 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:06.967901 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 311/594] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:06.967901 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5ecd0-58c7-4e5e-a1d4-f105724ff369 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:06.984207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:07.008740 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecd327-80f1-4db1-8593-edb29d967965 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:07.020164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:07.045102 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45225e-3857-4b23-a203-74173877c427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:07.045744 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45225e-3857-4b23-a203-74173877c427 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:07.046024 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45225e-3857-4b23-a203-74173877c427 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:07.046300 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45225e-3857-4b23-a203-74173877c427 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:07.053325 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45225e-3857-4b23-a203-74173877c427 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:07.054846 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45225e-3857-4b23-a203-74173877c427 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:07.066567 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-ad45225e-3857-4b23-a203-74173877c427 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:07.066567 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:07.066567 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:07.066567 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:07.066567 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:07.066567 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:07.066567 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:07.066567 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:07.066567 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:07.066567 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:07.066567 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:07.066567 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:07.066567 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:07.066567 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:07.066567 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:07.067656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:07.067656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:07.067656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:07.067656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:07.067656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:07.067656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:07.067656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:07.067656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:07.067656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:07.067656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:07.067656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:07.067656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:07.067656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:07.067656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:07.067656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:07.067656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:07.067656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:07.068730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:07.068730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:07.068730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:07.068730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:07.068730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:07.068730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:07.068730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:07.068730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:07.072348 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 284/595] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:07.073237 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45225e-3857-4b23-a203-74173877c427 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:07.087744 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5ecd0-58c7-4e5e-a1d4-f105724ff369 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:07.126465 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9765da-63d9-41eb-8008-1adcf13bf7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:07.127320 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9765da-63d9-41eb-8008-1adcf13bf7dc None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:07.127774 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9765da-63d9-41eb-8008-1adcf13bf7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:07.128259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9765da-63d9-41eb-8008-1adcf13bf7dc None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:07.129333 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9765da-63d9-41eb-8008-1adcf13bf7dc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:07.129788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9765da-63d9-41eb-8008-1adcf13bf7dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:07.131463 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9765da-63d9-41eb-8008-1adcf13bf7dc None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:07.151357 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 312/596] 10.222.0.16 () {56 vars in 1139 bytes} [Tue Aug 9 02:18:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:07.152497 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9765da-63d9-41eb-8008-1adcf13bf7dc None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:07.182601 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45225e-3857-4b23-a203-74173877c427 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:07.217746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32eb3c3-1920-4c41-abb9-3c5e8caf393b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:07.218358 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32eb3c3-1920-4c41-abb9-3c5e8caf393b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:07.218643 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32eb3c3-1920-4c41-abb9-3c5e8caf393b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:07.218919 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32eb3c3-1920-4c41-abb9-3c5e8caf393b None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:07.219564 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32eb3c3-1920-4c41-abb9-3c5e8caf393b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:07.219871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32eb3c3-1920-4c41-abb9-3c5e8caf393b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:07.221340 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32eb3c3-1920-4c41-abb9-3c5e8caf393b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:07.234013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 285/597] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:07.234823 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32eb3c3-1920-4c41-abb9-3c5e8caf393b None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:07.235719 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:07.265507 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:07.276956 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9765da-63d9-41eb-8008-1adcf13bf7dc None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:07.314604 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40ae9c-d695-4097-bdb1-af5f18658a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:07.316155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40ae9c-d695-4097-bdb1-af5f18658a32 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:07.316582 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40ae9c-d695-4097-bdb1-af5f18658a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:07.317001 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40ae9c-d695-4097-bdb1-af5f18658a32 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:07.318332 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40ae9c-d695-4097-bdb1-af5f18658a32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:07.318809 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40ae9c-d695-4097-bdb1-af5f18658a32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:07.320496 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40ae9c-d695-4097-bdb1-af5f18658a32 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:07.334882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 313/598] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:07.335936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40ae9c-d695-4097-bdb1-af5f18658a32 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:07.345106 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32eb3c3-1920-4c41-abb9-3c5e8caf393b None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:07.393525 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd703ec3-0a14-4967-a726-588840a9c2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:07.395503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd703ec3-0a14-4967-a726-588840a9c2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:07.396044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd703ec3-0a14-4967-a726-588840a9c2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:07.396466 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd703ec3-0a14-4967-a726-588840a9c2c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:07.410297 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd703ec3-0a14-4967-a726-588840a9c2c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:07.412503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd703ec3-0a14-4967-a726-588840a9c2c0 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:07.431230 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-bd703ec3-0a14-4967-a726-588840a9c2c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:07.431230 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:07.431230 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:07.431230 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:07.431230 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:07.431230 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:07.431230 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:07.431230 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:07.431230 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:07.431230 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:07.431230 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:07.431230 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:07.431230 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:07.431230 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:07.431230 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:07.431230 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:07.432367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:07.432367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:07.432367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:07.432367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:07.432367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:07.432367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:07.432367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:07.432367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:07.432367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:07.432367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:07.432367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:07.432367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:07.432367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:07.432367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:07.432367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:07.432367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:07.432367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:07.433533 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:07.433533 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:07.433533 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:07.439872 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 286/599] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:07.439872 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd703ec3-0a14-4967-a726-588840a9c2c0 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:07.469000 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40ae9c-d695-4097-bdb1-af5f18658a32 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:07.500720 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:07.509289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb863b8-c59a-49dd-9012-d72eadb7fba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:07.510215 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb863b8-c59a-49dd-9012-d72eadb7fba0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:07.510634 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb863b8-c59a-49dd-9012-d72eadb7fba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:07.511076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb863b8-c59a-49dd-9012-d72eadb7fba0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:07.518277 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb863b8-c59a-49dd-9012-d72eadb7fba0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:07.520291 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb863b8-c59a-49dd-9012-d72eadb7fba0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:07.528211 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:07.532097 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-1eb863b8-c59a-49dd-9012-d72eadb7fba0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:07.532097 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:07.532097 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:07.532097 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:07.532097 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:07.532097 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:07.532097 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:07.532097 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:07.532097 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:07.532097 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:07.532097 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:07.532097 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:07.532097 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:07.532097 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:07.532097 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:07.533553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:07.533553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:07.533553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:07.533553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:07.533553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:07.533553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:07.533553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:07.533553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:07.533553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:07.533553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:07.533553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:07.533553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:07.533553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:07.533553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:07.533553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:07.533553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:07.533553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:07.534678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:07.534678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:07.534678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:07.534678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:07.534678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:07.534678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:07.534678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:07.534678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:07.534678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 314/600] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:07.534678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb863b8-c59a-49dd-9012-d72eadb7fba0 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:07.552179 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd703ec3-0a14-4967-a726-588840a9c2c0 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:07.592028 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236480c-ccef-4e7b-999c-85b5d917aa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:07.593355 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236480c-ccef-4e7b-999c-85b5d917aa1f None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:07.594033 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236480c-ccef-4e7b-999c-85b5d917aa1f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:07.594466 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236480c-ccef-4e7b-999c-85b5d917aa1f None admin] PATH_INFO: `/v3/projects/105476dcda7f48c28224d33c05860d6f/users/9500a1b1de2344f78580bed52cc302a2/roles/d521e5f58e7e4cd48ceed4404113cbd5` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:07.615140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236480c-ccef-4e7b-999c-85b5d917aa1f None admin] RBAC: Authorizing `identity:create_grant(project_id=105476dcda7f48c28224d33c05860d6f, user_id=9500a1b1de2344f78580bed52cc302a2, role_id=d521e5f58e7e4cd48ceed4404113cbd5)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:07.617838 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236480c-ccef-4e7b-999c-85b5d917aa1f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:07.640638 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb863b8-c59a-49dd-9012-d72eadb7fba0 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:07.641115 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 287/601] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 9 02:18:07 2022] PUT /identity/v3/projects/105476dcda7f48c28224d33c05860d6f/users/9500a1b1de2344f78580bed52cc302a2/roles/d521e5f58e7e4cd48ceed4404113cbd5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:18:07.642690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427f0df-5d92-4688-bb68-1042560a2b5c None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:07.643102 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427f0df-5d92-4688-bb68-1042560a2b5c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:07.643497 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427f0df-5d92-4688-bb68-1042560a2b5c None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:07.645186 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 288/602] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:07.645988 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427f0df-5d92-4688-bb68-1042560a2b5c None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:07.697894 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d95fd-ce9f-41f0-b745-48e42aa64866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:07.699835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d95fd-ce9f-41f0-b745-48e42aa64866 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:07.700303 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d95fd-ce9f-41f0-b745-48e42aa64866 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:07.700722 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d95fd-ce9f-41f0-b745-48e42aa64866 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:07.701668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d95fd-ce9f-41f0-b745-48e42aa64866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:07.702153 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d95fd-ce9f-41f0-b745-48e42aa64866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:07.703825 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d95fd-ce9f-41f0-b745-48e42aa64866 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:07.718768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 315/603] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:07.720187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879f299-ff9c-40f3-8f75-17fa132dd13b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:07.720481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879f299-ff9c-40f3-8f75-17fa132dd13b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:07.720757 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879f299-ff9c-40f3-8f75-17fa132dd13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:07.742841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7879f299-ff9c-40f3-8f75-17fa132dd13b None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:07.743773 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7879f299-ff9c-40f3-8f75-17fa132dd13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:07.777573 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427f0df-5d92-4688-bb68-1042560a2b5c None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:07.810878 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:07.820553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc3772-3b18-46bf-8c65-3f951bdd2ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:07.821387 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc3772-3b18-46bf-8c65-3f951bdd2ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:07.822005 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc3772-3b18-46bf-8c65-3f951bdd2ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:07.822311 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc3772-3b18-46bf-8c65-3f951bdd2ee7 None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:07.822599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:07.823244 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc3772-3b18-46bf-8c65-3f951bdd2ee7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:07.823671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc3772-3b18-46bf-8c65-3f951bdd2ee7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:07.825816 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc3772-3b18-46bf-8c65-3f951bdd2ee7 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:07.832988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 316/604] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:18:07.833745 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879f299-ff9c-40f3-8f75-17fa132dd13b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:07.839752 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 289/605] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:07.845526 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc3772-3b18-46bf-8c65-3f951bdd2ee7 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:07.957588 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc3772-3b18-46bf-8c65-3f951bdd2ee7 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:07.981700 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879f299-ff9c-40f3-8f75-17fa132dd13b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:07.997773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba3f29-390c-4805-a9dd-8dd0a73d6bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:07.998668 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba3f29-390c-4805-a9dd-8dd0a73d6bd6 None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:07.999096 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba3f29-390c-4805-a9dd-8dd0a73d6bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:07.999517 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba3f29-390c-4805-a9dd-8dd0a73d6bd6 None admin] PATH_INFO: `/v3/projects/105476dcda7f48c28224d33c05860d6f/users/63645a88f5924a57b5b828aacd856902/roles/d521e5f58e7e4cd48ceed4404113cbd5` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:08.018378 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba3f29-390c-4805-a9dd-8dd0a73d6bd6 None admin] RBAC: Authorizing `identity:create_grant(project_id=105476dcda7f48c28224d33c05860d6f, user_id=63645a88f5924a57b5b828aacd856902, role_id=d521e5f58e7e4cd48ceed4404113cbd5)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:08.020708 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba3f29-390c-4805-a9dd-8dd0a73d6bd6 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:08.025045 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078541c4-30d1-40f5-9d77-1ce959bb4678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:08.026096 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078541c4-30d1-40f5-9d77-1ce959bb4678 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:08.026542 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078541c4-30d1-40f5-9d77-1ce959bb4678 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:08.027034 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078541c4-30d1-40f5-9d77-1ce959bb4678 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:08.037628 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078541c4-30d1-40f5-9d77-1ce959bb4678 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:08.039277 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078541c4-30d1-40f5-9d77-1ce959bb4678 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:08.040121 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 290/606] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 9 02:18:07 2022] PUT /identity/v3/projects/105476dcda7f48c28224d33c05860d6f/users/63645a88f5924a57b5b828aacd856902/roles/d521e5f58e7e4cd48ceed4404113cbd5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:18:08.041223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba3f29-390c-4805-a9dd-8dd0a73d6bd6 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:08.069660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-078541c4-30d1-40f5-9d77-1ce959bb4678 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:08.069660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:08.069660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:08.069660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:08.069660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:08.069660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:08.069660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:08.069660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:08.069660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:08.069660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:08.069660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:08.069660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:08.069660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:08.069660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:08.069660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:08.070810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:08.070810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:08.070810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:08.070810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:08.070810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:08.070810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:08.070810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:08.070810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:08.070810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:08.070810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:08.070810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:08.070810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:08.070810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:08.070810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:08.070810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:08.070810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:08.070810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:08.071878 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:08.071878 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:08.071878 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:08.071878 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:08.071878 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:08.071878 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:08.071878 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:08.071878 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:08.075336 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 317/607] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:08.081393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078541c4-30d1-40f5-9d77-1ce959bb4678 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:08.137404 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:08.170473 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:08.259448 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba3f29-390c-4805-a9dd-8dd0a73d6bd6 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:08.265854 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078541c4-30d1-40f5-9d77-1ce959bb4678 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:08.300762 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee5001-85df-453d-bab8-3ab1a859c06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:08.301570 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee5001-85df-453d-bab8-3ab1a859c06a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:08.301970 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee5001-85df-453d-bab8-3ab1a859c06a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:08.302331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee5001-85df-453d-bab8-3ab1a859c06a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:08.308927 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5271c0-4cac-4feb-ab6e-f7c5029b4fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:08.309733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5271c0-4cac-4feb-ab6e-f7c5029b4fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:08.310487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5271c0-4cac-4feb-ab6e-f7c5029b4fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:08.311273 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5271c0-4cac-4feb-ab6e-f7c5029b4fc4 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:08.312162 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5271c0-4cac-4feb-ab6e-f7c5029b4fc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:08.312609 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5271c0-4cac-4feb-ab6e-f7c5029b4fc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:08.314068 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee5001-85df-453d-bab8-3ab1a859c06a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:18:08.314738 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5271c0-4cac-4feb-ab6e-f7c5029b4fc4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:08.319582 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-abee5001-85df-453d-bab8-3ab1a859c06a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:08.319582 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:08.319582 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:08.319582 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:08.319582 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:08.319582 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:08.319582 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:08.319582 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:08.319582 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:08.319582 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:08.319582 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:08.319582 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:08.319582 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:18:08.319582 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:18:08.319582 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:18:08.319582 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:18:08.320687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:18:08.320687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:18:08.320687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:18:08.320687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:18:08.320687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:08.320687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:08.320687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:08.320687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:08.320687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:08.320687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:08.320687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:08.320687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:08.320687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:08.320687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:08.320687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:08.320687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:08.321791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:08.321791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:08.321791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:08.321791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:08.321791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:18:08.321791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:18:08.321791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:18:08.321791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:18:08.321791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:18:08.321791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:18:08.321791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:08.321791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:08.329351 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 291/608] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 9 02:18:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:08.330313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee5001-85df-453d-bab8-3ab1a859c06a None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:08.333057 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 318/609] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:08.341972 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5271c0-4cac-4feb-ab6e-f7c5029b4fc4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:08.457585 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:08.460601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5271c0-4cac-4feb-ab6e-f7c5029b4fc4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:08.500367 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfc93f-2be9-4558-ad7e-c3e9583530af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:08.501236 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfc93f-2be9-4558-ad7e-c3e9583530af None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:08.501653 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfc93f-2be9-4558-ad7e-c3e9583530af None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:08.502168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfc93f-2be9-4558-ad7e-c3e9583530af None admin] PATH_INFO: `/v3/projects/105476dcda7f48c28224d33c05860d6f/users/d608fede6f5e4b339f8de0354cc0562b/roles/d521e5f58e7e4cd48ceed4404113cbd5` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:08.525355 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfc93f-2be9-4558-ad7e-c3e9583530af None admin] RBAC: Authorizing `identity:create_grant(project_id=105476dcda7f48c28224d33c05860d6f, user_id=d608fede6f5e4b339f8de0354cc0562b, role_id=d521e5f58e7e4cd48ceed4404113cbd5)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:08.528427 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccfc93f-2be9-4558-ad7e-c3e9583530af None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:08.557579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 319/610] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 9 02:18:08 2022] PUT /identity/v3/projects/105476dcda7f48c28224d33c05860d6f/users/d608fede6f5e4b339f8de0354cc0562b/roles/d521e5f58e7e4cd48ceed4404113cbd5 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:18:08.564946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee5001-85df-453d-bab8-3ab1a859c06a None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:08.567585 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:08.605667 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0d40b-f724-4a08-a7b8-425b4a954c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:08.606583 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0d40b-f724-4a08-a7b8-425b4a954c93 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:08.607067 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0d40b-f724-4a08-a7b8-425b4a954c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:08.607449 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0d40b-f724-4a08-a7b8-425b4a954c93 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:08.608401 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0d40b-f724-4a08-a7b8-425b4a954c93 None admin] RBAC: Adding query filter params (name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:08.608822 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0d40b-f724-4a08-a7b8-425b4a954c93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:08.610516 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0d40b-f724-4a08-a7b8-425b4a954c93 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:08.621467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 292/611] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 9 02:18:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:08.627369 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfc93f-2be9-4558-ad7e-c3e9583530af None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:08.747989 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccfc93f-2be9-4558-ad7e-c3e9583530af None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:08.756390 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082c85d-9bb5-4147-a011-24591e16249d None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:08.756679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082c85d-9bb5-4147-a011-24591e16249d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:08.756955 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082c85d-9bb5-4147-a011-24591e16249d None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:08.759740 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 293/612] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:08.763842 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec83b86-58fd-4eb5-ac74-5c4c69fa8551 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:08.764127 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec83b86-58fd-4eb5-ac74-5c4c69fa8551 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:08.764404 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec83b86-58fd-4eb5-ac74-5c4c69fa8551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:08.786666 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-5ec83b86-58fd-4eb5-ac74-5c4c69fa8551 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:08.787543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9f3bb-0eb7-4689-a9fb-4671ec26644d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:08.787897 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5ec83b86-58fd-4eb5-ac74-5c4c69fa8551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:08.788588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9f3bb-0eb7-4689-a9fb-4671ec26644d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:08.789127 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9f3bb-0eb7-4689-a9fb-4671ec26644d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:08.789572 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9f3bb-0eb7-4689-a9fb-4671ec26644d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:08.801291 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9f3bb-0eb7-4689-a9fb-4671ec26644d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:08.803429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9f3bb-0eb7-4689-a9fb-4671ec26644d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:08.828119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-7ea9f3bb-0eb7-4689-a9fb-4671ec26644d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:08.828119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:08.828119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:08.828119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:08.828119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:08.828119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:08.828119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:08.828119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:08.828119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:08.828119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:08.828119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:08.828119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:08.828119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:08.828119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:08.828119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:08.828119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:08.829444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:08.829444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:08.829444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:08.829444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:08.829444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:08.829444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:08.829444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:08.829444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:08.829444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:08.829444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:08.829444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:08.829444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:08.829444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:08.829444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:08.829444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:08.829444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:08.829444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:08.830500 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:08.830500 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:08.830500 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:08.832962 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 320/613] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:08.839950 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9f3bb-0eb7-4689-a9fb-4671ec26644d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:08.845547 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:08.903553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 294/614] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 02:18:08.928139 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec83b86-58fd-4eb5-ac74-5c4c69fa8551 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:08.962742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9f3bb-0eb7-4689-a9fb-4671ec26644d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:09.009833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f6efd-ed0d-4133-ba31-ed8455726dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:09.011728 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f6efd-ed0d-4133-ba31-ed8455726dbb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:09.012157 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f6efd-ed0d-4133-ba31-ed8455726dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:09.012574 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f6efd-ed0d-4133-ba31-ed8455726dbb None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:09.013777 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f6efd-ed0d-4133-ba31-ed8455726dbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:09.014279 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f6efd-ed0d-4133-ba31-ed8455726dbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:09.016390 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f6efd-ed0d-4133-ba31-ed8455726dbb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:09.030224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:09.032756 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 321/615] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:09.038333 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f6efd-ed0d-4133-ba31-ed8455726dbb None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:09.043710 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec83b86-58fd-4eb5-ac74-5c4c69fa8551 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:09.080728 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c4125-ef56-46fb-a970-a6a74a18352a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:09.082213 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c4125-ef56-46fb-a970-a6a74a18352a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:09.082628 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c4125-ef56-46fb-a970-a6a74a18352a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:09.083060 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c4125-ef56-46fb-a970-a6a74a18352a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:09.094453 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c4125-ef56-46fb-a970-a6a74a18352a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:18:09.100054 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-629c4125-ef56-46fb-a970-a6a74a18352a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:09.100054 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:09.100054 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:09.100054 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:09.100054 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:09.100054 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:09.100054 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:09.100054 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:09.100054 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:09.100054 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:09.100054 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:09.100054 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:09.100054 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:18:09.100054 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:18:09.100054 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:18:09.100054 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:18:09.101224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:18:09.101224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:18:09.101224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:18:09.101224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:18:09.101224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:09.101224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:09.101224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:09.101224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:09.101224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:09.101224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:09.101224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:09.101224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:09.101224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:09.101224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:09.101224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:09.101224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:09.102253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:09.102253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:09.102253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:09.102253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:09.102253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:18:09.102253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:18:09.102253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:18:09.102253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:18:09.102253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:18:09.102253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:18:09.102253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:09.102253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:09.109082 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 295/616] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 9 02:18:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:09.110423 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c4125-ef56-46fb-a970-a6a74a18352a None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:09.151327 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:09.229409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f6efd-ed0d-4133-ba31-ed8455726dbb None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:09.262083 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c4125-ef56-46fb-a970-a6a74a18352a None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:09.303640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b453250-1900-48df-9c57-6d217e485ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:09.304500 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b453250-1900-48df-9c57-6d217e485ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:09.304945 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b453250-1900-48df-9c57-6d217e485ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:09.306894 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b453250-1900-48df-9c57-6d217e485ce2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:09.321595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b453250-1900-48df-9c57-6d217e485ce2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:09.325183 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b453250-1900-48df-9c57-6d217e485ce2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:09.332421 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5865ce-2837-48be-a64e-1abf9eb4bcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:09.336103 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5865ce-2837-48be-a64e-1abf9eb4bcb2 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:09.336542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5865ce-2837-48be-a64e-1abf9eb4bcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:09.336968 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5865ce-2837-48be-a64e-1abf9eb4bcb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:09.337808 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5865ce-2837-48be-a64e-1abf9eb4bcb2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:09.339270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5865ce-2837-48be-a64e-1abf9eb4bcb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:09.341133 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5865ce-2837-48be-a64e-1abf9eb4bcb2 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:09.351581 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-1b453250-1900-48df-9c57-6d217e485ce2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 02:18:09.351581 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:09.351581 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:09.351581 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:09.351581 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:09.351581 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:09.351581 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:09.351581 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:09.351581 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:09.351581 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:09.351581 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:09.351581 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:09.351581 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:18:09.351581 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:18:09.351581 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:18:09.351581 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:18:09.352712 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:09.352712 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:09.352712 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:18:09.352712 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:09.352712 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:18:09.352712 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:09.352712 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:09.352712 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:09.352712 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:09.352712 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:09.352712 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:09.352712 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:09.352712 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:09.352712 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:09.352712 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:09.352712 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:09.352712 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:09.352712 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:09.353877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:09.353877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:09.353877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:18:09.353877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:18:09.353877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:18:09.353877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:18:09.353877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:18:09.353877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:18:09.353877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 02:18:09.353877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:09.356532 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 322/617] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:18:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:18:09.366176 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b453250-1900-48df-9c57-6d217e485ce2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:09.367041 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 296/618] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 9 02:18:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:18:09.372506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5865ce-2837-48be-a64e-1abf9eb4bcb2 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:09.403460 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:09.542207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b453250-1900-48df-9c57-6d217e485ce2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:09.569216 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5865ce-2837-48be-a64e-1abf9eb4bcb2 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:09.597439 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:09.607423 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0906ac2-8ba9-4157-bedf-26bfa3dc49cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:09.608040 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0906ac2-8ba9-4157-bedf-26bfa3dc49cf None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:09.608322 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0906ac2-8ba9-4157-bedf-26bfa3dc49cf None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:09.608600 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0906ac2-8ba9-4157-bedf-26bfa3dc49cf None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:09.609451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0906ac2-8ba9-4157-bedf-26bfa3dc49cf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:09.609766 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0906ac2-8ba9-4157-bedf-26bfa3dc49cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:09.612800 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0906ac2-8ba9-4157-bedf-26bfa3dc49cf None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:09.630847 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a2257-9bbb-468d-bfd8-b82792bc2313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:09.631560 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a2257-9bbb-468d-bfd8-b82792bc2313 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:09.631845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a2257-9bbb-468d-bfd8-b82792bc2313 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:09.632120 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a2257-9bbb-468d-bfd8-b82792bc2313 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:09.648123 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 323/619] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Aug 9 02:18:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:09.654124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a2257-9bbb-468d-bfd8-b82792bc2313 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:09.655597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a2257-9bbb-468d-bfd8-b82792bc2313 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:09.656847 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0906ac2-8ba9-4157-bedf-26bfa3dc49cf None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:09.671319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-9a5a2257-9bbb-468d-bfd8-b82792bc2313 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:09.671319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:09.671319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:09.671319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:09.671319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:09.671319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:09.671319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:09.671319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:09.671319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:09.671319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:09.671319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:09.671319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:09.671319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:09.671319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:09.671319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:09.671319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:09.672635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:09.672635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:09.672635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:09.672635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:09.672635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:09.672635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:09.672635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:09.672635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:09.672635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:09.672635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:09.672635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:09.672635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:09.672635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:09.672635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:09.672635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:09.672635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:09.672635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:09.673705 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:09.673705 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:09.673705 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:09.673705 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 297/620] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:18:09.684346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a2257-9bbb-468d-bfd8-b82792bc2313 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:09.766334 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0906ac2-8ba9-4157-bedf-26bfa3dc49cf None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:09.801391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:09.809290 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f10e8-c657-41a4-a8bf-0649446e7ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:09.810198 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f10e8-c657-41a4-a8bf-0649446e7ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:09.811169 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f10e8-c657-41a4-a8bf-0649446e7ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:09.811687 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f10e8-c657-41a4-a8bf-0649446e7ac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:09.824985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f10e8-c657-41a4-a8bf-0649446e7ac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:09.826669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f10e8-c657-41a4-a8bf-0649446e7ac8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:09.843436 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-9e4f10e8-c657-41a4-a8bf-0649446e7ac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:09.843436 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:09.843436 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:09.843436 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:09.843436 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:09.843436 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:09.843436 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:09.843436 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:09.843436 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:09.843436 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:09.843436 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:09.843436 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:09.843436 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:09.843436 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:09.843436 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:09.843436 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:09.844601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:09.844601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:09.844601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:09.844601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:09.844601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:09.844601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:09.844601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:09.844601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:09.844601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:09.844601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:09.844601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:09.844601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:09.844601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:09.844601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:09.844601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:09.844601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:09.844601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:09.845535 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:09.845535 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:09.845535 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:09.848303 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 324/621] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:09.854898 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f10e8-c657-41a4-a8bf-0649446e7ac8 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:09.878995 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a2257-9bbb-468d-bfd8-b82792bc2313 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:09.891013 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:09.975341 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f10e8-c657-41a4-a8bf-0649446e7ac8 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:10.005737 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083c258-12a2-41c1-94f2-8070ed78f840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:10.006446 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083c258-12a2-41c1-94f2-8070ed78f840 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:10.006800 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083c258-12a2-41c1-94f2-8070ed78f840 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:10.007152 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083c258-12a2-41c1-94f2-8070ed78f840 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:10.007857 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083c258-12a2-41c1-94f2-8070ed78f840 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:10.008228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083c258-12a2-41c1-94f2-8070ed78f840 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:10.009716 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083c258-12a2-41c1-94f2-8070ed78f840 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:10.021887 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45751e0-fbdf-41a3-9d6e-3286fa0f655e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:10.023109 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45751e0-fbdf-41a3-9d6e-3286fa0f655e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:10.023570 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45751e0-fbdf-41a3-9d6e-3286fa0f655e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:10.024019 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45751e0-fbdf-41a3-9d6e-3286fa0f655e None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:10.024848 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45751e0-fbdf-41a3-9d6e-3286fa0f655e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:10.025347 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45751e0-fbdf-41a3-9d6e-3286fa0f655e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:10.026911 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45751e0-fbdf-41a3-9d6e-3286fa0f655e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:10.036923 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 298/622] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:10.038812 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fbde5-e797-46f1-8b9b-0336c804b4ab None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:10.038812 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fbde5-e797-46f1-8b9b-0336c804b4ab None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:10.038987 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fbde5-e797-46f1-8b9b-0336c804b4ab None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:10.044176 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 299/624] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:10.044411 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 325/624] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:10.049134 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fbde5-e797-46f1-8b9b-0336c804b4ab None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:10.050261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9952a9-92f6-45c2-af1c-356ce6932f23 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:10.050701 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9952a9-92f6-45c2-af1c-356ce6932f23 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:10.051157 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9952a9-92f6-45c2-af1c-356ce6932f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:10.072605 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-6f9952a9-92f6-45c2-af1c-356ce6932f23 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:10.074257 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6f9952a9-92f6-45c2-af1c-356ce6932f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:10.161244 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 326/625] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:18:10.162425 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9952a9-92f6-45c2-af1c-356ce6932f23 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:10.185404 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fbde5-e797-46f1-8b9b-0336c804b4ab None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:10.208955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:10.222345 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:10.231838 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49646fd-0a47-43d9-b666-a25a577497e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:10.232474 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49646fd-0a47-43d9-b666-a25a577497e8 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:10.232757 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49646fd-0a47-43d9-b666-a25a577497e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:10.233044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49646fd-0a47-43d9-b666-a25a577497e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:10.242486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49646fd-0a47-43d9-b666-a25a577497e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:10.244563 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49646fd-0a47-43d9-b666-a25a577497e8 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:10.260004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-b49646fd-0a47-43d9-b666-a25a577497e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 02:18:10.260004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:10.260004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:10.260004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:10.260004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:10.260004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:10.260004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:10.260004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:10.260004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:10.260004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:10.260004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:10.260004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:10.260004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:18:10.260004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:18:10.260004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:18:10.260004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:18:10.261131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:10.261131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:10.261131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:18:10.261131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:10.261131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:18:10.261131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:10.261131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:10.261131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:10.261131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:10.261131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:10.261131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:10.261131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:10.261131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:10.261131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:10.261131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:10.261131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:10.261131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:10.261131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:10.262074 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:10.262074 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:10.262074 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:18:10.262074 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:18:10.262074 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:18:10.262074 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:18:10.262074 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:18:10.262074 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:18:10.262074 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 02:18:10.262074 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:10.263010 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 300/626] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 9 02:18:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:10.263599 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49646fd-0a47-43d9-b666-a25a577497e8 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:10.314433 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9952a9-92f6-45c2-af1c-356ce6932f23 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:10.352442 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ca9d4-8e07-453b-bb0a-9d420230b6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:10.353119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ca9d4-8e07-453b-bb0a-9d420230b6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:10.353407 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ca9d4-8e07-453b-bb0a-9d420230b6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:10.353680 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ca9d4-8e07-453b-bb0a-9d420230b6b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:10.360908 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ca9d4-8e07-453b-bb0a-9d420230b6b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:10.362652 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ca9d4-8e07-453b-bb0a-9d420230b6b6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:10.370535 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49646fd-0a47-43d9-b666-a25a577497e8 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:10.375191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-0b9ca9d4-8e07-453b-bb0a-9d420230b6b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:10.375191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:10.375191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:10.375191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:10.375191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:10.375191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:10.375191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:10.375191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:10.375191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:10.375191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:10.375191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:10.375191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:10.375191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:10.375191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:10.375191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:10.376078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:10.376078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:10.376078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:10.376078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:10.376078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:10.376078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:10.376078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:10.376078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:10.376078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:10.376078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:10.376078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:10.376078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:10.376078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:10.376078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:10.376078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:10.376078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:10.376078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:10.377050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:10.377050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:10.377050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:10.377050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:10.377050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:10.377050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:10.377050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:10.377050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:10.377050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 327/627] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:10.378101 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ca9d4-8e07-453b-bb0a-9d420230b6b6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:10.410690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62accd96-8353-4310-824c-438e9433cff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:10.411376 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62accd96-8353-4310-824c-438e9433cff5 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:10.411600 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62accd96-8353-4310-824c-438e9433cff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:10.411874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62accd96-8353-4310-824c-438e9433cff5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:10.422245 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62accd96-8353-4310-824c-438e9433cff5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:18:10.427408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-62accd96-8353-4310-824c-438e9433cff5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:10.427408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:10.427408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:10.427408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:10.427408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:10.427408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:10.427408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:10.427408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:10.427408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:10.427408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:10.427408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:10.427408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:10.427408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:18:10.427408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:18:10.427408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:18:10.427408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:18:10.428288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:18:10.428288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:18:10.428288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:18:10.428288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:18:10.428288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:10.428288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:10.428288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:10.428288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:10.428288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:10.428288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:10.428288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:10.428288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:10.428288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:10.428288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:10.428288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:10.428288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:10.429124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:10.429124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:10.429124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:10.429124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:10.429124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:18:10.429124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:18:10.429124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:18:10.429124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:18:10.429124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:18:10.429124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:18:10.429124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:10.429124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:10.429124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 301/628] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 9 02:18:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:10.429791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62accd96-8353-4310-824c-438e9433cff5 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:10.468335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:10.481132 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:10.488854 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ca9d4-8e07-453b-bb0a-9d420230b6b6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:10.524415 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df04cd8-5292-4667-8f65-d43368b933d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:10.525029 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df04cd8-5292-4667-8f65-d43368b933d7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:10.525331 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df04cd8-5292-4667-8f65-d43368b933d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:10.525603 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df04cd8-5292-4667-8f65-d43368b933d7 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:10.526342 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df04cd8-5292-4667-8f65-d43368b933d7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:10.526638 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df04cd8-5292-4667-8f65-d43368b933d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:10.528068 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df04cd8-5292-4667-8f65-d43368b933d7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:10.534677 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62accd96-8353-4310-824c-438e9433cff5 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:10.551185 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 328/629] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 9 02:18:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:10.552257 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df04cd8-5292-4667-8f65-d43368b933d7 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:10.569244 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc70e2-d036-4a59-80b5-4ac231bce665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:10.569984 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc70e2-d036-4a59-80b5-4ac231bce665 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:10.570267 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc70e2-d036-4a59-80b5-4ac231bce665 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:10.570537 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc70e2-d036-4a59-80b5-4ac231bce665 None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:10.571224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc70e2-d036-4a59-80b5-4ac231bce665 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:10.571531 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc70e2-d036-4a59-80b5-4ac231bce665 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:10.572953 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc70e2-d036-4a59-80b5-4ac231bce665 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:10.590649 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 302/630] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:10.590649 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c5ddf-7a13-4b86-b0a4-006271a8dc2f None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:10.590649 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c5ddf-7a13-4b86-b0a4-006271a8dc2f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:10.590649 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c5ddf-7a13-4b86-b0a4-006271a8dc2f None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:10.590649 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 303/631] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:10.590649 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c5ddf-7a13-4b86-b0a4-006271a8dc2f None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:10.663124 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df04cd8-5292-4667-8f65-d43368b933d7 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:10.695452 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c5ddf-7a13-4b86-b0a4-006271a8dc2f None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:10.699508 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11bd41c-dfde-44c1-b506-88fbbb5255c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:10.700112 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bd41c-dfde-44c1-b506-88fbbb5255c7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:10.700393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bd41c-dfde-44c1-b506-88fbbb5255c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:10.700664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bd41c-dfde-44c1-b506-88fbbb5255c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:10.701358 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11bd41c-dfde-44c1-b506-88fbbb5255c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:10.701664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11bd41c-dfde-44c1-b506-88fbbb5255c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:10.703107 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11bd41c-dfde-44c1-b506-88fbbb5255c7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:10.705605 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:10.716528 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 329/632] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 9 02:18:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:10.716528 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11bd41c-dfde-44c1-b506-88fbbb5255c7 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:10.719308 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:10.741013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1e239-4cc9-4e7e-93a6-9dca7c170c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:10.742127 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1e239-4cc9-4e7e-93a6-9dca7c170c32 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:10.742413 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1e239-4cc9-4e7e-93a6-9dca7c170c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:10.742687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1e239-4cc9-4e7e-93a6-9dca7c170c32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:10.822608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1e239-4cc9-4e7e-93a6-9dca7c170c32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:10.824069 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1e239-4cc9-4e7e-93a6-9dca7c170c32 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:10.826515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11bd41c-dfde-44c1-b506-88fbbb5255c7 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:10.861335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6da395-2b1e-42c8-8b26-e732216aef99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:10.862538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6da395-2b1e-42c8-8b26-e732216aef99 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:10.862818 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6da395-2b1e-42c8-8b26-e732216aef99 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:10.863090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6da395-2b1e-42c8-8b26-e732216aef99 None admin] PATH_INFO: `/v3/projects/105476dcda7f48c28224d33c05860d6f/users/9151f210d29542dcb41ea3bc03390350/roles/d521e5f58e7e4cd48ceed4404113cbd5` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:10.878289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6da395-2b1e-42c8-8b26-e732216aef99 None admin] RBAC: Authorizing `identity:create_grant(project_id=105476dcda7f48c28224d33c05860d6f, user_id=9151f210d29542dcb41ea3bc03390350, role_id=d521e5f58e7e4cd48ceed4404113cbd5)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:10.879728 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6da395-2b1e-42c8-8b26-e732216aef99 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:10.893910 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 330/633] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 9 02:18:10 2022] PUT /identity/v3/projects/105476dcda7f48c28224d33c05860d6f/users/9151f210d29542dcb41ea3bc03390350/roles/d521e5f58e7e4cd48ceed4404113cbd5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:18:10.895104 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a8f2f-7e89-43b8-a712-e1c85287f917 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:10.895393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a8f2f-7e89-43b8-a712-e1c85287f917 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:10.895668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a8f2f-7e89-43b8-a712-e1c85287f917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:10.914233 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-681a8f2f-7e89-43b8-a712-e1c85287f917 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:10.915442 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-681a8f2f-7e89-43b8-a712-e1c85287f917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:10.946336 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 304/634] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:18:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:18:10.947209 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1e239-4cc9-4e7e-93a6-9dca7c170c32 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:10.957993 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:10.975010 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:11.003627 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 331/635] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:18:11.004974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a8f2f-7e89-43b8-a712-e1c85287f917 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:11.086098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1e239-4cc9-4e7e-93a6-9dca7c170c32 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:11.125109 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914267df-37ff-45dd-b1a9-865cb6673a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:11.125722 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914267df-37ff-45dd-b1a9-865cb6673a43 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:11.126001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914267df-37ff-45dd-b1a9-865cb6673a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:11.126271 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914267df-37ff-45dd-b1a9-865cb6673a43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:11.136219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914267df-37ff-45dd-b1a9-865cb6673a43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:11.137104 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a8f2f-7e89-43b8-a712-e1c85287f917 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:11.137683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914267df-37ff-45dd-b1a9-865cb6673a43 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:11.152642 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-914267df-37ff-45dd-b1a9-865cb6673a43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:11.152642 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:11.152642 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:11.152642 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:11.152642 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:11.152642 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:11.152642 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:11.152642 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:11.152642 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:11.152642 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:11.152642 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:11.152642 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:11.152642 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:11.152642 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:11.152642 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:11.152642 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:11.153697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:11.153697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:11.153697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:11.153697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:11.153697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:11.153697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:11.153697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:11.153697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:11.153697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:11.153697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:11.153697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:11.153697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:11.153697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:11.153697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:11.153697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:11.153697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:11.153697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:11.154598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:11.154598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:11.154598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:11.154598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 305/636] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:11.154598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914267df-37ff-45dd-b1a9-865cb6673a43 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:11.180335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f7b24-c4d4-45de-928e-841bfe623c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:11.180944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f7b24-c4d4-45de-928e-841bfe623c8c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:11.181267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f7b24-c4d4-45de-928e-841bfe623c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:11.181537 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f7b24-c4d4-45de-928e-841bfe623c8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:11.192328 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f7b24-c4d4-45de-928e-841bfe623c8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:11.193879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f7b24-c4d4-45de-928e-841bfe623c8c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:11.209785 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-407f7b24-c4d4-45de-928e-841bfe623c8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:11.209785 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:11.209785 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:11.209785 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:11.209785 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:11.209785 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:11.209785 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:11.209785 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:11.209785 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:11.209785 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:11.209785 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:11.209785 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:11.209785 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:11.209785 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:11.209785 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:11.209785 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:11.210772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:11.210772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:11.210772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:11.210772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:11.210772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:11.210772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:11.210772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:11.210772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:11.210772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:11.210772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:11.210772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:11.210772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:11.210772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:11.210772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:11.210772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:11.210772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:11.210772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:11.211637 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:11.211637 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:11.211637 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:11.211637 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 332/637] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:11.212228 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c8425-cc49-405f-b88e-7c6b9848c06e None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:11.212395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c8425-cc49-405f-b88e-7c6b9848c06e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:11.212671 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c8425-cc49-405f-b88e-7c6b9848c06e None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:11.214115 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 333/638] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:11.214714 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c8425-cc49-405f-b88e-7c6b9848c06e None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:11.222273 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:11.254001 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:11.268969 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914267df-37ff-45dd-b1a9-865cb6673a43 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:11.304256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87000f5-1e4d-41a3-9acd-2b9b9d7ce416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:11.304978 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87000f5-1e4d-41a3-9acd-2b9b9d7ce416 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:11.305292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87000f5-1e4d-41a3-9acd-2b9b9d7ce416 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:11.305568 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87000f5-1e4d-41a3-9acd-2b9b9d7ce416 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:11.316482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87000f5-1e4d-41a3-9acd-2b9b9d7ce416 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:18:11.321594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-a87000f5-1e4d-41a3-9acd-2b9b9d7ce416 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:11.321594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:11.321594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:11.321594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:11.321594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:11.321594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:11.321594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:11.321594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:11.321594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:11.321594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:11.321594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:11.321594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:11.321594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:18:11.321594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:18:11.321594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:18:11.321594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:18:11.322742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:18:11.322742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:18:11.322742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:18:11.322742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:18:11.322742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:11.322742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:11.322742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:11.322742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:11.322742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:11.322742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:11.322742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:11.322742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:11.322742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:11.322742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:11.322742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:11.322742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:11.323561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:11.323561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:11.323561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:11.323561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:11.323561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:18:11.323561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:18:11.323561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:18:11.323561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:18:11.323561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:18:11.323561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:18:11.323561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:11.323561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:11.323561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 306/639] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 9 02:18:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:11.323561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87000f5-1e4d-41a3-9acd-2b9b9d7ce416 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:11.334714 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c8425-cc49-405f-b88e-7c6b9848c06e None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:11.372062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089dd26-9675-4763-b470-3c46e6ed49ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:11.373077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089dd26-9675-4763-b470-3c46e6ed49ef None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:11.373536 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089dd26-9675-4763-b470-3c46e6ed49ef None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:11.374026 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089dd26-9675-4763-b470-3c46e6ed49ef None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:11.374860 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089dd26-9675-4763-b470-3c46e6ed49ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:11.375232 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089dd26-9675-4763-b470-3c46e6ed49ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:11.376808 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089dd26-9675-4763-b470-3c46e6ed49ef None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:11.389644 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 334/640] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:11.390833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96edbe-fbe6-44c6-bd86-4ea1bcdf9b77 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:11.391114 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96edbe-fbe6-44c6-bd86-4ea1bcdf9b77 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:11.391384 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96edbe-fbe6-44c6-bd86-4ea1bcdf9b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:11.412354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ff96edbe-fbe6-44c6-bd86-4ea1bcdf9b77 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:11.413681 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ff96edbe-fbe6-44c6-bd86-4ea1bcdf9b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:11.431916 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87000f5-1e4d-41a3-9acd-2b9b9d7ce416 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:11.452647 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:11.472238 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23bfca-f248-4e6c-a14b-540a3d879e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:11.473152 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23bfca-f248-4e6c-a14b-540a3d879e40 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:11.473445 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23bfca-f248-4e6c-a14b-540a3d879e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:11.473719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23bfca-f248-4e6c-a14b-540a3d879e40 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:11.474385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f23bfca-f248-4e6c-a14b-540a3d879e40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:11.474689 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f23bfca-f248-4e6c-a14b-540a3d879e40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:11.476487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f23bfca-f248-4e6c-a14b-540a3d879e40 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:11.501142 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 335/641] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:18:11.501343 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 307/642] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:11.501432 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96edbe-fbe6-44c6-bd86-4ea1bcdf9b77 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:11.501511 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23bfca-f248-4e6c-a14b-540a3d879e40 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:11.519922 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:11.596131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96edbe-fbe6-44c6-bd86-4ea1bcdf9b77 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:11.612965 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23bfca-f248-4e6c-a14b-540a3d879e40 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:11.632467 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ed92e-e8dc-4e86-867d-8e588079d97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:11.633101 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ed92e-e8dc-4e86-867d-8e588079d97d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:11.633380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ed92e-e8dc-4e86-867d-8e588079d97d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:11.633994 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ed92e-e8dc-4e86-867d-8e588079d97d None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:11.634311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ed92e-e8dc-4e86-867d-8e588079d97d None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:11.634616 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ed92e-e8dc-4e86-867d-8e588079d97d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:11.635976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ed92e-e8dc-4e86-867d-8e588079d97d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:11.644634 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 336/643] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 9 02:18:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:11.645759 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ed92e-e8dc-4e86-867d-8e588079d97d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:11.653351 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5720b3d-3658-4cc3-83d8-15673ce75d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:11.654047 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5720b3d-3658-4cc3-83d8-15673ce75d8b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:11.654324 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5720b3d-3658-4cc3-83d8-15673ce75d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:11.654591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5720b3d-3658-4cc3-83d8-15673ce75d8b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:11.662706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5720b3d-3658-4cc3-83d8-15673ce75d8b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:11.664187 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5720b3d-3658-4cc3-83d8-15673ce75d8b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:11.676037 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-e5720b3d-3658-4cc3-83d8-15673ce75d8b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 02:18:11.676037 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:11.676037 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:11.676037 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:11.676037 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:11.676037 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:11.676037 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:11.676037 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:11.676037 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:11.676037 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:11.676037 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:11.676037 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:11.676037 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:18:11.676037 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:18:11.676037 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:18:11.676037 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:18:11.677050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:11.677050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:11.677050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:18:11.677050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:11.677050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:18:11.677050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:11.677050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:11.677050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:11.677050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:11.677050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:11.677050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:11.677050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:11.677050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:11.677050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:11.677050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:11.677050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:11.677050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:11.677050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:11.678000 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:11.678000 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:11.678000 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:18:11.678000 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:18:11.678000 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:18:11.678000 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:18:11.678000 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:18:11.678000 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:18:11.678000 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 02:18:11.678000 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:11.678000 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 308/644] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:18:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:11.678000 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5720b3d-3658-4cc3-83d8-15673ce75d8b None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:11.722232 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:11.741756 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:11.757729 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ed92e-e8dc-4e86-867d-8e588079d97d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:11.788922 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5720b3d-3658-4cc3-83d8-15673ce75d8b None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:11.790844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d905d-2b64-4ff4-985c-d2fbd425585a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:11.791499 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d905d-2b64-4ff4-985c-d2fbd425585a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:11.791750 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d905d-2b64-4ff4-985c-d2fbd425585a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:11.792020 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d905d-2b64-4ff4-985c-d2fbd425585a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:11.798596 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d905d-2b64-4ff4-985c-d2fbd425585a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:11.800052 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d905d-2b64-4ff4-985c-d2fbd425585a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:11.811754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-0e3d905d-2b64-4ff4-985c-d2fbd425585a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:11.811754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:11.811754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:11.811754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:11.811754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:11.811754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:11.811754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:11.811754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:11.811754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:11.811754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:11.811754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:11.811754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:11.811754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:11.811754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:11.811754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:11.812601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:11.812601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:11.812601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:11.812601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:11.812601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:11.812601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:11.812601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:11.812601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:11.812601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:11.812601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:11.812601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:11.812601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:11.812601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:11.812601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:11.812601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:11.812601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:11.812601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:11.813676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:11.813676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:11.813676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:11.813676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:11.813676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:11.813676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:11.813676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:11.813676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:11.813676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 337/645] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:11.813676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d905d-2b64-4ff4-985c-d2fbd425585a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:11.831618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cd5b0-23ab-409a-8bf5-8508afdeffd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:11.832245 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cd5b0-23ab-409a-8bf5-8508afdeffd2 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:11.832523 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cd5b0-23ab-409a-8bf5-8508afdeffd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:11.832792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cd5b0-23ab-409a-8bf5-8508afdeffd2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:11.842913 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372cd5b0-23ab-409a-8bf5-8508afdeffd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:18:11.848020 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-372cd5b0-23ab-409a-8bf5-8508afdeffd2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:11.848020 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:11.848020 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:11.848020 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:11.848020 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:11.848020 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:11.848020 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:11.848020 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:11.848020 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:11.848020 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:11.848020 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:11.848020 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:11.848020 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:18:11.848020 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:18:11.848020 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:18:11.848020 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:18:11.848932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:18:11.848932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:18:11.848932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:18:11.848932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:18:11.848932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:11.848932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:11.848932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:11.848932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:11.848932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:11.848932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:11.848932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:11.848932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:11.848932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:11.848932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:11.848932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:11.848932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:11.849785 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:11.849785 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:11.849785 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:11.849785 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:11.849785 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:18:11.849785 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:18:11.849785 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:18:11.849785 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:18:11.849785 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:18:11.849785 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:18:11.849785 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:11.849785 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:11.849785 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 309/646] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 9 02:18:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:11.850494 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cd5b0-23ab-409a-8bf5-8508afdeffd2 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:11.925170 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d905d-2b64-4ff4-985c-d2fbd425585a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:11.957561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:11.960503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cd5b0-23ab-409a-8bf5-8508afdeffd2 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:11.961089 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7da13b-67de-4951-8697-5e38cf22e0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:11.961725 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7da13b-67de-4951-8697-5e38cf22e0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:11.962115 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7da13b-67de-4951-8697-5e38cf22e0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:11.962274 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7da13b-67de-4951-8697-5e38cf22e0e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:11.978828 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7da13b-67de-4951-8697-5e38cf22e0e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:11.980307 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7da13b-67de-4951-8697-5e38cf22e0e8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:11.987596 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:11.996575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-eb7da13b-67de-4951-8697-5e38cf22e0e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:11.996575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:11.996575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:11.996575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:11.996575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:11.996575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:11.996575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:11.996575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:11.996575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:11.996575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:11.996575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:11.996575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:11.996575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:11.996575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:11.996575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:11.996575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:11.997553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:11.997553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:11.997553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:11.997553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:11.997553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:11.997553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:11.997553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:11.997553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:11.997553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:11.997553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:11.997553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:11.997553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:11.997553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:11.997553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:11.997553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:11.997553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:11.997553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:11.998421 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:11.998421 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:11.998421 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:12.000375 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97916b5f-c1a8-40bc-a2dd-7ccfc5ed5fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:12.000502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 338/647] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:12.001300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7da13b-67de-4951-8697-5e38cf22e0e8 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:12.002149 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97916b5f-c1a8-40bc-a2dd-7ccfc5ed5fca None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:12.003156 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97916b5f-c1a8-40bc-a2dd-7ccfc5ed5fca None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:12.003624 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97916b5f-c1a8-40bc-a2dd-7ccfc5ed5fca None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:12.004739 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97916b5f-c1a8-40bc-a2dd-7ccfc5ed5fca None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:12.006181 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97916b5f-c1a8-40bc-a2dd-7ccfc5ed5fca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:12.007917 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97916b5f-c1a8-40bc-a2dd-7ccfc5ed5fca None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:12.029446 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 310/648] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 9 02:18:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:12.030601 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97916b5f-c1a8-40bc-a2dd-7ccfc5ed5fca None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:12.126036 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7da13b-67de-4951-8697-5e38cf22e0e8 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:12.135593 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97916b5f-c1a8-40bc-a2dd-7ccfc5ed5fca None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:12.163225 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51346752-e794-49ee-a776-82758d10574c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:12.163876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51346752-e794-49ee-a776-82758d10574c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:12.164156 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51346752-e794-49ee-a776-82758d10574c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:12.164425 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51346752-e794-49ee-a776-82758d10574c None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:12.165149 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51346752-e794-49ee-a776-82758d10574c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:12.165455 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51346752-e794-49ee-a776-82758d10574c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:12.166982 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51346752-e794-49ee-a776-82758d10574c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:12.169539 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c53bc9-650d-4094-ab40-96bf59668d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:12.170138 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c53bc9-650d-4094-ab40-96bf59668d99 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:12.170418 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c53bc9-650d-4094-ab40-96bf59668d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:12.170692 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c53bc9-650d-4094-ab40-96bf59668d99 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:12.171348 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c53bc9-650d-4094-ab40-96bf59668d99 None admin] RBAC: Adding query filter params (name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:12.171654 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c53bc9-650d-4094-ab40-96bf59668d99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:12.173051 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c53bc9-650d-4094-ab40-96bf59668d99 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:12.181109 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 339/649] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:12.181803 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 311/650] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 9 02:18:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:12.182269 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51346752-e794-49ee-a776-82758d10574c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:12.182599 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c53bc9-650d-4094-ab40-96bf59668d99 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:12.210751 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:12.248730 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:12.296013 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51346752-e794-49ee-a776-82758d10574c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:12.297695 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c53bc9-650d-4094-ab40-96bf59668d99 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:12.331681 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b405fb2-5fa6-4a0a-afa6-d79ac0657ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:12.331945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750d84c-6082-45e1-8792-b1dc619af04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:12.332287 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b405fb2-5fa6-4a0a-afa6-d79ac0657ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:12.332541 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750d84c-6082-45e1-8792-b1dc619af04e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:12.332642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b405fb2-5fa6-4a0a-afa6-d79ac0657ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:12.332824 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750d84c-6082-45e1-8792-b1dc619af04e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:12.332921 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b405fb2-5fa6-4a0a-afa6-d79ac0657ad6 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:12.333131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750d84c-6082-45e1-8792-b1dc619af04e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:12.333509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b405fb2-5fa6-4a0a-afa6-d79ac0657ad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:12.333818 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b405fb2-5fa6-4a0a-afa6-d79ac0657ad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:12.335187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b405fb2-5fa6-4a0a-afa6-d79ac0657ad6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:12.347538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 340/651] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:12.352871 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b405fb2-5fa6-4a0a-afa6-d79ac0657ad6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:12.407587 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750d84c-6082-45e1-8792-b1dc619af04e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:12.409223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750d84c-6082-45e1-8792-b1dc619af04e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:12.431002 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:12.459241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b405fb2-5fa6-4a0a-afa6-d79ac0657ad6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:12.476962 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:12.495726 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0db53c-8207-4466-a176-7bd5894a76de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:12.496391 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0db53c-8207-4466-a176-7bd5894a76de None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:12.496670 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0db53c-8207-4466-a176-7bd5894a76de None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:12.496937 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0db53c-8207-4466-a176-7bd5894a76de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:12.497692 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0db53c-8207-4466-a176-7bd5894a76de None admin] RBAC: Adding query filter params (role.id=d521e5f58e7e4cd48ceed4404113cbd5, scope.project.id=105476dcda7f48c28224d33c05860d6f, user.id=78fff294b9794a26aa1bbc231fa1133c) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:12.497997 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0db53c-8207-4466-a176-7bd5894a76de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:12.499580 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0db53c-8207-4466-a176-7bd5894a76de None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:12.517061 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 341/652] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:18:12 2022] GET /identity/v3/role_assignments?user.id=78fff294b9794a26aa1bbc231fa1133c&scope.project.id=105476dcda7f48c28224d33c05860d6f&role.id=d521e5f58e7e4cd48ceed4404113cbd5 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:12.517061 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0db53c-8207-4466-a176-7bd5894a76de None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:12.531719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 312/653] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:18:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:18:12.532898 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750d84c-6082-45e1-8792-b1dc619af04e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:12.623229 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0db53c-8207-4466-a176-7bd5894a76de None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:12.660275 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878cb74-0579-418a-bc63-bff9c0fcd2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:12.660912 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878cb74-0579-418a-bc63-bff9c0fcd2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:12.661215 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878cb74-0579-418a-bc63-bff9c0fcd2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:12.661485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878cb74-0579-418a-bc63-bff9c0fcd2f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:12.672901 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750d84c-6082-45e1-8792-b1dc619af04e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:12.673123 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878cb74-0579-418a-bc63-bff9c0fcd2f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:12.675488 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878cb74-0579-418a-bc63-bff9c0fcd2f9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:12.694502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-3878cb74-0579-418a-bc63-bff9c0fcd2f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:12.694502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:12.694502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:12.694502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:12.694502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:12.694502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:12.694502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:12.694502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:12.694502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:12.694502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:12.694502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:12.694502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:12.694502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:12.694502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:12.694502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:12.694502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:12.695493 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:12.695493 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:12.695493 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:12.695493 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:12.695493 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:12.695493 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:12.695493 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:12.695493 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:12.695493 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:12.695493 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:12.695493 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:12.695493 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:12.695493 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:12.695493 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:12.695493 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:12.695493 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:12.695493 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:12.696413 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:12.696413 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:12.696413 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:12.697119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 342/654] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:12.697986 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878cb74-0579-418a-bc63-bff9c0fcd2f9 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:12.704714 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:12.724532 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dce036-22fd-44fd-8324-8a39277f72ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:12.725397 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dce036-22fd-44fd-8324-8a39277f72ba None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:12.725916 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dce036-22fd-44fd-8324-8a39277f72ba None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:12.726372 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dce036-22fd-44fd-8324-8a39277f72ba None admin] PATH_INFO: `/v3/users/glance` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:12.734369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dce036-22fd-44fd-8324-8a39277f72ba None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:12.736256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dce036-22fd-44fd-8324-8a39277f72ba None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:12.742962 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:12.750331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-16dce036-22fd-44fd-8324-8a39277f72ba None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 09 02:18:12.750331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:12.750331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:12.750331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:12.750331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:12.750331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:12.750331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:12.750331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:12.750331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:12.750331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:12.750331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:12.750331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:12.750331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:18:12.750331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:18:12.750331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:18:12.750331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:18:12.751436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:12.751436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:12.751436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:18:12.751436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:12.751436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:18:12.751436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:12.751436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:12.751436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:12.751436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:12.751436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:12.751436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:12.751436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:12.751436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:12.751436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:12.751436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:12.751436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:12.751436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:12.751436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:12.752465 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:12.752465 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:12.752465 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:18:12.752465 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:18:12.752465 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:18:12.752465 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:18:12.752465 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:18:12.752465 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:18:12.752465 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 09 02:18:12.752465 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:12.752465 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 313/655] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:18:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:12.752465 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dce036-22fd-44fd-8324-8a39277f72ba None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:12.830076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878cb74-0579-418a-bc63-bff9c0fcd2f9 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:12.869216 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d7166-ae4a-492f-be17-7c8630a9c5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:12.869852 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d7166-ae4a-492f-be17-7c8630a9c5bf None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:12.870131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d7166-ae4a-492f-be17-7c8630a9c5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:12.870401 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d7166-ae4a-492f-be17-7c8630a9c5bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:12.881158 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d7166-ae4a-492f-be17-7c8630a9c5bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:12.882637 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d7166-ae4a-492f-be17-7c8630a9c5bf None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:12.883652 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dce036-22fd-44fd-8324-8a39277f72ba None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:12.899199 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-a62d7166-ae4a-492f-be17-7c8630a9c5bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:12.899199 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:12.899199 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:12.899199 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:12.899199 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:12.899199 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:12.899199 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:12.899199 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:12.899199 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:12.899199 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:12.899199 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:12.899199 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:12.899199 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:12.899199 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:12.899199 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:12.899199 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:12.900166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:12.900166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:12.900166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:12.900166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:12.900166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:12.900166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:12.900166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:12.900166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:12.900166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:12.900166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:12.900166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:12.900166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:12.900166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:12.900166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:12.900166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:12.900166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:12.900166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:12.901032 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:12.901032 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:12.901032 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:12.901032 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 343/656] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:12.905803 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d7166-ae4a-492f-be17-7c8630a9c5bf None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:12.926763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92977bdc-2bbf-49c0-a49b-ce09d1dec0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:12.927433 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92977bdc-2bbf-49c0-a49b-ce09d1dec0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:12.927762 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92977bdc-2bbf-49c0-a49b-ce09d1dec0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:12.928084 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92977bdc-2bbf-49c0-a49b-ce09d1dec0c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:12.929285 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92977bdc-2bbf-49c0-a49b-ce09d1dec0c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:12.929614 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92977bdc-2bbf-49c0-a49b-ce09d1dec0c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:12.931007 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92977bdc-2bbf-49c0-a49b-ce09d1dec0c6 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:12.943633 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 314/657] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:12.944285 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92977bdc-2bbf-49c0-a49b-ce09d1dec0c6 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:12.994217 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:13.009815 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:13.026638 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d7166-ae4a-492f-be17-7c8630a9c5bf None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:13.059517 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92977bdc-2bbf-49c0-a49b-ce09d1dec0c6 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:13.061494 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec8fdd-2b09-4c86-a79c-dd9a6e2da956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:13.062107 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec8fdd-2b09-4c86-a79c-dd9a6e2da956 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:13.062388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec8fdd-2b09-4c86-a79c-dd9a6e2da956 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:13.062662 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec8fdd-2b09-4c86-a79c-dd9a6e2da956 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:13.063389 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec8fdd-2b09-4c86-a79c-dd9a6e2da956 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:13.063703 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec8fdd-2b09-4c86-a79c-dd9a6e2da956 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:13.065186 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec8fdd-2b09-4c86-a79c-dd9a6e2da956 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:13.083032 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 344/658] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 9 02:18:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:13.084074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec8fdd-2b09-4c86-a79c-dd9a6e2da956 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:13.101109 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2c80e-7636-441e-b96a-d33f2b4619db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:13.102035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2c80e-7636-441e-b96a-d33f2b4619db None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:13.102495 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2c80e-7636-441e-b96a-d33f2b4619db None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:13.102949 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2c80e-7636-441e-b96a-d33f2b4619db None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:13.103782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2c80e-7636-441e-b96a-d33f2b4619db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:13.104237 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2c80e-7636-441e-b96a-d33f2b4619db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:13.105821 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2c80e-7636-441e-b96a-d33f2b4619db None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:13.117927 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 315/659] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:13.119296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af42fdc-4f6b-4cb0-a9f7-6614c37a3448 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:13.119585 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af42fdc-4f6b-4cb0-a9f7-6614c37a3448 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:13.119858 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af42fdc-4f6b-4cb0-a9f7-6614c37a3448 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:13.121212 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 316/660] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:13.125751 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af42fdc-4f6b-4cb0-a9f7-6614c37a3448 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:13.199104 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec8fdd-2b09-4c86-a79c-dd9a6e2da956 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:13.231808 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:13.235319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f1b6b-f74b-4397-9d11-56fcb276bfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:13.235959 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f1b6b-f74b-4397-9d11-56fcb276bfdf None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:13.236241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f1b6b-f74b-4397-9d11-56fcb276bfdf None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:13.236516 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f1b6b-f74b-4397-9d11-56fcb276bfdf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:13.236745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af42fdc-4f6b-4cb0-a9f7-6614c37a3448 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:13.244010 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f1b6b-f74b-4397-9d11-56fcb276bfdf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:13.245501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f1b6b-f74b-4397-9d11-56fcb276bfdf None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:13.257605 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-898f1b6b-f74b-4397-9d11-56fcb276bfdf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 02:18:13.257605 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:13.257605 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:13.257605 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:13.257605 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:13.257605 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:13.257605 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:13.257605 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:13.257605 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:13.257605 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:13.257605 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:13.257605 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:13.257605 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:18:13.257605 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:18:13.257605 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:18:13.257605 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:18:13.258768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:13.258768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:13.258768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:18:13.258768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:13.258768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:18:13.258768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:13.258768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:13.258768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:13.258768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:13.258768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:13.258768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:13.258768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:13.258768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:13.258768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:13.258768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:13.258768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:13.258768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:13.258768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:13.259945 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:13.259945 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:13.259945 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:18:13.259945 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:18:13.259945 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:18:13.259945 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:18:13.259945 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:18:13.259945 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:18:13.259945 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 02:18:13.259945 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:13.263329 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 345/661] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 9 02:18:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:13.264157 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f1b6b-f74b-4397-9d11-56fcb276bfdf None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:13.268989 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:13.279342 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf67d6-8b5e-43f4-a3b7-6461460ff410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:13.279951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf67d6-8b5e-43f4-a3b7-6461460ff410 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:13.280231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf67d6-8b5e-43f4-a3b7-6461460ff410 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:13.280503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf67d6-8b5e-43f4-a3b7-6461460ff410 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:13.350555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf67d6-8b5e-43f4-a3b7-6461460ff410 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:13.352028 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf67d6-8b5e-43f4-a3b7-6461460ff410 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:13.371586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f1b6b-f74b-4397-9d11-56fcb276bfdf None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:13.405141 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b491a-83da-45c5-a178-9c38830c8b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:13.405772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b491a-83da-45c5-a178-9c38830c8b81 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:13.406049 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b491a-83da-45c5-a178-9c38830c8b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:13.406323 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b491a-83da-45c5-a178-9c38830c8b81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:13.413635 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b491a-83da-45c5-a178-9c38830c8b81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:13.415065 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b491a-83da-45c5-a178-9c38830c8b81 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:13.425974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-0b0b491a-83da-45c5-a178-9c38830c8b81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:13.425974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:13.425974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:13.425974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:13.425974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:13.425974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:13.425974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:13.425974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:13.425974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:13.425974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:13.425974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:13.425974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:13.425974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:13.425974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:13.425974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:13.426966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:13.426966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:13.426966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:13.426966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:13.426966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:13.426966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:13.426966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:13.426966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:13.426966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:13.426966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:13.426966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:13.426966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:13.426966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:13.426966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:13.426966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:13.426966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:13.426966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:13.427858 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:13.427858 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:13.427858 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:13.427858 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:13.427858 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:13.427858 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:13.427858 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:13.427858 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:13.427858 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 346/662] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:13.428349 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaefe23-8eed-4e4d-a2ae-280462483287 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:13.428730 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaefe23-8eed-4e4d-a2ae-280462483287 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:13.428831 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaefe23-8eed-4e4d-a2ae-280462483287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:13.446910 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-1aaefe23-8eed-4e4d-a2ae-280462483287 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:13.448086 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1aaefe23-8eed-4e4d-a2ae-280462483287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:13.458674 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:13.463227 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 317/663] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:18:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:18:13.464066 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf67d6-8b5e-43f4-a3b7-6461460ff410 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:13.512034 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:13.523844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 347/664] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:18:13.529219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaefe23-8eed-4e4d-a2ae-280462483287 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:13.583341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf67d6-8b5e-43f4-a3b7-6461460ff410 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:13.620748 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3aa1b6-64f9-40fc-905c-aa6e5f19680c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:13.621485 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3aa1b6-64f9-40fc-905c-aa6e5f19680c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:13.621808 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3aa1b6-64f9-40fc-905c-aa6e5f19680c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:13.622230 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3aa1b6-64f9-40fc-905c-aa6e5f19680c None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:13.622976 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3aa1b6-64f9-40fc-905c-aa6e5f19680c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:13.623288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3aa1b6-64f9-40fc-905c-aa6e5f19680c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:13.624868 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3aa1b6-64f9-40fc-905c-aa6e5f19680c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:13.631296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaefe23-8eed-4e4d-a2ae-280462483287 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:13.647552 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 318/665] 10.222.0.16 () {56 vars in 1139 bytes} [Tue Aug 9 02:18:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:13.648545 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3aa1b6-64f9-40fc-905c-aa6e5f19680c None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:13.666232 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92cd60-ad19-45e7-a5d2-98acc0c21b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:13.666841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92cd60-ad19-45e7-a5d2-98acc0c21b39 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:13.667118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92cd60-ad19-45e7-a5d2-98acc0c21b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:13.667390 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb92cd60-ad19-45e7-a5d2-98acc0c21b39 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:13.668083 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92cd60-ad19-45e7-a5d2-98acc0c21b39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:13.668387 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92cd60-ad19-45e7-a5d2-98acc0c21b39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:13.669837 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb92cd60-ad19-45e7-a5d2-98acc0c21b39 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:13.682845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 348/666] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:13.683643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92cd60-ad19-45e7-a5d2-98acc0c21b39 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:13.714834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:13.741589 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:13.760118 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3aa1b6-64f9-40fc-905c-aa6e5f19680c None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:13.789903 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb92cd60-ad19-45e7-a5d2-98acc0c21b39 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:13.795670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bfbe3-3671-4c16-a285-a2107d0f5599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:13.796323 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bfbe3-3671-4c16-a285-a2107d0f5599 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:13.796599 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bfbe3-3671-4c16-a285-a2107d0f5599 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:13.796868 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bfbe3-3671-4c16-a285-a2107d0f5599 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:13.808948 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69bfbe3-3671-4c16-a285-a2107d0f5599 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:13.810424 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69bfbe3-3671-4c16-a285-a2107d0f5599 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:13.825880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-b69bfbe3-3671-4c16-a285-a2107d0f5599 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:13.825880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:13.825880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:13.825880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:13.825880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:13.825880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:13.825880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:13.825880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:13.825880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:13.825880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:13.825880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:13.825880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:13.825880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:13.825880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:13.825880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:13.825880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:13.827035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:13.827035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:13.827035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:13.827035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:13.827035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:13.827035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:13.827035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:13.827035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:13.827035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:13.827035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:13.827035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:13.827035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:13.827035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:13.827035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:13.827035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:13.827035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:13.827035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:13.828123 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:13.828123 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:13.828123 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:13.830452 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71276313-7c7f-46cf-829e-20985c3ae0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:13.831078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71276313-7c7f-46cf-829e-20985c3ae0dc None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:13.831520 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71276313-7c7f-46cf-829e-20985c3ae0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:13.831620 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71276313-7c7f-46cf-829e-20985c3ae0dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:13.831691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 319/667] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:13.832533 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bfbe3-3671-4c16-a285-a2107d0f5599 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:13.844011 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71276313-7c7f-46cf-829e-20985c3ae0dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:18:13.849476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-71276313-7c7f-46cf-829e-20985c3ae0dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:13.849476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:13.849476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:13.849476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:13.849476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:13.849476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:13.849476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:13.849476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:13.849476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:13.849476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:13.849476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:13.849476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:13.849476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:18:13.849476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:18:13.849476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:18:13.849476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:18:13.850415 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:18:13.850415 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:18:13.850415 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:18:13.850415 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:18:13.850415 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:13.850415 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:13.850415 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:13.850415 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:13.850415 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:13.850415 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:13.850415 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:13.850415 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:13.850415 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:13.850415 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:13.850415 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:13.850415 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:13.856262 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:13.856262 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:13.856262 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:13.856262 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:13.856262 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:18:13.856262 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:18:13.856262 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:18:13.856262 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:18:13.856262 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:18:13.856262 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:18:13.856262 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:13.856262 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:13.856262 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 349/668] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 9 02:18:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:13.856262 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71276313-7c7f-46cf-829e-20985c3ae0dc None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:13.944413 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bfbe3-3671-4c16-a285-a2107d0f5599 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:13.954943 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:13.963194 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71276313-7c7f-46cf-829e-20985c3ae0dc None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:13.981687 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:13.988142 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1cd04-bcc9-4960-bd45-b9b7908396c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:13.988957 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1cd04-bcc9-4960-bd45-b9b7908396c9 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:13.989861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1cd04-bcc9-4960-bd45-b9b7908396c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:13.990283 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1cd04-bcc9-4960-bd45-b9b7908396c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:14.004153 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f1882-ec46-40a6-93a2-7bb62088c854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:14.004756 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f1882-ec46-40a6-93a2-7bb62088c854 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:14.005080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f1882-ec46-40a6-93a2-7bb62088c854 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:14.005354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f1882-ec46-40a6-93a2-7bb62088c854 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:14.006076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f1882-ec46-40a6-93a2-7bb62088c854 None admin] RBAC: Adding query filter params (role.id=d521e5f58e7e4cd48ceed4404113cbd5, scope.project.id=105476dcda7f48c28224d33c05860d6f, user.id=9500a1b1de2344f78580bed52cc302a2) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:14.006384 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f1882-ec46-40a6-93a2-7bb62088c854 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:14.007807 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f1882-ec46-40a6-93a2-7bb62088c854 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:14.013460 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 350/669] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:18:13 2022] GET /identity/v3/role_assignments?user.id=9500a1b1de2344f78580bed52cc302a2&scope.project.id=105476dcda7f48c28224d33c05860d6f&role.id=d521e5f58e7e4cd48ceed4404113cbd5 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:14.014233 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f1882-ec46-40a6-93a2-7bb62088c854 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:14.084444 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1cd04-bcc9-4960-bd45-b9b7908396c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:14.086080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1cd04-bcc9-4960-bd45-b9b7908396c9 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:14.133892 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f1882-ec46-40a6-93a2-7bb62088c854 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:14.184339 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf36768-4d3f-432f-a151-d7525bd5b21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:14.185008 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf36768-4d3f-432f-a151-d7525bd5b21c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:14.185409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf36768-4d3f-432f-a151-d7525bd5b21c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:14.185750 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf36768-4d3f-432f-a151-d7525bd5b21c None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:14.186471 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf36768-4d3f-432f-a151-d7525bd5b21c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:14.186840 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf36768-4d3f-432f-a151-d7525bd5b21c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:14.188289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf36768-4d3f-432f-a151-d7525bd5b21c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:14.202721 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 351/670] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:14.203652 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf36768-4d3f-432f-a151-d7525bd5b21c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:14.215701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 320/671] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:18:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:18:14.216801 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1cd04-bcc9-4960-bd45-b9b7908396c9 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:14.232108 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:14.252771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:14.325141 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf36768-4d3f-432f-a151-d7525bd5b21c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:14.349208 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1cd04-bcc9-4960-bd45-b9b7908396c9 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:14.374295 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab66044-365b-4e8d-990c-cc33a2b6eb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:14.375171 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab66044-365b-4e8d-990c-cc33a2b6eb56 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:14.375453 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab66044-365b-4e8d-990c-cc33a2b6eb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:14.375727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab66044-365b-4e8d-990c-cc33a2b6eb56 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:14.376656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab66044-365b-4e8d-990c-cc33a2b6eb56 None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:14.377425 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab66044-365b-4e8d-990c-cc33a2b6eb56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:14.379326 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab66044-365b-4e8d-990c-cc33a2b6eb56 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:14.384808 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732633b-a481-4abf-819f-515871bfe87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:14.385480 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732633b-a481-4abf-819f-515871bfe87e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:14.385757 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732633b-a481-4abf-819f-515871bfe87e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:14.386026 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732633b-a481-4abf-819f-515871bfe87e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:14.389559 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 352/672] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 9 02:18:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:14.390397 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab66044-365b-4e8d-990c-cc33a2b6eb56 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:14.398339 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732633b-a481-4abf-819f-515871bfe87e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:14.399806 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732633b-a481-4abf-819f-515871bfe87e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:14.416670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-0732633b-a481-4abf-819f-515871bfe87e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:14.416670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:14.416670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:14.416670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:14.416670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:14.416670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:14.416670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:14.416670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:14.416670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:14.416670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:14.416670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:14.416670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:14.416670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:14.416670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:14.416670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:14.417608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:14.417608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:14.417608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:14.417608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:14.417608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:14.417608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:14.417608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:14.417608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:14.417608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:14.417608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:14.417608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:14.417608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:14.417608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:14.417608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:14.417608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:14.417608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:14.417608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:14.418554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:14.418554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:14.418554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:14.418554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:14.418554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:14.418554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:14.418554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:14.418554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:14.421761 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 321/673] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:14.423538 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732633b-a481-4abf-819f-515871bfe87e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:14.508788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:14.515144 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:14.519785 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab66044-365b-4e8d-990c-cc33a2b6eb56 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:14.550292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732633b-a481-4abf-819f-515871bfe87e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:14.557052 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2971f163-f348-4f40-bc06-a8b28b3e70bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:14.557699 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971f163-f348-4f40-bc06-a8b28b3e70bc None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:14.557975 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971f163-f348-4f40-bc06-a8b28b3e70bc None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:14.558244 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2971f163-f348-4f40-bc06-a8b28b3e70bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:14.569885 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2971f163-f348-4f40-bc06-a8b28b3e70bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:14.571337 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2971f163-f348-4f40-bc06-a8b28b3e70bc None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:14.586762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-2971f163-f348-4f40-bc06-a8b28b3e70bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:14.586762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:14.586762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:14.586762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:14.586762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:14.586762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:14.586762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:14.586762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:14.586762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:14.586762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:14.586762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:14.586762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:14.586762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:14.586762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:14.586762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:14.586762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:14.587733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:14.587733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:14.587733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:14.587733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:14.587733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:14.587733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:14.587733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:14.587733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:14.587733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:14.587733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:14.587733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:14.587733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:14.587733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:14.587733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:14.587733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:14.587733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:14.587733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:14.588616 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:14.588616 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:14.588616 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:14.588616 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 353/674] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:14.589319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2971f163-f348-4f40-bc06-a8b28b3e70bc None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:14.593104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edcd9c-27e4-4c9a-b532-5369fa313afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:14.593996 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edcd9c-27e4-4c9a-b532-5369fa313afc None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:14.594476 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edcd9c-27e4-4c9a-b532-5369fa313afc None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:14.594972 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edcd9c-27e4-4c9a-b532-5369fa313afc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:14.609718 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3edcd9c-27e4-4c9a-b532-5369fa313afc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:14.612594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3edcd9c-27e4-4c9a-b532-5369fa313afc None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:14.628686 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-f3edcd9c-27e4-4c9a-b532-5369fa313afc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:14.628686 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:14.628686 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:14.628686 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:14.628686 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:14.628686 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:14.628686 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:14.628686 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:14.628686 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:14.628686 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:14.628686 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:14.628686 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:14.628686 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:14.628686 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:14.628686 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:14.628686 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:14.629836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:14.629836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:14.629836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:14.629836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:14.629836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:14.629836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:14.629836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:14.629836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:14.629836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:14.629836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:14.629836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:14.629836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:14.629836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:14.629836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:14.629836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:14.629836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:14.629836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:14.630853 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:14.630853 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:14.630853 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:14.636814 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 322/675] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:14.637858 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edcd9c-27e4-4c9a-b532-5369fa313afc None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:14.695199 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2971f163-f348-4f40-bc06-a8b28b3e70bc None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:14.732189 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8db4eb-740e-4ea5-b821-150bc1da90e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:14.732949 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8db4eb-740e-4ea5-b821-150bc1da90e4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:14.733272 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8db4eb-740e-4ea5-b821-150bc1da90e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:14.733864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8db4eb-740e-4ea5-b821-150bc1da90e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:14.734881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8db4eb-740e-4ea5-b821-150bc1da90e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:14.735190 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8db4eb-740e-4ea5-b821-150bc1da90e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:14.737255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8db4eb-740e-4ea5-b821-150bc1da90e4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:14.742785 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edcd9c-27e4-4c9a-b532-5369fa313afc None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:14.752979 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 354/676] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:14.754394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8db4eb-740e-4ea5-b821-150bc1da90e4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:14.766493 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:14.775949 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:14.780010 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b5cf1-79a2-4db9-a676-4d3e061b99c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:14.780624 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b5cf1-79a2-4db9-a676-4d3e061b99c9 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:14.780907 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b5cf1-79a2-4db9-a676-4d3e061b99c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:14.781215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b5cf1-79a2-4db9-a676-4d3e061b99c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:14.781866 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b5cf1-79a2-4db9-a676-4d3e061b99c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:14.782174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b5cf1-79a2-4db9-a676-4d3e061b99c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:14.783571 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b5cf1-79a2-4db9-a676-4d3e061b99c9 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:14.796792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 323/677] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:14.798415 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebb09d-5940-4cd1-a8f1-2b92f64fbc13 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:14.798874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebb09d-5940-4cd1-a8f1-2b92f64fbc13 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:14.799346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebb09d-5940-4cd1-a8f1-2b92f64fbc13 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:14.800718 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 324/678] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:14.801861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebb09d-5940-4cd1-a8f1-2b92f64fbc13 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:14.875103 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8db4eb-740e-4ea5-b821-150bc1da90e4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:14.910063 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c456a1-ef0b-4eb8-9deb-a98ef23aaba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:14.910662 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c456a1-ef0b-4eb8-9deb-a98ef23aaba9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:14.910938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c456a1-ef0b-4eb8-9deb-a98ef23aaba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:14.911206 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c456a1-ef0b-4eb8-9deb-a98ef23aaba9 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:14.911869 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c456a1-ef0b-4eb8-9deb-a98ef23aaba9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:14.912033 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebb09d-5940-4cd1-a8f1-2b92f64fbc13 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:14.912204 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c456a1-ef0b-4eb8-9deb-a98ef23aaba9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:14.913557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c456a1-ef0b-4eb8-9deb-a98ef23aaba9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:14.925627 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 355/679] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:14.926435 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c456a1-ef0b-4eb8-9deb-a98ef23aaba9 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:14.956122 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16a038-89a1-4e76-ae5b-f286ac163a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:14.956805 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16a038-89a1-4e76-ae5b-f286ac163a08 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:14.957139 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16a038-89a1-4e76-ae5b-f286ac163a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:14.957440 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16a038-89a1-4e76-ae5b-f286ac163a08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:14.958104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16a038-89a1-4e76-ae5b-f286ac163a08 None admin] RBAC: Adding query filter params (role.id=d521e5f58e7e4cd48ceed4404113cbd5, scope.project.id=105476dcda7f48c28224d33c05860d6f, user.id=63645a88f5924a57b5b828aacd856902) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:14.958422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16a038-89a1-4e76-ae5b-f286ac163a08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:14.959836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16a038-89a1-4e76-ae5b-f286ac163a08 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:14.973068 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 325/680] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:18:14 2022] GET /identity/v3/role_assignments?user.id=63645a88f5924a57b5b828aacd856902&scope.project.id=105476dcda7f48c28224d33c05860d6f&role.id=d521e5f58e7e4cd48ceed4404113cbd5 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:14.973068 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddc8e2-c894-4355-87c0-029a732cb428 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:14.973068 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddc8e2-c894-4355-87c0-029a732cb428 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:14.973068 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddc8e2-c894-4355-87c0-029a732cb428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:15.003793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-7cddc8e2-c894-4355-87c0-029a732cb428 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:15.005407 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-7cddc8e2-c894-4355-87c0-029a732cb428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:15.018550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:15.061596 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c456a1-ef0b-4eb8-9deb-a98ef23aaba9 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:15.067557 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:15.105255 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 326/681] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:18:15.105255 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cddc8e2-c894-4355-87c0-029a732cb428 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:15.129395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8860ac-dd0a-411e-9c5b-e51fcbb306e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:15.129974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8860ac-dd0a-411e-9c5b-e51fcbb306e3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:15.130257 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8860ac-dd0a-411e-9c5b-e51fcbb306e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:15.130531 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8860ac-dd0a-411e-9c5b-e51fcbb306e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:15.142050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8860ac-dd0a-411e-9c5b-e51fcbb306e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:15.143754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8860ac-dd0a-411e-9c5b-e51fcbb306e3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:15.158514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-1c8860ac-dd0a-411e-9c5b-e51fcbb306e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:15.158514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:15.158514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:15.158514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:15.158514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:15.158514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:15.158514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:15.158514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:15.158514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:15.158514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:15.158514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:15.158514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:15.158514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:15.158514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:15.158514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:15.159514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:15.159514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:15.159514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:15.159514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:15.159514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:15.159514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:15.159514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:15.159514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:15.159514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:15.159514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:15.159514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:15.159514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:15.159514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:15.159514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:15.159514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:15.159514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:15.159514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:15.160505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:15.160505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:15.160505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:15.160505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:15.160505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:15.160505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:15.160505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:15.160505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:15.160505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 356/682] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:15.160505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8860ac-dd0a-411e-9c5b-e51fcbb306e3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:15.243963 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cddc8e2-c894-4355-87c0-029a732cb428 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:15.284568 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88f52a-8e3e-4260-88b7-395252030922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:15.285445 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88f52a-8e3e-4260-88b7-395252030922 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:15.285831 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88f52a-8e3e-4260-88b7-395252030922 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:15.286206 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88f52a-8e3e-4260-88b7-395252030922 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:15.294652 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb88f52a-8e3e-4260-88b7-395252030922 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:15.296264 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb88f52a-8e3e-4260-88b7-395252030922 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:15.309939 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-bb88f52a-8e3e-4260-88b7-395252030922 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 02:18:15.309939 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:15.309939 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:15.309939 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:15.309939 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:15.309939 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:15.309939 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:15.309939 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:15.309939 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:15.309939 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:15.309939 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:15.309939 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:15.309939 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:18:15.309939 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:18:15.309939 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:18:15.309939 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:18:15.311031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:15.311031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:15.311031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:18:15.311031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:15.311031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:18:15.311031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:15.311031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:15.311031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:15.311031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:15.311031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:15.311031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:15.311031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:15.311031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:15.311031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:15.311031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:15.311031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:15.311031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:15.311031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:15.311950 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:15.311950 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:15.311950 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:18:15.311950 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:18:15.311950 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:18:15.311950 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:18:15.311950 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:18:15.311950 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:18:15.311950 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 02:18:15.311950 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:15.312504 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 327/683] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:18:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:15.313313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88f52a-8e3e-4260-88b7-395252030922 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:15.373480 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:15.423858 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88f52a-8e3e-4260-88b7-395252030922 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:15.434297 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8860ac-dd0a-411e-9c5b-e51fcbb306e3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:15.474426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:15.480108 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a220a16-41fd-4064-812e-ef5193ba9245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:15.480731 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a220a16-41fd-4064-812e-ef5193ba9245 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:15.481010 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a220a16-41fd-4064-812e-ef5193ba9245 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:15.481469 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a220a16-41fd-4064-812e-ef5193ba9245 None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:15.482185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a220a16-41fd-4064-812e-ef5193ba9245 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:15.482720 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a220a16-41fd-4064-812e-ef5193ba9245 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:15.485108 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a220a16-41fd-4064-812e-ef5193ba9245 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:15.489113 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f9d37-cca8-4ff0-b8e0-ee00e132e23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:15.490394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f9d37-cca8-4ff0-b8e0-ee00e132e23e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:15.490886 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f9d37-cca8-4ff0-b8e0-ee00e132e23e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:15.491609 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f9d37-cca8-4ff0-b8e0-ee00e132e23e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:15.504828 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f9d37-cca8-4ff0-b8e0-ee00e132e23e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:18:15.505776 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 328/684] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:15.506676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a220a16-41fd-4064-812e-ef5193ba9245 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:15.511755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-c87f9d37-cca8-4ff0-b8e0-ee00e132e23e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:18:15.511755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:15.511755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:15.511755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:15.511755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:15.511755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:15.511755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:15.511755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:15.511755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:15.511755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:15.511755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:15.511755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:15.511755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:18:15.511755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:18:15.511755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:18:15.511755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:18:15.512718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:18:15.512718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:18:15.512718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:18:15.512718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:18:15.512718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:15.512718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:15.512718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:15.512718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:15.512718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:15.512718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:15.512718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:15.512718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:15.512718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:15.512718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:15.512718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:15.512718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:15.513593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:15.513593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:15.513593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:15.513593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:15.513593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:18:15.513593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:18:15.513593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:18:15.513593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:18:15.513593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:18:15.513593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:18:15.513593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:18:15.513593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:15.516699 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 357/685] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:18:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:15.518697 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f9d37-cca8-4ff0-b8e0-ee00e132e23e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:15.632198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:15.633783 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f9d37-cca8-4ff0-b8e0-ee00e132e23e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:15.643680 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a220a16-41fd-4064-812e-ef5193ba9245 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:15.670533 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07efade-9f98-4d93-961e-12ab0903a627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:15.671159 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07efade-9f98-4d93-961e-12ab0903a627 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:15.671434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07efade-9f98-4d93-961e-12ab0903a627 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:15.671703 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07efade-9f98-4d93-961e-12ab0903a627 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:15.672423 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07efade-9f98-4d93-961e-12ab0903a627 None admin] RBAC: Adding query filter params (role.id=d521e5f58e7e4cd48ceed4404113cbd5, scope.project.id=105476dcda7f48c28224d33c05860d6f, user.id=d608fede6f5e4b339f8de0354cc0562b) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:15.672727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07efade-9f98-4d93-961e-12ab0903a627 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:15.674866 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07efade-9f98-4d93-961e-12ab0903a627 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:15.685389 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 358/686] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:18:15 2022] GET /identity/v3/role_assignments?user.id=d608fede6f5e4b339f8de0354cc0562b&scope.project.id=105476dcda7f48c28224d33c05860d6f&role.id=d521e5f58e7e4cd48ceed4404113cbd5 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:15.686360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07efade-9f98-4d93-961e-12ab0903a627 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:15.690263 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7897bf5-450c-4983-9e7a-d7d6bcce0081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:15.691332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7897bf5-450c-4983-9e7a-d7d6bcce0081 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:15.692031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7897bf5-450c-4983-9e7a-d7d6bcce0081 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:15.692534 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7897bf5-450c-4983-9e7a-d7d6bcce0081 None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:15.693514 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7897bf5-450c-4983-9e7a-d7d6bcce0081 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:15.695006 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7897bf5-450c-4983-9e7a-d7d6bcce0081 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:15.696740 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7897bf5-450c-4983-9e7a-d7d6bcce0081 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:15.718670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 329/687] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Aug 9 02:18:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:15.725151 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7897bf5-450c-4983-9e7a-d7d6bcce0081 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:15.826223 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:15.834786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7897bf5-450c-4983-9e7a-d7d6bcce0081 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:15.876673 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279a343-4863-4ed0-9bb1-ebede07a0b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:15.877743 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279a343-4863-4ed0-9bb1-ebede07a0b56 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:15.878556 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279a343-4863-4ed0-9bb1-ebede07a0b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:15.879025 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279a343-4863-4ed0-9bb1-ebede07a0b56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:15.928486 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07efade-9f98-4d93-961e-12ab0903a627 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:15.929074 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:15.967863 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00738f63-d6e8-4e98-80f6-ac8b55e1e038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:15.969624 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00738f63-d6e8-4e98-80f6-ac8b55e1e038 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:15.970139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00738f63-d6e8-4e98-80f6-ac8b55e1e038 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:15.970622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00738f63-d6e8-4e98-80f6-ac8b55e1e038 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:15.972004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00738f63-d6e8-4e98-80f6-ac8b55e1e038 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:15.972395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00738f63-d6e8-4e98-80f6-ac8b55e1e038 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:15.973899 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00738f63-d6e8-4e98-80f6-ac8b55e1e038 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:15.982939 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 359/688] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:18:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:15.989875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00738f63-d6e8-4e98-80f6-ac8b55e1e038 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:15.998925 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279a343-4863-4ed0-9bb1-ebede07a0b56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:16.001203 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279a343-4863-4ed0-9bb1-ebede07a0b56 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:16.107840 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00738f63-d6e8-4e98-80f6-ac8b55e1e038 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:16.123840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 330/689] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:18:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:18:16.126270 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:16.129751 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279a343-4863-4ed0-9bb1-ebede07a0b56 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:16.145704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065491d-d68c-4976-8d6e-997993c37290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:16.146340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065491d-d68c-4976-8d6e-997993c37290 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:16.146615 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065491d-d68c-4976-8d6e-997993c37290 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:16.146884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065491d-d68c-4976-8d6e-997993c37290 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:16.158174 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065491d-d68c-4976-8d6e-997993c37290 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:16.160274 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065491d-d68c-4976-8d6e-997993c37290 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:16.174504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-b065491d-d68c-4976-8d6e-997993c37290 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:16.174504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:16.174504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:16.174504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:16.174504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:16.174504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:16.174504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:16.174504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:16.174504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:16.174504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:16.174504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:16.174504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:16.174504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:16.174504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:16.174504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:16.174504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:16.175475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:16.175475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:16.175475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:16.175475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:16.175475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:16.175475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:16.175475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:16.175475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:16.175475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:16.175475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:16.175475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:16.175475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:16.175475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:16.175475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:16.175475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:16.175475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:16.175475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:16.176361 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:16.176361 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:16.176361 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:16.176361 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 360/690] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:16.181710 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065491d-d68c-4976-8d6e-997993c37290 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:16.199729 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:16.251733 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279a343-4863-4ed0-9bb1-ebede07a0b56 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:16.294282 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610c9ac-a003-40de-a17c-8d6f3eb41c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:16.295360 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610c9ac-a003-40de-a17c-8d6f3eb41c10 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:16.295537 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065491d-d68c-4976-8d6e-997993c37290 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:16.296022 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610c9ac-a003-40de-a17c-8d6f3eb41c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:16.296502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610c9ac-a003-40de-a17c-8d6f3eb41c10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:16.308262 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610c9ac-a003-40de-a17c-8d6f3eb41c10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:16.310211 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610c9ac-a003-40de-a17c-8d6f3eb41c10 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:16.326848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-7610c9ac-a003-40de-a17c-8d6f3eb41c10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:16.326848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:16.326848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:16.326848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:16.326848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:16.326848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:16.326848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:16.326848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:16.326848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:16.326848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:16.326848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:16.326848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:16.326848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:16.326848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:16.326848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:16.326848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:16.327799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:16.327799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:16.327799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:16.327799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:16.327799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:16.327799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:16.327799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:16.327799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:16.327799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:16.327799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:16.327799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:16.327799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:16.327799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:16.327799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:16.327799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:16.327799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:16.327799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:16.328647 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:16.328647 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:16.328647 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:16.331711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 331/691] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:18:16.333131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75b84b-fbf7-4542-a2d4-7798823a30c0 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:16.333681 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75b84b-fbf7-4542-a2d4-7798823a30c0 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:16.334149 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75b84b-fbf7-4542-a2d4-7798823a30c0 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:16.335810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 332/692] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:16.336790 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75b84b-fbf7-4542-a2d4-7798823a30c0 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:16.338164 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194c431-09e6-4a4c-b90e-d9ccfaa04e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:16.338775 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194c431-09e6-4a4c-b90e-d9ccfaa04e74 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:16.339051 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194c431-09e6-4a4c-b90e-d9ccfaa04e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:16.339550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194c431-09e6-4a4c-b90e-d9ccfaa04e74 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:16.340203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194c431-09e6-4a4c-b90e-d9ccfaa04e74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:16.340506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194c431-09e6-4a4c-b90e-d9ccfaa04e74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:16.342702 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194c431-09e6-4a4c-b90e-d9ccfaa04e74 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:16.355488 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 361/693] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:18:16.361158 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2489bbc-3c1b-44e6-8020-0ea841c21025 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:16.361524 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2489bbc-3c1b-44e6-8020-0ea841c21025 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:16.361797 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2489bbc-3c1b-44e6-8020-0ea841c21025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:16.381129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b2489bbc-3c1b-44e6-8020-0ea841c21025 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:16.382312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b2489bbc-3c1b-44e6-8020-0ea841c21025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:16.408584 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:16.452675 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75b84b-fbf7-4542-a2d4-7798823a30c0 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:16.456220 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 362/694] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:18:16.457660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2489bbc-3c1b-44e6-8020-0ea841c21025 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:16.462290 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:16.493072 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e659e9a-1462-46ca-8349-808571574a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:16.493788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e659e9a-1462-46ca-8349-808571574a30 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:16.494151 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e659e9a-1462-46ca-8349-808571574a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:16.494485 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e659e9a-1462-46ca-8349-808571574a30 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:16.495386 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e659e9a-1462-46ca-8349-808571574a30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:16.495758 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e659e9a-1462-46ca-8349-808571574a30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:16.497304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e659e9a-1462-46ca-8349-808571574a30 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:16.510334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 333/695] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:16.515421 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e659e9a-1462-46ca-8349-808571574a30 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:16.575316 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2489bbc-3c1b-44e6-8020-0ea841c21025 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:16.615147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3148d-ac2a-408d-b2ec-f04f9b866add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:16.616398 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3148d-ac2a-408d-b2ec-f04f9b866add None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:16.616863 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3148d-ac2a-408d-b2ec-f04f9b866add None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:16.617445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3148d-ac2a-408d-b2ec-f04f9b866add None admin] PATH_INFO: `/v3/users/nova` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:16.626039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3148d-ac2a-408d-b2ec-f04f9b866add None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:16.629523 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3148d-ac2a-408d-b2ec-f04f9b866add None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:16.645685 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-46b3148d-ac2a-408d-b2ec-f04f9b866add None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 02:18:16.645685 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:16.645685 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:16.645685 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:16.645685 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:16.645685 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:16.645685 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:16.645685 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:16.645685 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:16.645685 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:16.645685 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:16.645685 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:16.645685 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:18:16.645685 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:18:16.645685 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:18:16.645685 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:18:16.646669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:16.646669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:16.646669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:18:16.646669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:16.646669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:18:16.646669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:16.646669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:16.646669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:16.646669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:16.646669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:16.646669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:16.646669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:16.646669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:16.646669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:16.646669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:16.646669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:16.646669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:16.646669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:16.647640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:16.647640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:16.647640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:18:16.647640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:18:16.647640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:18:16.647640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:18:16.647640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:18:16.647640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:18:16.647640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 02:18:16.647640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:16.654482 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 363/696] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 9 02:18:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:16.655658 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3148d-ac2a-408d-b2ec-f04f9b866add None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:16.697400 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:16.742582 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e659e9a-1462-46ca-8349-808571574a30 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:16.778384 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a31d5-b60e-43e2-8f9e-def45a1b98df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:16.780631 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a31d5-b60e-43e2-8f9e-def45a1b98df None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:16.781180 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a31d5-b60e-43e2-8f9e-def45a1b98df None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:16.781612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a31d5-b60e-43e2-8f9e-def45a1b98df None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:16.782222 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a31d5-b60e-43e2-8f9e-def45a1b98df None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:16.783791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a31d5-b60e-43e2-8f9e-def45a1b98df None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:16.795239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-4b0a31d5-b60e-43e2-8f9e-def45a1b98df None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 02:18:16.795239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:16.795239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 02:18:16.795239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 02:18:16.795239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 02:18:16.795239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 02:18:16.795239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 02:18:16.795239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:16.795239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 02:18:16.795239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:16.795239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:18:16.795239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:16.795239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:16.795239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:16.795239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:16.795239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:16.795239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:16.796487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:16.796487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:16.796487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:16.796487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:16.796487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:16.796487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:16.796487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 02:18:16.796487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 02:18:16.796487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 02:18:16.796487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 02:18:16.796487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:16.796487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:16.796487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:16.796487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:16.796487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:16.796487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:16.797555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:16.797555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:16.797555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:16.797555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:16.797555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:16.797555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:16.797555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:16.797555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:16.797555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:16.797555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:16.797555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 02:18:16.797555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:16.797555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 02:18:16.797555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:16.800276 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 334/697] 10.222.0.16 () {56 vars in 1129 bytes} [Tue Aug 9 02:18:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:16.802002 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a31d5-b60e-43e2-8f9e-def45a1b98df None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:16.806781 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3148d-ac2a-408d-b2ec-f04f9b866add None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:16.846247 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:16.856470 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510ed9d-b2d5-47e6-bb63-84caba1d5b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:16.857363 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510ed9d-b2d5-47e6-bb63-84caba1d5b44 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:16.858772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510ed9d-b2d5-47e6-bb63-84caba1d5b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:16.858772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510ed9d-b2d5-47e6-bb63-84caba1d5b44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:16.866973 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510ed9d-b2d5-47e6-bb63-84caba1d5b44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:16.868757 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510ed9d-b2d5-47e6-bb63-84caba1d5b44 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:16.882005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-0510ed9d-b2d5-47e6-bb63-84caba1d5b44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:16.882005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:16.882005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:16.882005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:16.882005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:16.882005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:16.882005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:16.882005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:16.882005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:16.882005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:16.882005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:16.882005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:16.882005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:16.882005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:16.882005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:16.882947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:16.882947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:16.882947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:16.882947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:16.882947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:16.882947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:16.882947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:16.882947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:16.882947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:16.882947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:16.882947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:16.882947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:16.882947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:16.882947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:16.882947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:16.882947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:16.882947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:16.883823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:16.883823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:16.883823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:16.883823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:16.883823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:16.883823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:16.883823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:16.883823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:16.886303 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 364/698] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:16.887445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510ed9d-b2d5-47e6-bb63-84caba1d5b44 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:16.920616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a31d5-b60e-43e2-8f9e-def45a1b98df None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:16.956757 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cdc12-6b88-4d16-9b5b-b4b8226eb768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:16.957485 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cdc12-6b88-4d16-9b5b-b4b8226eb768 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:16.957921 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cdc12-6b88-4d16-9b5b-b4b8226eb768 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:16.958082 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cdc12-6b88-4d16-9b5b-b4b8226eb768 None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:16.958919 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cdc12-6b88-4d16-9b5b-b4b8226eb768 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:16.959303 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cdc12-6b88-4d16-9b5b-b4b8226eb768 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:16.960853 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cdc12-6b88-4d16-9b5b-b4b8226eb768 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:16.983910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 335/699] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 9 02:18:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:16.984942 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cdc12-6b88-4d16-9b5b-b4b8226eb768 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:17.007565 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:17.047675 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510ed9d-b2d5-47e6-bb63-84caba1d5b44 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:17.086636 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea9b0a-1b17-40ff-9fd0-9ff81658bada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:17.087612 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea9b0a-1b17-40ff-9fd0-9ff81658bada None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:17.088116 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea9b0a-1b17-40ff-9fd0-9ff81658bada None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:17.088604 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea9b0a-1b17-40ff-9fd0-9ff81658bada None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:17.089561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea9b0a-1b17-40ff-9fd0-9ff81658bada None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:17.090090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea9b0a-1b17-40ff-9fd0-9ff81658bada None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:17.091722 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea9b0a-1b17-40ff-9fd0-9ff81658bada None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:17.101887 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 365/700] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 9 02:18:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:17.103182 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea9b0a-1b17-40ff-9fd0-9ff81658bada None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:17.118550 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:17.135807 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cdc12-6b88-4d16-9b5b-b4b8226eb768 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:17.206247 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b265bfe-2371-49aa-b249-3edd0a82fdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:17.207170 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b265bfe-2371-49aa-b249-3edd0a82fdb9 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:17.207452 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b265bfe-2371-49aa-b249-3edd0a82fdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:17.207723 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b265bfe-2371-49aa-b249-3edd0a82fdb9 None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:17.208438 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b265bfe-2371-49aa-b249-3edd0a82fdb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:17.208751 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b265bfe-2371-49aa-b249-3edd0a82fdb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:17.211207 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b265bfe-2371-49aa-b249-3edd0a82fdb9 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:17.236292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 336/701] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:17.238452 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b265bfe-2371-49aa-b249-3edd0a82fdb9 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:17.247644 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea9b0a-1b17-40ff-9fd0-9ff81658bada None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:17.282786 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd175f-6609-4ff8-b531-d02970d52b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:17.284111 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd175f-6609-4ff8-b531-d02970d52b9f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:17.284395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd175f-6609-4ff8-b531-d02970d52b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:17.284666 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd175f-6609-4ff8-b531-d02970d52b9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:17.300959 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:17.353641 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b265bfe-2371-49aa-b249-3edd0a82fdb9 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:17.362029 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd175f-6609-4ff8-b531-d02970d52b9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:17.363710 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd175f-6609-4ff8-b531-d02970d52b9f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:17.388994 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1063a-e08c-4402-aac2-1a977e46ce3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:17.389642 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1063a-e08c-4402-aac2-1a977e46ce3b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:17.389927 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1063a-e08c-4402-aac2-1a977e46ce3b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:17.390182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1063a-e08c-4402-aac2-1a977e46ce3b None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:17.390810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1063a-e08c-4402-aac2-1a977e46ce3b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:17.391114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1063a-e08c-4402-aac2-1a977e46ce3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:17.392464 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1063a-e08c-4402-aac2-1a977e46ce3b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:17.397937 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 337/702] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 9 02:18:17 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:17.398712 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1063a-e08c-4402-aac2-1a977e46ce3b None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:17.414594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:17.505048 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 366/703] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:18:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 02:18:17.505048 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6a71d-927a-470b-87f7-6f744a6685de None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:17.505048 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6a71d-927a-470b-87f7-6f744a6685de None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:17.505048 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6a71d-927a-470b-87f7-6f744a6685de None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:17.505048 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 367/704] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:17.510325 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6a71d-927a-470b-87f7-6f744a6685de None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:17.520812 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1063a-e08c-4402-aac2-1a977e46ce3b None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:17.560373 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a550b9-0a7b-4d2b-a253-20def8d0a1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:17.560905 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a550b9-0a7b-4d2b-a253-20def8d0a1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:17.561233 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a550b9-0a7b-4d2b-a253-20def8d0a1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:17.561504 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a550b9-0a7b-4d2b-a253-20def8d0a1a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:17.562242 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a550b9-0a7b-4d2b-a253-20def8d0a1a3 None admin] RBAC: Adding query filter params (role.id=d521e5f58e7e4cd48ceed4404113cbd5, scope.project.id=105476dcda7f48c28224d33c05860d6f, user.id=9151f210d29542dcb41ea3bc03390350) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:17.562684 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a550b9-0a7b-4d2b-a253-20def8d0a1a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:17.564302 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a550b9-0a7b-4d2b-a253-20def8d0a1a3 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:17.577354 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 338/705] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:18:17 2022] GET /identity/v3/role_assignments?user.id=9151f210d29542dcb41ea3bc03390350&scope.project.id=105476dcda7f48c28224d33c05860d6f&role.id=d521e5f58e7e4cd48ceed4404113cbd5 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:17.578094 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:17.580085 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400acc3-4695-400e-9bb8-fcb9966c5bf6 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:17.580361 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400acc3-4695-400e-9bb8-fcb9966c5bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:17.580644 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400acc3-4695-400e-9bb8-fcb9966c5bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:17.602220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-d400acc3-4695-400e-9bb8-fcb9966c5bf6 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:17.603474 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d400acc3-4695-400e-9bb8-fcb9966c5bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:17.670690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6a71d-927a-470b-87f7-6f744a6685de None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:17.698258 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 339/706] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:18:17.714738 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af58c2-0249-4aa0-80eb-c83e7c50b0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:17.715383 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af58c2-0249-4aa0-80eb-c83e7c50b0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:17.715660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af58c2-0249-4aa0-80eb-c83e7c50b0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:17.715931 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af58c2-0249-4aa0-80eb-c83e7c50b0c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:17.727400 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400acc3-4695-400e-9bb8-fcb9966c5bf6 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:17.728271 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af58c2-0249-4aa0-80eb-c83e7c50b0c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:17.729856 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af58c2-0249-4aa0-80eb-c83e7c50b0c4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:17.745964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:17.748673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-14af58c2-0249-4aa0-80eb-c83e7c50b0c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:17.748673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:17.748673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:17.748673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:17.748673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:17.748673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:17.748673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:17.748673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:17.748673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:17.748673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:17.748673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:17.748673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:17.748673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:17.748673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:17.748673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:17.748673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:17.749643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:17.749643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:17.749643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:17.749643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:17.749643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:17.749643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:17.749643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:17.749643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:17.749643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:17.749643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:17.749643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:17.749643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:17.749643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:17.749643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:17.749643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:17.749643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:17.749643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:17.750555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:17.750555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:17.750555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:17.750555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 368/707] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:18:17.761925 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af58c2-0249-4aa0-80eb-c83e7c50b0c4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:17.881691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400acc3-4695-400e-9bb8-fcb9966c5bf6 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:17.889985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:17.900216 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af58c2-0249-4aa0-80eb-c83e7c50b0c4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:17.926922 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a987875-c1f7-453a-b5ab-2c4d655528fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:17.927696 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a987875-c1f7-453a-b5ab-2c4d655528fd None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:17.928616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a987875-c1f7-453a-b5ab-2c4d655528fd None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:17.928991 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a987875-c1f7-453a-b5ab-2c4d655528fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:17.942837 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a987875-c1f7-453a-b5ab-2c4d655528fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:17.944388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a987875-c1f7-453a-b5ab-2c4d655528fd None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:17.945454 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bde8a-2d74-4867-8c5b-547df3cec96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:17.946252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bde8a-2d74-4867-8c5b-547df3cec96f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:17.946859 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bde8a-2d74-4867-8c5b-547df3cec96f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:17.947280 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bde8a-2d74-4867-8c5b-547df3cec96f None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:17.948396 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523bde8a-2d74-4867-8c5b-547df3cec96f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:17.948892 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523bde8a-2d74-4867-8c5b-547df3cec96f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:17.950617 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523bde8a-2d74-4867-8c5b-547df3cec96f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:17.963708 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-6a987875-c1f7-453a-b5ab-2c4d655528fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:17.963708 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:17.963708 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:17.963708 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:17.963708 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:17.963708 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:17.963708 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:17.963708 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:17.963708 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:17.963708 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:17.963708 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:17.963708 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:17.963708 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:17.963708 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:17.963708 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:17.963708 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:17.964719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:17.964719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:17.964719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:17.964719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:17.964719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:17.964719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:17.964719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:17.964719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:17.964719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:17.964719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:17.964719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:17.964719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:17.964719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:17.964719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:17.964719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:17.964719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:17.964719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:17.965661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:17.965661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:17.965661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:17.965661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 340/708] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:17.974137 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 369/709] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:17.976630 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a987875-c1f7-453a-b5ab-2c4d655528fd None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:17.980253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bde8a-2d74-4867-8c5b-547df3cec96f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:18.056107 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:18.118266 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bde8a-2d74-4867-8c5b-547df3cec96f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:18.123880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a987875-c1f7-453a-b5ab-2c4d655528fd None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:18.156755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21483c71-de5f-4669-9e88-faed9f349e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:18.157787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21483c71-de5f-4669-9e88-faed9f349e26 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:18.158354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21483c71-de5f-4669-9e88-faed9f349e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:18.158873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21483c71-de5f-4669-9e88-faed9f349e26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:18.166150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12069ddd-8e71-4d97-b8ad-6097861fa83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:18.166764 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12069ddd-8e71-4d97-b8ad-6097861fa83c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:18.167044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12069ddd-8e71-4d97-b8ad-6097861fa83c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:18.167381 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12069ddd-8e71-4d97-b8ad-6097861fa83c None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:18.168039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12069ddd-8e71-4d97-b8ad-6097861fa83c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:18.168349 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12069ddd-8e71-4d97-b8ad-6097861fa83c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:18.169860 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21483c71-de5f-4669-9e88-faed9f349e26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:18.170047 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12069ddd-8e71-4d97-b8ad-6097861fa83c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:18.171708 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21483c71-de5f-4669-9e88-faed9f349e26 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:18.184934 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 341/710] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:18.186735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-21483c71-de5f-4669-9e88-faed9f349e26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:18.186735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:18.186735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:18.186735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:18.186735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:18.186735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:18.186735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:18.186735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:18.186735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:18.186735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:18.186735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:18.186735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:18.186735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:18.186735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:18.186735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:18.187606 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:18.187606 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:18.187606 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:18.187606 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:18.187606 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:18.187606 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:18.187606 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:18.187606 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:18.187606 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:18.187606 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:18.187606 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:18.187606 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:18.187606 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:18.187606 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:18.187606 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:18.187606 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:18.187606 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:18.188503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:18.188503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:18.188503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:18.188503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:18.188503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:18.188503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:18.188503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:18.188503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:18.192617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c784e08-a7ac-4617-8365-ef523fb9f64c None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:18.192617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c784e08-a7ac-4617-8365-ef523fb9f64c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:18.192617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c784e08-a7ac-4617-8365-ef523fb9f64c None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:18.193670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 342/711] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:18.194199 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 370/712] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:18.197863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c784e08-a7ac-4617-8365-ef523fb9f64c None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:18.199404 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98437736-c28d-4697-964b-bdb671da9e77 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:18.199686 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98437736-c28d-4697-964b-bdb671da9e77 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:18.199962 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98437736-c28d-4697-964b-bdb671da9e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:18.220383 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-98437736-c28d-4697-964b-bdb671da9e77 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:18.222207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-98437736-c28d-4697-964b-bdb671da9e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:18.236960 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:18.325326 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 371/713] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 02:18:18.326254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98437736-c28d-4697-964b-bdb671da9e77 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:18.326387 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c784e08-a7ac-4617-8365-ef523fb9f64c None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:18.345330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:18.366433 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3215f-8996-4534-8c93-6f15a9258065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:18.367284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3215f-8996-4534-8c93-6f15a9258065 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:18.367769 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3215f-8996-4534-8c93-6f15a9258065 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:18.368288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3215f-8996-4534-8c93-6f15a9258065 None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:18.369201 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3215f-8996-4534-8c93-6f15a9258065 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:18.370799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3215f-8996-4534-8c93-6f15a9258065 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:18.398397 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 343/714] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 9 02:18:18 2022] POST /identity/v3/users => generated 254 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:18:18.400191 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3215f-8996-4534-8c93-6f15a9258065 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:18.457139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98437736-c28d-4697-964b-bdb671da9e77 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:18.509988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36ddb1-64eb-409d-b9e5-8c5ecbe3c8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:18.511538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36ddb1-64eb-409d-b9e5-8c5ecbe3c8c9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:18.511969 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36ddb1-64eb-409d-b9e5-8c5ecbe3c8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:18.512399 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36ddb1-64eb-409d-b9e5-8c5ecbe3c8c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:18.513305 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36ddb1-64eb-409d-b9e5-8c5ecbe3c8c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:18.513813 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36ddb1-64eb-409d-b9e5-8c5ecbe3c8c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:18.515599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36ddb1-64eb-409d-b9e5-8c5ecbe3c8c9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:18.531704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 372/715] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:18.538949 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36ddb1-64eb-409d-b9e5-8c5ecbe3c8c9 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:18.553908 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:18.562456 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3215f-8996-4534-8c93-6f15a9258065 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:18.618551 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb562be-0937-4f26-a7df-3e51a0f5ffa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:18.619204 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb562be-0937-4f26-a7df-3e51a0f5ffa7 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:18.624831 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb562be-0937-4f26-a7df-3e51a0f5ffa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:18.625150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb562be-0937-4f26-a7df-3e51a0f5ffa7 None admin] PATH_INFO: `/v3/services/network` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:18.625769 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb562be-0937-4f26-a7df-3e51a0f5ffa7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:18.627700 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb562be-0937-4f26-a7df-3e51a0f5ffa7 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:18.641930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-1fb562be-0937-4f26-a7df-3e51a0f5ffa7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 02:18:18.641930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:18.641930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 02:18:18.641930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 02:18:18.641930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 02:18:18.641930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 02:18:18.641930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 02:18:18.641930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:18.641930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 02:18:18.641930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:18.641930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:18:18.641930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:18.641930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:18.641930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:18.641930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:18.641930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:18.641930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:18.643542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:18.643542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:18.643542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:18.643542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:18.643542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:18.643542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:18.643542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 02:18:18.643542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 02:18:18.643542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 02:18:18.643542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 02:18:18.643542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:18.643542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:18.643542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:18.643542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:18.643542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:18.643542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:18.644385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:18.644385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:18.644385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:18.644385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:18.644385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:18.644385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:18.644385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:18.644385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:18.644385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:18.644385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:18.644385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 02:18:18.644385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:18.644385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 02:18:18.644385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:18.649062 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 344/716] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:18 2022] GET /identity/v3/services/network => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:18.651723 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb562be-0937-4f26-a7df-3e51a0f5ffa7 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:18.699291 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36ddb1-64eb-409d-b9e5-8c5ecbe3c8c9 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:18.700402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:18.740401 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53ad1e-aa6e-43ab-a62d-cb5f2205aac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:18.741563 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53ad1e-aa6e-43ab-a62d-cb5f2205aac8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:18.741993 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53ad1e-aa6e-43ab-a62d-cb5f2205aac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:18.742411 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53ad1e-aa6e-43ab-a62d-cb5f2205aac8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:18.743288 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53ad1e-aa6e-43ab-a62d-cb5f2205aac8 None admin] RBAC: Adding query filter params (role.id=e2095c5a29d74c33b9dcb16f8e5343bf, scope.project.id=105476dcda7f48c28224d33c05860d6f, user.id=78fff294b9794a26aa1bbc231fa1133c) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:18.743768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53ad1e-aa6e-43ab-a62d-cb5f2205aac8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:18.745516 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53ad1e-aa6e-43ab-a62d-cb5f2205aac8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:18.755427 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 373/717] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:18:18 2022] GET /identity/v3/role_assignments?user.id=78fff294b9794a26aa1bbc231fa1133c&scope.project.id=105476dcda7f48c28224d33c05860d6f&role.id=e2095c5a29d74c33b9dcb16f8e5343bf => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:18:18.775533 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb562be-0937-4f26-a7df-3e51a0f5ffa7 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:18.815435 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037b0a3-9144-4870-b61e-9ff2e44ef095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:18.816293 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037b0a3-9144-4870-b61e-9ff2e44ef095 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:18.816665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037b0a3-9144-4870-b61e-9ff2e44ef095 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:18.817056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037b0a3-9144-4870-b61e-9ff2e44ef095 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:18.817795 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037b0a3-9144-4870-b61e-9ff2e44ef095 None admin] RBAC: Adding query filter params (name=network) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:18.818196 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037b0a3-9144-4870-b61e-9ff2e44ef095 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:18.819699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037b0a3-9144-4870-b61e-9ff2e44ef095 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:18.825408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 345/718] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 9 02:18:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:18.831792 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53ad1e-aa6e-43ab-a62d-cb5f2205aac8 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:18.920408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:18.962937 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53ad1e-aa6e-43ab-a62d-cb5f2205aac8 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:18.998002 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bec293-8833-4f54-968f-438788a466de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:18.998542 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bec293-8833-4f54-968f-438788a466de None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:18.998820 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bec293-8833-4f54-968f-438788a466de None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:18.999091 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bec293-8833-4f54-968f-438788a466de None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:18.999720 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bec293-8833-4f54-968f-438788a466de None admin] RBAC: Adding query filter params (type=network) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:19.000025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bec293-8833-4f54-968f-438788a466de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:19.001416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bec293-8833-4f54-968f-438788a466de None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:19.008021 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 374/719] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 9 02:18:18 2022] GET /identity/v3/services?type=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:19.875268 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660549f2-4a10-4307-88ab-4df07d5d16e6 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:19.875783 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660549f2-4a10-4307-88ab-4df07d5d16e6 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:19.875886 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660549f2-4a10-4307-88ab-4df07d5d16e6 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:19.877495 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 346/720] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:19.882213 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99137df4-92ca-45ea-b125-2b346eecc7ff None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:19.882596 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99137df4-92ca-45ea-b125-2b346eecc7ff None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:19.882771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99137df4-92ca-45ea-b125-2b346eecc7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:19.909972 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-99137df4-92ca-45ea-b125-2b346eecc7ff None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:19.911186 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-99137df4-92ca-45ea-b125-2b346eecc7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:20.004182 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 375/721] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:18:20.036602 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660549f2-4a10-4307-88ab-4df07d5d16e6 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:20.186755 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660549f2-4a10-4307-88ab-4df07d5d16e6 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:20.188292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:20.237838 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feba77a-5a03-448d-bbe8-6ed81a98db0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:20.238702 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feba77a-5a03-448d-bbe8-6ed81a98db0b None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:20.239136 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feba77a-5a03-448d-bbe8-6ed81a98db0b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:20.239559 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feba77a-5a03-448d-bbe8-6ed81a98db0b None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:20.240408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feba77a-5a03-448d-bbe8-6ed81a98db0b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:20.242219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feba77a-5a03-448d-bbe8-6ed81a98db0b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:20.274629 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 347/722] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 9 02:18:20 2022] POST /identity/v3/services => generated 251 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:18:20.487746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559948c-0387-47ee-9aa4-a3e51cdb2de3 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:20.488294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559948c-0387-47ee-9aa4-a3e51cdb2de3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:20.488718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559948c-0387-47ee-9aa4-a3e51cdb2de3 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:20.490612 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 376/723] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:20.501672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76236e1-9e5e-41ae-a59b-5b34dd918c67 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:20.502235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76236e1-9e5e-41ae-a59b-5b34dd918c67 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:20.502686 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76236e1-9e5e-41ae-a59b-5b34dd918c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:20.528231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a76236e1-9e5e-41ae-a59b-5b34dd918c67 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:20.529595 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a76236e1-9e5e-41ae-a59b-5b34dd918c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:20.625416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 348/724] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:20 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:18:20.649840 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559948c-0387-47ee-9aa4-a3e51cdb2de3 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:20.719300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:20.778719 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559948c-0387-47ee-9aa4-a3e51cdb2de3 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:20.823583 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d06e2-fc91-4e27-be08-324ca9c81b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:20.824221 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d06e2-fc91-4e27-be08-324ca9c81b14 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:20.824497 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d06e2-fc91-4e27-be08-324ca9c81b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:20.824767 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d06e2-fc91-4e27-be08-324ca9c81b14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:20.843846 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d06e2-fc91-4e27-be08-324ca9c81b14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:18:20.848591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-fe3d06e2-fc91-4e27-be08-324ca9c81b14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:18:20.848591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:20.848591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:20.848591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:20.848591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:20.848591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:20.848591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:20.848591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:20.848591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:20.848591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:20.848591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:20.848591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:20.848591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:18:20.848591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:18:20.848591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:18:20.848591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:18:20.849575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:18:20.849575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:18:20.849575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:18:20.849575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:18:20.849575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:20.849575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:20.849575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:20.849575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:20.849575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:20.849575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:20.849575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:20.849575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:20.849575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:20.849575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:20.849575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:20.849575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:20.850877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:20.850877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:20.850877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:20.850877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:20.850877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:18:20.850877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:18:20.850877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:18:20.850877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:18:20.850877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:18:20.850877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:18:20.850877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:18:20.850877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:20.850877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 377/725] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:18:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:20.856137 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76236e1-9e5e-41ae-a59b-5b34dd918c67 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:20.996118 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:21.013956 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76236e1-9e5e-41ae-a59b-5b34dd918c67 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:21.062302 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fa600-51ae-4bc4-b025-01c4a5d631fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:21.062839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fa600-51ae-4bc4-b025-01c4a5d631fa None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:21.063122 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fa600-51ae-4bc4-b025-01c4a5d631fa None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:21.063393 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fa600-51ae-4bc4-b025-01c4a5d631fa None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:21.064063 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fa600-51ae-4bc4-b025-01c4a5d631fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:21.065051 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fa600-51ae-4bc4-b025-01c4a5d631fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:21.066404 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fa600-51ae-4bc4-b025-01c4a5d631fa None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:21.081736 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 349/726] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:18:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:21.087160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d06e2-fc91-4e27-be08-324ca9c81b14 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:21.142683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f3a86-40fb-4782-9785-eadab875599d None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:21.143169 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f3a86-40fb-4782-9785-eadab875599d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:21.143445 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f3a86-40fb-4782-9785-eadab875599d None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:21.145055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 350/727] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:21.150529 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab7370-f3ed-416a-a930-a047acfcc481 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:21.150825 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab7370-f3ed-416a-a930-a047acfcc481 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:21.151083 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab7370-f3ed-416a-a930-a047acfcc481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:21.172379 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-6fab7370-f3ed-416a-a930-a047acfcc481 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:21.174176 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6fab7370-f3ed-416a-a930-a047acfcc481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:21.239849 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d06e2-fc91-4e27-be08-324ca9c81b14 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:21.249362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 351/728] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:18:21.251139 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cadb96-5c9a-4b0c-9930-5997614aa0c8 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:21.251661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cadb96-5c9a-4b0c-9930-5997614aa0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:21.252733 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cadb96-5c9a-4b0c-9930-5997614aa0c8 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:21.254523 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 352/729] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:21.260966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b7525-e624-48f3-a57a-eb6f0bc3ab72 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:21.261441 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b7525-e624-48f3-a57a-eb6f0bc3ab72 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:21.262016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b7525-e624-48f3-a57a-eb6f0bc3ab72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:21.272823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:21.284986 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b195dcf-2b4c-4fb5-9520-187a1589de5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:21.285584 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-b60b7525-e624-48f3-a57a-eb6f0bc3ab72 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:21.285916 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b195dcf-2b4c-4fb5-9520-187a1589de5a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:21.286291 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b195dcf-2b4c-4fb5-9520-187a1589de5a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:21.286655 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b195dcf-2b4c-4fb5-9520-187a1589de5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:21.287445 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b60b7525-e624-48f3-a57a-eb6f0bc3ab72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:21.297911 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b195dcf-2b4c-4fb5-9520-187a1589de5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:21.300022 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b195dcf-2b4c-4fb5-9520-187a1589de5a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:21.315403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-2b195dcf-2b4c-4fb5-9520-187a1589de5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:21.315403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:21.315403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:21.315403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:21.315403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:21.315403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:21.315403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:21.315403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:21.315403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:21.315403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:21.315403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:21.315403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:21.315403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:21.315403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:21.315403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:21.315403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:21.316538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:21.316538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:21.316538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:21.316538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:21.316538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:21.316538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:21.316538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:21.316538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:21.316538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:21.316538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:21.316538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:21.316538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:21.316538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:21.316538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:21.316538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:21.316538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:21.316538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:21.317666 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:21.317666 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:21.317666 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:21.319633 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 378/730] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:21.320506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b195dcf-2b4c-4fb5-9520-187a1589de5a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:21.379426 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 353/731] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:18:21.379426 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b7525-e624-48f3-a57a-eb6f0bc3ab72 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:21.391779 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:21.469823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b195dcf-2b4c-4fb5-9520-187a1589de5a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:21.503890 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b7525-e624-48f3-a57a-eb6f0bc3ab72 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:21.516532 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf541f-7f3f-4172-ae9f-251506be8a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:21.517445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf541f-7f3f-4172-ae9f-251506be8a11 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:21.518174 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf541f-7f3f-4172-ae9f-251506be8a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:21.518634 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf541f-7f3f-4172-ae9f-251506be8a11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:21.532219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf541f-7f3f-4172-ae9f-251506be8a11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:18:21.538586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-1caf541f-7f3f-4172-ae9f-251506be8a11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:21.538586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:21.538586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:21.538586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:21.538586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:21.538586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:21.538586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:21.538586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:21.538586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:21.538586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:21.538586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:21.538586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:21.538586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:18:21.538586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:18:21.538586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:18:21.538586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:18:21.539521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:18:21.539521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:18:21.539521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:18:21.539521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:18:21.539521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:21.539521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:21.539521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:21.539521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:21.539521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:21.539521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:21.539521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:21.539521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:21.539521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:21.539521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:21.539521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:21.539521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:21.540353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:21.540353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:21.540353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:21.540353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:21.540353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:18:21.540353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:18:21.540353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:18:21.540353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:18:21.540353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:18:21.540353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:18:21.540353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:21.540353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:21.540353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 379/732] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 9 02:18:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:21.541067 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf541f-7f3f-4172-ae9f-251506be8a11 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:21.546265 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746c5ac-fa86-4baf-bfea-a811fd2ddb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:21.547075 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746c5ac-fa86-4baf-bfea-a811fd2ddb91 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:21.547504 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746c5ac-fa86-4baf-bfea-a811fd2ddb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:21.547921 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746c5ac-fa86-4baf-bfea-a811fd2ddb91 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:21.549325 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746c5ac-fa86-4baf-bfea-a811fd2ddb91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:21.549805 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746c5ac-fa86-4baf-bfea-a811fd2ddb91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:21.551313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746c5ac-fa86-4baf-bfea-a811fd2ddb91 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:21.567236 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 354/733] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:21.568247 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746c5ac-fa86-4baf-bfea-a811fd2ddb91 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:21.588576 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:21.655196 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:21.656242 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf541f-7f3f-4172-ae9f-251506be8a11 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:21.689028 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746c5ac-fa86-4baf-bfea-a811fd2ddb91 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:21.691823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7b656-782c-4782-b398-c039e2c9d9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:21.692452 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7b656-782c-4782-b398-c039e2c9d9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:21.692733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7b656-782c-4782-b398-c039e2c9d9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:21.693006 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7b656-782c-4782-b398-c039e2c9d9a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:21.703244 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7b656-782c-4782-b398-c039e2c9d9a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:18:21.707943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-28e7b656-782c-4782-b398-c039e2c9d9a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:18:21.707943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:21.707943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:21.707943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:21.707943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:21.707943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:21.707943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:21.707943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:21.707943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:21.707943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:21.707943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:21.707943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:21.707943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:18:21.707943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:18:21.707943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:18:21.707943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:18:21.708868 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:18:21.708868 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:18:21.708868 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:18:21.708868 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:18:21.708868 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:21.708868 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:21.708868 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:21.708868 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:21.708868 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:21.708868 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:21.708868 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:21.708868 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:21.708868 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:21.708868 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:21.708868 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:21.708868 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:21.709723 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:21.709723 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:21.709723 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:21.709723 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:21.709723 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:18:21.709723 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:18:21.709723 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:18:21.709723 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:18:21.709723 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:18:21.709723 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:18:21.709723 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:18:21.709723 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:21.713871 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 380/734] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:18:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:21.714697 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7b656-782c-4782-b398-c039e2c9d9a9 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:21.725833 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93a405-cc13-4e98-98af-82cf3be07fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:21.726776 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93a405-cc13-4e98-98af-82cf3be07fbf None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:21.727065 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93a405-cc13-4e98-98af-82cf3be07fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:21.727664 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93a405-cc13-4e98-98af-82cf3be07fbf None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:21.728369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93a405-cc13-4e98-98af-82cf3be07fbf None admin] RBAC: Adding query filter params (name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:21.728641 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93a405-cc13-4e98-98af-82cf3be07fbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:21.730041 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93a405-cc13-4e98-98af-82cf3be07fbf None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:21.744198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 355/735] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 9 02:18:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:21.744198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb78e0-d31f-4732-8cad-229d20bd4798 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:21.744198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb78e0-d31f-4732-8cad-229d20bd4798 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:21.744198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb78e0-d31f-4732-8cad-229d20bd4798 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:21.744198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 356/736] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:21.744198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb78e0-d31f-4732-8cad-229d20bd4798 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:21.823795 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:21.832973 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7b656-782c-4782-b398-c039e2c9d9a9 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:21.854842 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb78e0-d31f-4732-8cad-229d20bd4798 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:21.873152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32f78f-2ff2-4845-8679-c78ab44ce850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:21.873784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32f78f-2ff2-4845-8679-c78ab44ce850 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:21.874068 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32f78f-2ff2-4845-8679-c78ab44ce850 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:21.874367 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32f78f-2ff2-4845-8679-c78ab44ce850 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:21.881630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32f78f-2ff2-4845-8679-c78ab44ce850 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:21.883151 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32f78f-2ff2-4845-8679-c78ab44ce850 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:21.886564 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:21.892787 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf629a3-4e8e-4a37-8af9-7c4fd1147af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:21.893429 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf629a3-4e8e-4a37-8af9-7c4fd1147af1 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:21.893717 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf629a3-4e8e-4a37-8af9-7c4fd1147af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:21.893990 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf629a3-4e8e-4a37-8af9-7c4fd1147af1 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:21.894653 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf629a3-4e8e-4a37-8af9-7c4fd1147af1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:21.894959 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf629a3-4e8e-4a37-8af9-7c4fd1147af1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:21.895259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-fa32f78f-2ff2-4845-8679-c78ab44ce850 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 02:18:21.895259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:21.895259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:21.895259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:21.895259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:21.895259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:21.895259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:21.895259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:21.895259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:21.895259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:21.895259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:21.895259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:21.895259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:18:21.895259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:18:21.895259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:18:21.895259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:18:21.896187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:21.896187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:21.896187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:18:21.896187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:21.896187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:18:21.896187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:21.896187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:21.896187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:21.896187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:21.896187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:21.896187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:21.896187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:21.896187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:21.896187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:21.896187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:21.896187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:21.896187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:21.896187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:21.902301 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:21.902301 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:21.902301 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:18:21.902301 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:18:21.902301 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:18:21.902301 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:18:21.902301 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:18:21.902301 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:18:21.902301 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 02:18:21.902301 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:21.902839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf629a3-4e8e-4a37-8af9-7c4fd1147af1 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:21.902910 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 381/737] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:18:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:21.902910 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32f78f-2ff2-4845-8679-c78ab44ce850 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:21.911361 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 357/738] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:18:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:21.916821 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd8a4e-17ee-4c37-878f-413d64227e43 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:21.917132 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd8a4e-17ee-4c37-878f-413d64227e43 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:21.917409 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd8a4e-17ee-4c37-878f-413d64227e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:21.934722 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-5cfd8a4e-17ee-4c37-878f-413d64227e43 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:21.935936 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5cfd8a4e-17ee-4c37-878f-413d64227e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:22.013597 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32f78f-2ff2-4845-8679-c78ab44ce850 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:22.017866 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 358/739] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 02:18:22.019351 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd8a4e-17ee-4c37-878f-413d64227e43 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:22.049923 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a28c9-09b0-45c5-8d1c-f7a2b6c7b002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:22.050573 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a28c9-09b0-45c5-8d1c-f7a2b6c7b002 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:22.050829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a28c9-09b0-45c5-8d1c-f7a2b6c7b002 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:22.051102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a28c9-09b0-45c5-8d1c-f7a2b6c7b002 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:22.062763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a28c9-09b0-45c5-8d1c-f7a2b6c7b002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:22.063589 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a28c9-09b0-45c5-8d1c-f7a2b6c7b002 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:22.078160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-1e0a28c9-09b0-45c5-8d1c-f7a2b6c7b002 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:22.078160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:22.078160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:22.078160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:22.078160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:22.078160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:22.078160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:22.078160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:22.078160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:22.078160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:22.078160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:22.078160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:22.078160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:22.078160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:22.078160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:22.078160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:22.079090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:22.079090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:22.079090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:22.079090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:22.079090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:22.079090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:22.079090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:22.079090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:22.079090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:22.079090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:22.079090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:22.079090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:22.079090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:22.079090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:22.079090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:22.079090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:22.079090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:22.080529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:22.080529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:22.080529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:22.080529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 382/740] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:22.080529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a28c9-09b0-45c5-8d1c-f7a2b6c7b002 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:22.093929 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:22.135186 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd8a4e-17ee-4c37-878f-413d64227e43 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:22.161094 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:22.173760 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6af6ac-86ce-4913-b51a-68bd051da020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:22.174665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6af6ac-86ce-4913-b51a-68bd051da020 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:22.175156 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6af6ac-86ce-4913-b51a-68bd051da020 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:22.175582 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6af6ac-86ce-4913-b51a-68bd051da020 None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:22.176489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6af6ac-86ce-4913-b51a-68bd051da020 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:22.176950 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6af6ac-86ce-4913-b51a-68bd051da020 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:22.178561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6af6ac-86ce-4913-b51a-68bd051da020 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:22.191283 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a28c9-09b0-45c5-8d1c-f7a2b6c7b002 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:22.197387 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 359/741] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Aug 9 02:18:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:22.198524 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6af6ac-86ce-4913-b51a-68bd051da020 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:22.231791 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cac0ed-5f8d-4c43-be4e-e30d49113762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:22.232432 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cac0ed-5f8d-4c43-be4e-e30d49113762 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:22.232719 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cac0ed-5f8d-4c43-be4e-e30d49113762 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:22.232994 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cac0ed-5f8d-4c43-be4e-e30d49113762 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:22.244037 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cac0ed-5f8d-4c43-be4e-e30d49113762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:22.245542 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cac0ed-5f8d-4c43-be4e-e30d49113762 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:22.260469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-04cac0ed-5f8d-4c43-be4e-e30d49113762 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:22.260469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:22.260469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:22.260469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:22.260469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:22.260469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:22.260469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:22.260469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:22.260469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:22.260469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:22.260469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:22.260469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:22.260469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:22.260469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:22.260469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:22.260469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:22.261474 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:22.261474 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:22.261474 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:22.261474 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:22.261474 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:22.261474 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:22.261474 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:22.261474 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:22.261474 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:22.261474 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:22.261474 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:22.261474 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:22.261474 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:22.261474 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:22.261474 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:22.261474 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:22.261474 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:22.262351 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:22.262351 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:22.262351 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:22.262351 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 383/742] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:22.262351 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cac0ed-5f8d-4c43-be4e-e30d49113762 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:22.316858 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6af6ac-86ce-4913-b51a-68bd051da020 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:22.340423 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:22.355830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79bfcb-4c48-4421-af0f-4adbd5de5471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:22.356446 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79bfcb-4c48-4421-af0f-4adbd5de5471 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:22.356728 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79bfcb-4c48-4421-af0f-4adbd5de5471 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:22.357003 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79bfcb-4c48-4421-af0f-4adbd5de5471 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:22.358095 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79bfcb-4c48-4421-af0f-4adbd5de5471 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:22.359856 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79bfcb-4c48-4421-af0f-4adbd5de5471 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:22.379052 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 360/743] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 9 02:18:22 2022] POST /identity/v3/services => generated 240 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:18:22.379879 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79bfcb-4c48-4421-af0f-4adbd5de5471 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:22.397603 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cac0ed-5f8d-4c43-be4e-e30d49113762 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:22.449853 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0253083-c2f8-4b94-954f-86e67d14ba68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:22.450968 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0253083-c2f8-4b94-954f-86e67d14ba68 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:22.451500 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0253083-c2f8-4b94-954f-86e67d14ba68 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:22.451818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:22.452152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0253083-c2f8-4b94-954f-86e67d14ba68 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:22.453053 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0253083-c2f8-4b94-954f-86e67d14ba68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:22.453615 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0253083-c2f8-4b94-954f-86e67d14ba68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:22.455878 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0253083-c2f8-4b94-954f-86e67d14ba68 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:22.469937 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 384/744] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:22.471285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0253083-c2f8-4b94-954f-86e67d14ba68 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:22.533579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79bfcb-4c48-4421-af0f-4adbd5de5471 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:22.582538 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d891793-7e61-436f-93ee-f6437340483a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:22.583302 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d891793-7e61-436f-93ee-f6437340483a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:22.583584 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d891793-7e61-436f-93ee-f6437340483a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:22.583855 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d891793-7e61-436f-93ee-f6437340483a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:22.608999 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0253083-c2f8-4b94-954f-86e67d14ba68 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:22.630790 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:22.651555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076e37e-8f40-45f7-8589-c2eaac23e887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:22.653128 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076e37e-8f40-45f7-8589-c2eaac23e887 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:22.653885 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076e37e-8f40-45f7-8589-c2eaac23e887 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:22.654365 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076e37e-8f40-45f7-8589-c2eaac23e887 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:22.655868 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076e37e-8f40-45f7-8589-c2eaac23e887 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:22.656542 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076e37e-8f40-45f7-8589-c2eaac23e887 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:22.659125 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076e37e-8f40-45f7-8589-c2eaac23e887 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:22.668786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d891793-7e61-436f-93ee-f6437340483a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:22.670393 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d891793-7e61-436f-93ee-f6437340483a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:22.675493 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 385/745] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:22.676576 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076e37e-8f40-45f7-8589-c2eaac23e887 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:22.721400 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:22.787421 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 361/746] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:18:22 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 02:18:22.788587 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d891793-7e61-436f-93ee-f6437340483a None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:22.797329 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076e37e-8f40-45f7-8589-c2eaac23e887 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:22.840306 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28faac9-89b9-4454-87d1-c1ed57bc8f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:22.841479 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28faac9-89b9-4454-87d1-c1ed57bc8f49 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:22.841863 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28faac9-89b9-4454-87d1-c1ed57bc8f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:22.842236 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28faac9-89b9-4454-87d1-c1ed57bc8f49 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:22.850910 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28faac9-89b9-4454-87d1-c1ed57bc8f49 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:22.852345 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28faac9-89b9-4454-87d1-c1ed57bc8f49 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:22.863881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-b28faac9-89b9-4454-87d1-c1ed57bc8f49 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 02:18:22.863881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:22.863881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:22.863881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:22.863881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:22.863881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:22.863881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:22.863881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:22.863881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:22.863881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:22.863881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:22.863881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:22.863881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:18:22.863881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:18:22.863881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:18:22.863881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:18:22.864823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:22.864823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:22.864823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:18:22.864823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:22.864823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:18:22.864823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:22.864823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:22.864823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:22.864823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:22.864823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:22.864823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:22.864823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:22.864823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:22.864823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:22.864823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:22.864823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:22.864823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:22.864823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:22.866059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:22.866059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:22.866059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:18:22.866059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:18:22.866059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:18:22.866059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:18:22.866059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:18:22.866059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:18:22.866059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 02:18:22.866059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:22.866059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 386/747] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 9 02:18:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:22.867132 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213ac74-7fe4-42a9-b9bc-e65827f71f92 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:22.867132 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213ac74-7fe4-42a9-b9bc-e65827f71f92 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:22.867376 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213ac74-7fe4-42a9-b9bc-e65827f71f92 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:22.872436 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 387/748] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:22.873199 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213ac74-7fe4-42a9-b9bc-e65827f71f92 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:22.902614 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d891793-7e61-436f-93ee-f6437340483a None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:22.911288 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:22.941414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6587414-a054-4a00-b0ae-665a513aeb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:22.942046 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6587414-a054-4a00-b0ae-665a513aeb99 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:22.942323 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6587414-a054-4a00-b0ae-665a513aeb99 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:22.942594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6587414-a054-4a00-b0ae-665a513aeb99 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:22.949758 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6587414-a054-4a00-b0ae-665a513aeb99 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:22.951191 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6587414-a054-4a00-b0ae-665a513aeb99 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:22.963503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-c6587414-a054-4a00-b0ae-665a513aeb99 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 02:18:22.963503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:22.963503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:22.963503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:22.963503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:22.963503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:22.963503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:22.963503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:22.963503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:22.963503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:22.963503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:22.963503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:22.963503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:18:22.963503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:18:22.963503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:18:22.963503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:18:22.964672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:22.964672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:22.964672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:18:22.964672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:22.964672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:18:22.964672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:22.964672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:22.964672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:22.964672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:22.964672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:22.964672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:22.964672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:22.964672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:22.964672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:22.964672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:22.964672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:22.964672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:22.964672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:22.965966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:22.965966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:22.965966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:18:22.965966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:18:22.965966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:18:22.965966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:18:22.965966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:18:22.965966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:18:22.965966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 02:18:22.965966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:22.969245 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 362/749] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 9 02:18:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:22.972796 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6587414-a054-4a00-b0ae-665a513aeb99 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:22.975726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:22.993739 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213ac74-7fe4-42a9-b9bc-e65827f71f92 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:23.027884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f79603-ee2c-46a7-8f9f-f39bfb559b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:23.028715 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f79603-ee2c-46a7-8f9f-f39bfb559b23 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:23.029213 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f79603-ee2c-46a7-8f9f-f39bfb559b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:23.029488 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f79603-ee2c-46a7-8f9f-f39bfb559b23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:23.040897 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f79603-ee2c-46a7-8f9f-f39bfb559b23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:23.042379 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f79603-ee2c-46a7-8f9f-f39bfb559b23 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:23.057300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-f4f79603-ee2c-46a7-8f9f-f39bfb559b23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:23.057300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:23.057300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:23.057300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:23.057300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:23.057300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:23.057300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:23.057300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:23.057300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:23.057300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:23.057300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:23.057300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:23.057300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:23.057300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:23.057300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:23.057300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:23.058289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:23.058289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:23.058289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:23.058289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:23.058289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:23.058289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:23.058289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:23.058289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:23.058289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:23.058289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:23.058289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:23.058289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:23.058289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:23.058289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:23.058289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:23.058289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:23.058289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:23.059169 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:23.059169 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:23.059169 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:23.059169 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 388/750] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:23.059911 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54e16e-7db4-4cda-8d77-416f9ade02a6 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:23.059911 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54e16e-7db4-4cda-8d77-416f9ade02a6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:23.060048 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54e16e-7db4-4cda-8d77-416f9ade02a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:23.078554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ca54e16e-7db4-4cda-8d77-416f9ade02a6 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:23.079786 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ca54e16e-7db4-4cda-8d77-416f9ade02a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:23.085770 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6587414-a054-4a00-b0ae-665a513aeb99 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:23.121301 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572ad43-9a4c-4f1c-b8e5-c9ce96d74e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:23.121936 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572ad43-9a4c-4f1c-b8e5-c9ce96d74e19 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:23.122220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572ad43-9a4c-4f1c-b8e5-c9ce96d74e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:23.122496 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572ad43-9a4c-4f1c-b8e5-c9ce96d74e19 None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:23.123230 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572ad43-9a4c-4f1c-b8e5-c9ce96d74e19 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:23.123541 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572ad43-9a4c-4f1c-b8e5-c9ce96d74e19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:23.124967 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572ad43-9a4c-4f1c-b8e5-c9ce96d74e19 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:23.143136 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 363/751] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Aug 9 02:18:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:23.143970 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572ad43-9a4c-4f1c-b8e5-c9ce96d74e19 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:23.164140 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 389/752] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:23.165685 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54e16e-7db4-4cda-8d77-416f9ade02a6 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:23.188312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:23.223253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:23.266754 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572ad43-9a4c-4f1c-b8e5-c9ce96d74e19 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:23.280692 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54e16e-7db4-4cda-8d77-416f9ade02a6 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:23.302429 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb1ce8-1a78-454d-87e0-af6f4315b1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:23.303035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb1ce8-1a78-454d-87e0-af6f4315b1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:23.303347 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb1ce8-1a78-454d-87e0-af6f4315b1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:23.303596 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb1ce8-1a78-454d-87e0-af6f4315b1e0 None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:23.304325 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb1ce8-1a78-454d-87e0-af6f4315b1e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:23.304634 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb1ce8-1a78-454d-87e0-af6f4315b1e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:23.306103 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb1ce8-1a78-454d-87e0-af6f4315b1e0 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:23.324142 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0594bb2-8e0a-4812-a4e7-13c917a5424e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:23.324741 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0594bb2-8e0a-4812-a4e7-13c917a5424e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:23.325036 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0594bb2-8e0a-4812-a4e7-13c917a5424e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:23.325306 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0594bb2-8e0a-4812-a4e7-13c917a5424e None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:23.325966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0594bb2-8e0a-4812-a4e7-13c917a5424e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:23.326266 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0594bb2-8e0a-4812-a4e7-13c917a5424e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:23.327625 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0594bb2-8e0a-4812-a4e7-13c917a5424e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:23.328875 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 364/753] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 9 02:18:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:23.330417 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb1ce8-1a78-454d-87e0-af6f4315b1e0 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:23.340094 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 390/754] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:23.345047 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0594bb2-8e0a-4812-a4e7-13c917a5424e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:23.425597 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:23.438168 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb1ce8-1a78-454d-87e0-af6f4315b1e0 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:23.450128 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0594bb2-8e0a-4812-a4e7-13c917a5424e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:23.458156 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:23.477652 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be975576-8c3b-48a7-9db3-926fac82e8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:23.478261 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be975576-8c3b-48a7-9db3-926fac82e8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:23.478608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be975576-8c3b-48a7-9db3-926fac82e8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:23.479121 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be975576-8c3b-48a7-9db3-926fac82e8b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:23.483795 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77973bb1-9e42-4520-8cf9-a4f2b4a9ca90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:23.484417 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77973bb1-9e42-4520-8cf9-a4f2b4a9ca90 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:23.484697 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77973bb1-9e42-4520-8cf9-a4f2b4a9ca90 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:23.484968 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77973bb1-9e42-4520-8cf9-a4f2b4a9ca90 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:23.485585 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77973bb1-9e42-4520-8cf9-a4f2b4a9ca90 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:23.487507 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77973bb1-9e42-4520-8cf9-a4f2b4a9ca90 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:23.498704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-77973bb1-9e42-4520-8cf9-a4f2b4a9ca90 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 02:18:23.498704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:23.498704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 02:18:23.498704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 02:18:23.498704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 02:18:23.498704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 02:18:23.498704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 02:18:23.498704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:23.498704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 02:18:23.498704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:23.498704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:18:23.498704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:23.498704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:23.498704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:23.498704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:23.498704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:23.498704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:23.499676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:23.499676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:23.499676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:23.499676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:23.499676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:23.499676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:23.499676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 02:18:23.499676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 02:18:23.499676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 02:18:23.499676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 02:18:23.499676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:23.499676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:23.499676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:23.499676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:23.499676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:23.499676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:23.500503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:23.500503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:23.500503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:23.500503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:23.500503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:23.500503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:23.500503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:23.500503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:23.500503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:23.500503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:23.500503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 02:18:23.500503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:23.500503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 02:18:23.500503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:23.505368 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 391/755] 10.222.0.16 () {56 vars in 1129 bytes} [Tue Aug 9 02:18:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:23.506104 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77973bb1-9e42-4520-8cf9-a4f2b4a9ca90 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:23.552109 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be975576-8c3b-48a7-9db3-926fac82e8b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:23.553643 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be975576-8c3b-48a7-9db3-926fac82e8b9 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:23.609657 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77973bb1-9e42-4520-8cf9-a4f2b4a9ca90 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:23.645448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d3375-728f-48b8-b016-cecd68eb7184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:23.646069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d3375-728f-48b8-b016-cecd68eb7184 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:23.646347 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d3375-728f-48b8-b016-cecd68eb7184 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:23.646617 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d3375-728f-48b8-b016-cecd68eb7184 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:23.656667 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d3375-728f-48b8-b016-cecd68eb7184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:23.658179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d3375-728f-48b8-b016-cecd68eb7184 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:23.659929 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:23.668030 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 365/756] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:18:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 02:18:23.668030 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be975576-8c3b-48a7-9db3-926fac82e8b9 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:23.678025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-508d3375-728f-48b8-b016-cecd68eb7184 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:23.678025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:23.678025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:23.678025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:23.678025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:23.678025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:23.678025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:23.678025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:23.678025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:23.678025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:23.678025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:23.678025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:23.678025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:23.678025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:23.678025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:23.678025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:23.679120 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:23.679120 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:23.679120 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:23.679120 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:23.679120 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:23.679120 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:23.679120 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:23.679120 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:23.679120 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:23.679120 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:23.679120 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:23.679120 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:23.679120 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:23.679120 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:23.679120 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:23.679120 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:23.679120 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:23.680390 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:23.680390 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:23.680390 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:23.681407 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 392/757] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:23.682659 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d3375-728f-48b8-b016-cecd68eb7184 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:23.690817 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:23.778576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be975576-8c3b-48a7-9db3-926fac82e8b9 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:23.786074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d3375-728f-48b8-b016-cecd68eb7184 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:23.814700 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89506b-3e4c-4971-b995-148a72e86bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:23.815328 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89506b-3e4c-4971-b995-148a72e86bee None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:23.815635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89506b-3e4c-4971-b995-148a72e86bee None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:23.815878 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89506b-3e4c-4971-b995-148a72e86bee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:23.820781 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95826d40-74e3-42bd-971b-a6d4faa5c380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:23.821404 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95826d40-74e3-42bd-971b-a6d4faa5c380 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:23.821695 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95826d40-74e3-42bd-971b-a6d4faa5c380 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:23.821964 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95826d40-74e3-42bd-971b-a6d4faa5c380 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:23.822597 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95826d40-74e3-42bd-971b-a6d4faa5c380 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:23.822795 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89506b-3e4c-4971-b995-148a72e86bee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:23.822893 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95826d40-74e3-42bd-971b-a6d4faa5c380 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:23.824210 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89506b-3e4c-4971-b995-148a72e86bee None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:23.824323 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95826d40-74e3-42bd-971b-a6d4faa5c380 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:23.833320 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 393/758] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 9 02:18:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:23.833320 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95826d40-74e3-42bd-971b-a6d4faa5c380 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:23.839388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-3c89506b-3e4c-4971-b995-148a72e86bee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:23.839388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:23.839388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:23.839388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:23.839388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:23.839388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:23.839388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:23.839388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:23.839388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:23.839388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:23.839388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:23.839388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:23.839388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:23.839388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:23.839388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:23.840243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:23.840243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:23.840243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:23.840243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:23.840243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:23.840243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:23.840243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:23.840243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:23.840243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:23.840243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:23.840243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:23.840243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:23.840243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:23.840243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:23.840243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:23.840243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:23.840243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:23.846292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:23.846292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:23.846292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:23.846292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:23.846292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:23.846292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:23.846292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:23.846292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:23.846292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 366/759] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:23.846292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89506b-3e4c-4971-b995-148a72e86bee None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:23.898587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:23.927591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:23.944225 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95826d40-74e3-42bd-971b-a6d4faa5c380 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:23.951099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89506b-3e4c-4971-b995-148a72e86bee None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:23.988754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc9865-9839-403c-88b6-ed434334fbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:23.989415 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc9865-9839-403c-88b6-ed434334fbd2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:23.989692 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc9865-9839-403c-88b6-ed434334fbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:23.989962 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc9865-9839-403c-88b6-ed434334fbd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:23.991339 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9090c-3c8f-4b7c-9e63-3a66d1da4c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:23.991944 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9090c-3c8f-4b7c-9e63-3a66d1da4c2c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:23.992242 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9090c-3c8f-4b7c-9e63-3a66d1da4c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:23.992504 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9090c-3c8f-4b7c-9e63-3a66d1da4c2c None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:23.993193 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9090c-3c8f-4b7c-9e63-3a66d1da4c2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:23.993501 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9090c-3c8f-4b7c-9e63-3a66d1da4c2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:23.994875 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9090c-3c8f-4b7c-9e63-3a66d1da4c2c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:24.001478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc9865-9839-403c-88b6-ed434334fbd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:24.003018 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc9865-9839-403c-88b6-ed434334fbd2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:24.007028 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 367/760] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:24.012042 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9090c-3c8f-4b7c-9e63-3a66d1da4c2c None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:24.017742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-b3bc9865-9839-403c-88b6-ed434334fbd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:24.017742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:24.017742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:24.017742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:24.017742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:24.017742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:24.017742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:24.017742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:24.017742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:24.017742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:24.017742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:24.017742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:24.017742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:24.017742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:24.017742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:24.017742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:24.018643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:24.018643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:24.018643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:24.018643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:24.018643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:24.018643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:24.018643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:24.018643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:24.018643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:24.018643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:24.018643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:24.018643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:24.018643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:24.018643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:24.018643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:24.018643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:24.018643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:24.019547 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:24.019547 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:24.019547 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:24.019547 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 394/761] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:24.019764 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc9865-9839-403c-88b6-ed434334fbd2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:24.119325 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9090c-3c8f-4b7c-9e63-3a66d1da4c2c None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:24.132709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc9865-9839-403c-88b6-ed434334fbd2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:24.145226 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:24.155377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a7521-c7d7-49ab-9da5-cd9486cdb85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:24.155991 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a7521-c7d7-49ab-9da5-cd9486cdb85b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:24.156281 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a7521-c7d7-49ab-9da5-cd9486cdb85b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:24.156551 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a7521-c7d7-49ab-9da5-cd9486cdb85b None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:24.157218 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a7521-c7d7-49ab-9da5-cd9486cdb85b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:24.157528 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a7521-c7d7-49ab-9da5-cd9486cdb85b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:24.159446 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a7521-c7d7-49ab-9da5-cd9486cdb85b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:24.164279 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 368/762] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 9 02:18:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:24.165076 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a7521-c7d7-49ab-9da5-cd9486cdb85b None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:24.167500 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:24.176230 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15afdfcd-d6df-47e5-9101-c5c7297a1df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:24.177385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afdfcd-d6df-47e5-9101-c5c7297a1df3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:24.177803 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afdfcd-d6df-47e5-9101-c5c7297a1df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:24.178220 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afdfcd-d6df-47e5-9101-c5c7297a1df3 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:24.179094 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15afdfcd-d6df-47e5-9101-c5c7297a1df3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:24.179403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15afdfcd-d6df-47e5-9101-c5c7297a1df3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:24.180829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15afdfcd-d6df-47e5-9101-c5c7297a1df3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:24.197134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 395/763] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:24.197134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15afdfcd-d6df-47e5-9101-c5c7297a1df3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:24.277403 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a7521-c7d7-49ab-9da5-cd9486cdb85b None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:24.300549 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15afdfcd-d6df-47e5-9101-c5c7297a1df3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:24.316736 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890c853-5aa9-4ba6-8bfb-76aac26025c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:24.317387 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890c853-5aa9-4ba6-8bfb-76aac26025c3 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:24.317660 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890c853-5aa9-4ba6-8bfb-76aac26025c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:24.317926 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890c853-5aa9-4ba6-8bfb-76aac26025c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:24.324481 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890c853-5aa9-4ba6-8bfb-76aac26025c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:24.325939 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890c853-5aa9-4ba6-8bfb-76aac26025c3 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:24.337579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-d890c853-5aa9-4ba6-8bfb-76aac26025c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:24.337579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:24.337579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:24.337579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:24.337579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:24.337579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:24.337579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:24.337579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:24.337579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:24.337579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:24.337579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:24.337579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:24.337579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:24.337579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:24.337579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:24.338566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:24.338566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:24.338566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:24.338566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:24.338566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:24.338566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:24.338566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:24.338566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:24.338566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:24.338566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:24.338566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:24.338566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:24.338566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:24.338566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:24.338566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:24.338566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:24.338566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:24.340083 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:24.340083 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:24.340083 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:24.340083 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:24.340083 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:24.340083 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:24.340083 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:24.340083 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:24.340083 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 369/764] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:24.340083 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890c853-5aa9-4ba6-8bfb-76aac26025c3 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:24.345075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e59a5-5710-47e7-9437-f59ab2d7f3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:24.346250 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e59a5-5710-47e7-9437-f59ab2d7f3ce None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:24.346530 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e59a5-5710-47e7-9437-f59ab2d7f3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:24.346802 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e59a5-5710-47e7-9437-f59ab2d7f3ce None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:24.347458 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e59a5-5710-47e7-9437-f59ab2d7f3ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:24.347763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e59a5-5710-47e7-9437-f59ab2d7f3ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:24.349162 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e59a5-5710-47e7-9437-f59ab2d7f3ce None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:24.361339 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 396/765] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:24.362000 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e59a5-5710-47e7-9437-f59ab2d7f3ce None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:24.393666 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:24.412518 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:24.454209 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890c853-5aa9-4ba6-8bfb-76aac26025c3 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:24.465356 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e59a5-5710-47e7-9437-f59ab2d7f3ce None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:24.490538 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac971ff9-58c2-462a-b754-38d9f664f1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:24.491397 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac971ff9-58c2-462a-b754-38d9f664f1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:24.491677 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac971ff9-58c2-462a-b754-38d9f664f1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:24.491950 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac971ff9-58c2-462a-b754-38d9f664f1e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:24.492656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac971ff9-58c2-462a-b754-38d9f664f1e2 None admin] RBAC: Adding query filter params (interface=public, service_id=d031a7d088d84551a29030d5c839bd38, region_id=RegionOne) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:24.492967 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac971ff9-58c2-462a-b754-38d9f664f1e2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:24.494387 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac971ff9-58c2-462a-b754-38d9f664f1e2 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:24.498448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4c64e-4749-445d-8eca-c6b7f473d0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:24.499040 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4c64e-4749-445d-8eca-c6b7f473d0ee None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:24.499313 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4c64e-4749-445d-8eca-c6b7f473d0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:24.499583 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4c64e-4749-445d-8eca-c6b7f473d0ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:24.500299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4c64e-4749-445d-8eca-c6b7f473d0ee None admin] RBAC: Adding query filter params (role.id=e2095c5a29d74c33b9dcb16f8e5343bf, scope.project.id=105476dcda7f48c28224d33c05860d6f, user.id=9151f210d29542dcb41ea3bc03390350) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:24.500606 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4c64e-4749-445d-8eca-c6b7f473d0ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:24.506956 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4c64e-4749-445d-8eca-c6b7f473d0ee None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:24.507111 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 370/766] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 9 02:18:24 2022] GET /identity/v3/endpoints?service_id=d031a7d088d84551a29030d5c839bd38&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:24.507111 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac971ff9-58c2-462a-b754-38d9f664f1e2 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:24.511447 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 397/767] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:18:24 2022] GET /identity/v3/role_assignments?user.id=9151f210d29542dcb41ea3bc03390350&scope.project.id=105476dcda7f48c28224d33c05860d6f&role.id=e2095c5a29d74c33b9dcb16f8e5343bf => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:24.512333 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4c64e-4749-445d-8eca-c6b7f473d0ee None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:24.620490 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac971ff9-58c2-462a-b754-38d9f664f1e2 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:24.620707 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:24.629751 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4c64e-4749-445d-8eca-c6b7f473d0ee None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:24.650374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:24.660553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144fc9d-3b9a-4475-97db-bfb29349b5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:24.660776 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144fc9d-3b9a-4475-97db-bfb29349b5ba None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:24.661086 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144fc9d-3b9a-4475-97db-bfb29349b5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:24.661370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144fc9d-3b9a-4475-97db-bfb29349b5ba None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:24.662067 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c144fc9d-3b9a-4475-97db-bfb29349b5ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:24.662662 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c144fc9d-3b9a-4475-97db-bfb29349b5ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:24.663810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c144fc9d-3b9a-4475-97db-bfb29349b5ba None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:24.675190 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fcd8a-2b7d-4abb-adce-d0f7d950f827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:24.675829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fcd8a-2b7d-4abb-adce-d0f7d950f827 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:24.676108 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fcd8a-2b7d-4abb-adce-d0f7d950f827 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:24.676620 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 371/768] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:24.677769 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fbe4d-1b9d-4bf5-af98-01b396832ac6 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:24.678050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fbe4d-1b9d-4bf5-af98-01b396832ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:24.678315 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fbe4d-1b9d-4bf5-af98-01b396832ac6 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:24.683431 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 372/769] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:24.683431 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fbe4d-1b9d-4bf5-af98-01b396832ac6 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:24.683671 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fcd8a-2b7d-4abb-adce-d0f7d950f827 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:24.688745 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44fcd8a-2b7d-4abb-adce-d0f7d950f827 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:24.690771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44fcd8a-2b7d-4abb-adce-d0f7d950f827 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:24.702139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-c44fcd8a-2b7d-4abb-adce-d0f7d950f827 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:24.702139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:24.702139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:24.702139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:24.702139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:24.702139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:24.702139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:24.702139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:24.702139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:24.702139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:24.702139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:24.702139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:24.702139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:24.702139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:24.702139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:24.703083 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:24.703083 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:24.703083 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:24.703083 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:24.703083 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:24.703083 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:24.703083 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:24.703083 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:24.703083 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:24.703083 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:24.703083 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:24.703083 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:24.703083 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:24.703083 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:24.703083 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:24.703083 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:24.703083 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:24.703983 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:24.703983 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:24.703983 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:24.703983 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:24.703983 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:24.703983 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:24.703983 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:24.703983 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:24.708512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 398/770] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:24.709387 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fcd8a-2b7d-4abb-adce-d0f7d950f827 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:24.791231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fbe4d-1b9d-4bf5-af98-01b396832ac6 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:24.815730 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fcd8a-2b7d-4abb-adce-d0f7d950f827 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:24.827409 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e8b88-7496-4378-8c57-8b3a64919025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:24.828023 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e8b88-7496-4378-8c57-8b3a64919025 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:24.828306 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e8b88-7496-4378-8c57-8b3a64919025 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:24.828636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e8b88-7496-4378-8c57-8b3a64919025 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:24.829284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e8b88-7496-4378-8c57-8b3a64919025 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:24.831239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e8b88-7496-4378-8c57-8b3a64919025 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:24.844516 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 373/771] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 9 02:18:24 2022] GET /identity/v3/services => generated 772 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:24.844516 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5e1bd-6b3c-46cc-9a25-0592fe486c40 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:24.844516 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5e1bd-6b3c-46cc-9a25-0592fe486c40 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:24.844516 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5e1bd-6b3c-46cc-9a25-0592fe486c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:24.863043 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-90d5e1bd-6b3c-46cc-9a25-0592fe486c40 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:24.864978 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-90d5e1bd-6b3c-46cc-9a25-0592fe486c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:24.868587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd1b34-0469-43dd-90d1-87cd78fecb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:24.869371 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd1b34-0469-43dd-90d1-87cd78fecb2e None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:24.869717 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd1b34-0469-43dd-90d1-87cd78fecb2e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:24.870051 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd1b34-0469-43dd-90d1-87cd78fecb2e None admin] PATH_INFO: `/v3/projects/105476dcda7f48c28224d33c05860d6f/users/78fff294b9794a26aa1bbc231fa1133c/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:24.872155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd1b34-0469-43dd-90d1-87cd78fecb2e None admin] RBAC: Authorizing `identity:create_grant(project_id=105476dcda7f48c28224d33c05860d6f, user_id=78fff294b9794a26aa1bbc231fa1133c, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:24.873776 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd1b34-0469-43dd-90d1-87cd78fecb2e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:24.891462 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 399/772] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 9 02:18:24 2022] PUT /identity/v3/projects/105476dcda7f48c28224d33c05860d6f/users/78fff294b9794a26aa1bbc231fa1133c/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:18:24.892359 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd1b34-0469-43dd-90d1-87cd78fecb2e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:24.941771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:24.961437 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:24.998844 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 374/773] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:25.040704 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5e1bd-6b3c-46cc-9a25-0592fe486c40 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:25.086634 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd1b34-0469-43dd-90d1-87cd78fecb2e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:25.135833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5d8b5-e667-4082-96d3-c5a30b4f9318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:25.136486 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5d8b5-e667-4082-96d3-c5a30b4f9318 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:25.136769 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5d8b5-e667-4082-96d3-c5a30b4f9318 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:25.137062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5d8b5-e667-4082-96d3-c5a30b4f9318 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:25.137772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5d8b5-e667-4082-96d3-c5a30b4f9318 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:25.138080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5d8b5-e667-4082-96d3-c5a30b4f9318 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:25.139526 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5d8b5-e667-4082-96d3-c5a30b4f9318 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:25.154291 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 400/774] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:25.159876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5d8b5-e667-4082-96d3-c5a30b4f9318 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:25.162099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5e1bd-6b3c-46cc-9a25-0592fe486c40 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:25.211290 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a8554-491d-48d3-b243-b713ab8a6489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:25.212567 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a8554-491d-48d3-b243-b713ab8a6489 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:25.213033 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a8554-491d-48d3-b243-b713ab8a6489 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:25.213889 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a8554-491d-48d3-b243-b713ab8a6489 None admin] PATH_INFO: `/v3/services/network` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:25.214655 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a8554-491d-48d3-b243-b713ab8a6489 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:25.216190 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a8554-491d-48d3-b243-b713ab8a6489 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:25.229834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-664a8554-491d-48d3-b243-b713ab8a6489 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 02:18:25.229834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:25.229834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 02:18:25.229834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 02:18:25.229834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 02:18:25.229834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 02:18:25.229834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 02:18:25.229834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:25.229834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 02:18:25.229834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:25.229834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:18:25.229834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:25.229834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:25.229834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:25.229834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:25.229834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:25.229834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:25.231099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:25.231099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:25.231099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:25.231099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:25.231099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:25.231099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:25.231099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 02:18:25.231099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 02:18:25.231099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 02:18:25.231099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 02:18:25.231099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:25.231099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:25.231099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:25.231099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:25.231099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:25.231099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:25.232130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:25.232130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:25.232130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:25.232130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:25.232130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:25.232130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:25.232130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:25.232130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:25.232130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:25.232130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:25.232130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 02:18:25.232130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:25.232130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 02:18:25.232130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:25.235550 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 375/775] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:25 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:25.244103 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a8554-491d-48d3-b243-b713ab8a6489 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:25.247468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:25.276582 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5d8b5-e667-4082-96d3-c5a30b4f9318 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:25.322830 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286012f0-eb95-44d9-b8e7-3b9848698207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:25.323657 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286012f0-eb95-44d9-b8e7-3b9848698207 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:25.324032 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286012f0-eb95-44d9-b8e7-3b9848698207 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:25.324403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286012f0-eb95-44d9-b8e7-3b9848698207 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:25.324576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:25.325348 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286012f0-eb95-44d9-b8e7-3b9848698207 None admin] RBAC: Adding query filter params (role.id=d521e5f58e7e4cd48ceed4404113cbd5, scope.project.id=105476dcda7f48c28224d33c05860d6f, user.id=07041df2276d4dd58fb0e49417a26e2c) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:25.325758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286012f0-eb95-44d9-b8e7-3b9848698207 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:25.327502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286012f0-eb95-44d9-b8e7-3b9848698207 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:25.341573 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 401/776] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:18:25 2022] GET /identity/v3/role_assignments?user.id=07041df2276d4dd58fb0e49417a26e2c&scope.project.id=105476dcda7f48c28224d33c05860d6f&role.id=d521e5f58e7e4cd48ceed4404113cbd5 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:18:25.403598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a8554-491d-48d3-b243-b713ab8a6489 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:25.449697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23e187-c562-4953-a5e5-342162ffeef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:25.450758 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23e187-c562-4953-a5e5-342162ffeef5 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:25.451191 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23e187-c562-4953-a5e5-342162ffeef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:25.451615 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23e187-c562-4953-a5e5-342162ffeef5 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:25.452411 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23e187-c562-4953-a5e5-342162ffeef5 None admin] RBAC: Adding query filter params (name=network) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:25.452899 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23e187-c562-4953-a5e5-342162ffeef5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:25.454753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23e187-c562-4953-a5e5-342162ffeef5 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:25.460662 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 376/777] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 9 02:18:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:25.469123 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286012f0-eb95-44d9-b8e7-3b9848698207 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:25.594411 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286012f0-eb95-44d9-b8e7-3b9848698207 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:25.634695 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4be649-39a5-45af-ae8d-9dcbca4d194b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:25.635457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4be649-39a5-45af-ae8d-9dcbca4d194b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:25.635837 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4be649-39a5-45af-ae8d-9dcbca4d194b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:25.636201 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4be649-39a5-45af-ae8d-9dcbca4d194b None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:25.636936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4be649-39a5-45af-ae8d-9dcbca4d194b None admin] RBAC: Adding query filter params (type=network) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:25.637362 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4be649-39a5-45af-ae8d-9dcbca4d194b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:25.638836 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4be649-39a5-45af-ae8d-9dcbca4d194b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:25.649447 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 402/778] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 9 02:18:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:25.651628 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23e187-c562-4953-a5e5-342162ffeef5 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:25.778578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23e187-c562-4953-a5e5-342162ffeef5 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:25.788472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:25.821654 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4ee59-ca49-47fa-9f9d-9a40d2fe027d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:25.822276 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4ee59-ca49-47fa-9f9d-9a40d2fe027d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:25.822561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4ee59-ca49-47fa-9f9d-9a40d2fe027d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:25.822838 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4ee59-ca49-47fa-9f9d-9a40d2fe027d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:25.823548 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4ee59-ca49-47fa-9f9d-9a40d2fe027d None admin] RBAC: Adding query filter params (interface=public, service_id=631b709a5ba54ac0937d88a390774e3d, region_id=RegionOne) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:25.823861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4ee59-ca49-47fa-9f9d-9a40d2fe027d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:25.825260 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4ee59-ca49-47fa-9f9d-9a40d2fe027d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:25.831695 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 377/779] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 9 02:18:25 2022] GET /identity/v3/endpoints?service_id=631b709a5ba54ac0937d88a390774e3d&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:25.837013 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4be649-39a5-45af-ae8d-9dcbca4d194b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:25.841336 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:25.963478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4be649-39a5-45af-ae8d-9dcbca4d194b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:26.005038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128c9eb-6f9b-4d54-ae6d-ebbaef54d2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:26.005715 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128c9eb-6f9b-4d54-ae6d-ebbaef54d2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:26.006004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128c9eb-6f9b-4d54-ae6d-ebbaef54d2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:26.006279 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128c9eb-6f9b-4d54-ae6d-ebbaef54d2d9 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:26.006894 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128c9eb-6f9b-4d54-ae6d-ebbaef54d2d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:26.008271 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128c9eb-6f9b-4d54-ae6d-ebbaef54d2d9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:26.013810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 403/780] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 9 02:18:25 2022] GET /identity/v3/services => generated 772 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:26.673002 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cb862-b8b2-4a53-aec5-b798d667d5e9 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:26.673612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cb862-b8b2-4a53-aec5-b798d667d5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:26.673612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cb862-b8b2-4a53-aec5-b798d667d5e9 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:26.675243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 378/781] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:26.680444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51992a12-6b8c-447a-ac0b-2c9d1b62154b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:26.680848 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51992a12-6b8c-447a-ac0b-2c9d1b62154b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:26.681011 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51992a12-6b8c-447a-ac0b-2c9d1b62154b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:26.699203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-51992a12-6b8c-447a-ac0b-2c9d1b62154b None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:26.700411 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-51992a12-6b8c-447a-ac0b-2c9d1b62154b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:26.763508 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:26.771965 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 404/782] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:26.793747 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cb862-b8b2-4a53-aec5-b798d667d5e9 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:26.909830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cb862-b8b2-4a53-aec5-b798d667d5e9 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:26.946570 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b965b56-8c01-4cd5-806c-8d78201faf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:26.947130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b965b56-8c01-4cd5-806c-8d78201faf5e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:26.947415 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b965b56-8c01-4cd5-806c-8d78201faf5e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:26.947691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b965b56-8c01-4cd5-806c-8d78201faf5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:26.960005 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b965b56-8c01-4cd5-806c-8d78201faf5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:18:26.964726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-8b965b56-8c01-4cd5-806c-8d78201faf5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:18:26.964726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:26.964726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:26.964726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:26.964726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:26.964726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:26.964726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:26.964726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:26.964726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:26.964726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:26.964726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:26.964726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:26.964726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:18:26.964726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:18:26.964726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:18:26.964726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:18:26.965671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:18:26.965671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:18:26.965671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:18:26.965671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:18:26.965671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:26.965671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:26.965671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:26.965671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:26.965671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:26.965671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:26.965671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:26.965671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:26.965671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:26.965671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:26.965671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:26.965671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:26.966492 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:26.966492 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:26.966492 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:26.966492 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:26.966492 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:18:26.966492 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:18:26.966492 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:18:26.966492 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:18:26.966492 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:18:26.966492 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:18:26.966492 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:18:26.966492 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:26.966492 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 379/783] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:18:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:26.973745 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51992a12-6b8c-447a-ac0b-2c9d1b62154b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:27.078004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51992a12-6b8c-447a-ac0b-2c9d1b62154b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:27.114153 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623db2a5-d48b-4ee0-8d1c-823a410e971b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:27.114772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623db2a5-d48b-4ee0-8d1c-823a410e971b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:27.115061 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623db2a5-d48b-4ee0-8d1c-823a410e971b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:27.115337 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623db2a5-d48b-4ee0-8d1c-823a410e971b None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:27.116265 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623db2a5-d48b-4ee0-8d1c-823a410e971b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:27.116574 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623db2a5-d48b-4ee0-8d1c-823a410e971b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:27.118023 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623db2a5-d48b-4ee0-8d1c-823a410e971b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:27.127400 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 405/784] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:18:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:27.133760 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b965b56-8c01-4cd5-806c-8d78201faf5e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:27.167296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:27.238455 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b965b56-8c01-4cd5-806c-8d78201faf5e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:27.273663 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75401eb-a613-4e92-86f2-48cd4b2deb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:27.274297 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75401eb-a613-4e92-86f2-48cd4b2deb88 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:27.274640 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75401eb-a613-4e92-86f2-48cd4b2deb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:27.274922 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75401eb-a613-4e92-86f2-48cd4b2deb88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:27.285828 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75401eb-a613-4e92-86f2-48cd4b2deb88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:27.287338 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75401eb-a613-4e92-86f2-48cd4b2deb88 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:27.302370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-d75401eb-a613-4e92-86f2-48cd4b2deb88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:27.302370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:27.302370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:27.302370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:27.302370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:27.302370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:27.302370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:27.302370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:27.302370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:27.302370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:27.302370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:27.302370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:27.302370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:27.302370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:27.302370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:27.302370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:27.303314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:27.303314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:27.303314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:27.303314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:27.303314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:27.303314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:27.303314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:27.303314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:27.303314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:27.303314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:27.303314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:27.303314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:27.303314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:27.303314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:27.303314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:27.303314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:27.303314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:27.304197 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:27.304197 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:27.304197 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:27.304197 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 380/785] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:27.309584 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623db2a5-d48b-4ee0-8d1c-823a410e971b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:27.385429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:27.416311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623db2a5-d48b-4ee0-8d1c-823a410e971b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:27.435645 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3276da-956a-4dc9-8465-c2814fbf3481 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:27.435939 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3276da-956a-4dc9-8465-c2814fbf3481 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:27.436189 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3276da-956a-4dc9-8465-c2814fbf3481 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:27.437555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 381/786] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:27.443283 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f71d22-f00a-46c7-9250-39c7921a8d3f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:27.443566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f71d22-f00a-46c7-9250-39c7921a8d3f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:27.443844 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f71d22-f00a-46c7-9250-39c7921a8d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:27.474861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-b2f71d22-f00a-46c7-9250-39c7921a8d3f None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:27.476079 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b2f71d22-f00a-46c7-9250-39c7921a8d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:27.489002 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623c408-373e-4e14-9a0f-97736fac3d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:27.489642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623c408-373e-4e14-9a0f-97736fac3d6d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:27.489984 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623c408-373e-4e14-9a0f-97736fac3d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:27.490264 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623c408-373e-4e14-9a0f-97736fac3d6d None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:27.491175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623c408-373e-4e14-9a0f-97736fac3d6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:27.491482 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623c408-373e-4e14-9a0f-97736fac3d6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:27.492865 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1623c408-373e-4e14-9a0f-97736fac3d6d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:27.507400 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 406/787] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:27.514298 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623c408-373e-4e14-9a0f-97736fac3d6d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:27.630792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 382/788] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 02:18:27.634978 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623c408-373e-4e14-9a0f-97736fac3d6d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:27.654058 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:27.663235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f71d22-f00a-46c7-9250-39c7921a8d3f None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:27.673967 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb243782-7617-48aa-b192-ef1ce60fd1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:27.674608 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb243782-7617-48aa-b192-ef1ce60fd1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:27.674931 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb243782-7617-48aa-b192-ef1ce60fd1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:27.675211 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb243782-7617-48aa-b192-ef1ce60fd1c1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:27.683592 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb243782-7617-48aa-b192-ef1ce60fd1c1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:27.685414 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb243782-7617-48aa-b192-ef1ce60fd1c1 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:27.694120 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:27.699561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-cb243782-7617-48aa-b192-ef1ce60fd1c1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 02:18:27.699561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:27.699561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:27.699561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:27.699561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:27.699561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:27.699561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:27.699561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:27.699561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:27.699561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:27.699561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:27.699561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:27.699561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:18:27.699561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:18:27.699561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:18:27.699561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:18:27.701709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:27.701709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:27.701709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:18:27.701709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:27.701709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:18:27.701709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:27.701709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:27.701709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:27.701709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:27.701709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:27.701709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:27.701709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:27.701709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:27.701709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:27.701709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:27.701709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:27.701709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:27.701709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:27.703946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:27.703946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:27.703946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:18:27.703946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:18:27.703946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:18:27.703946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:18:27.703946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:18:27.703946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:18:27.703946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 02:18:27.703946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:27.709393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 407/789] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:18:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:27.711116 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb243782-7617-48aa-b192-ef1ce60fd1c1 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:27.831618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f71d22-f00a-46c7-9250-39c7921a8d3f None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:27.844168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb243782-7617-48aa-b192-ef1ce60fd1c1 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:27.876799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f779184-cf8b-49b3-88b4-cb96a458add7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:27.878177 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f779184-cf8b-49b3-88b4-cb96a458add7 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:27.878751 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f779184-cf8b-49b3-88b4-cb96a458add7 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:27.879036 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f779184-cf8b-49b3-88b4-cb96a458add7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:27.879726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f779184-cf8b-49b3-88b4-cb96a458add7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:27.881127 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f779184-cf8b-49b3-88b4-cb96a458add7 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:27.882201 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d1815-5233-44d2-99fb-d9b40a4690bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:27.882896 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d1815-5233-44d2-99fb-d9b40a4690bf None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:27.883179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d1815-5233-44d2-99fb-d9b40a4690bf None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:27.883451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d1815-5233-44d2-99fb-d9b40a4690bf None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:27.884282 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d1815-5233-44d2-99fb-d9b40a4690bf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:27.884589 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d1815-5233-44d2-99fb-d9b40a4690bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:27.886173 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d1815-5233-44d2-99fb-d9b40a4690bf None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:27.890665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-1f779184-cf8b-49b3-88b4-cb96a458add7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 02:18:27.890665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:27.890665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 02:18:27.890665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 02:18:27.890665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 02:18:27.890665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 02:18:27.890665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 02:18:27.890665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:27.890665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 02:18:27.890665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:27.890665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:18:27.890665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:27.890665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:27.890665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:27.890665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:27.890665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:27.890665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:27.892613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:27.892613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:27.892613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:27.892613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:27.892613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:27.892613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:27.892613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 02:18:27.892613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 02:18:27.892613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 02:18:27.892613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 02:18:27.892613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:27.892613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:27.892613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:27.892613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:27.892613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:27.892613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:27.893575 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:27.893575 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:27.893575 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:27.893575 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:27.893575 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:27.893575 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:27.893575 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:27.893575 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:27.893575 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:27.893575 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:27.893575 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 02:18:27.893575 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:27.893575 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 02:18:27.893575 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:27.893575 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 383/790] 10.222.0.16 () {56 vars in 1129 bytes} [Tue Aug 9 02:18:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:27.897308 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66330685-6931-46cc-a8c4-efaa8b887cbc None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:27.900305 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66330685-6931-46cc-a8c4-efaa8b887cbc None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:27.900305 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66330685-6931-46cc-a8c4-efaa8b887cbc None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:27.900305 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 384/791] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:27.900305 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66330685-6931-46cc-a8c4-efaa8b887cbc None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:27.912793 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 408/792] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Aug 9 02:18:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:27.914082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29918455-310c-4eb2-83a2-c52fabf3fc7d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:27.914370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29918455-310c-4eb2-83a2-c52fabf3fc7d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:27.914643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29918455-310c-4eb2-83a2-c52fabf3fc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:27.933227 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-29918455-310c-4eb2-83a2-c52fabf3fc7d None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:27.934464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-29918455-310c-4eb2-83a2-c52fabf3fc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:27.966936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:27.999620 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:28.020683 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 409/793] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:28.021558 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29918455-310c-4eb2-83a2-c52fabf3fc7d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:28.032960 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66330685-6931-46cc-a8c4-efaa8b887cbc None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:28.069611 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18a11d-0f59-4285-a516-44337960d9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:28.070463 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18a11d-0f59-4285-a516-44337960d9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:28.070744 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18a11d-0f59-4285-a516-44337960d9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:28.071013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18a11d-0f59-4285-a516-44337960d9d9 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:28.071635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18a11d-0f59-4285-a516-44337960d9d9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:28.071933 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18a11d-0f59-4285-a516-44337960d9d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:28.073329 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18a11d-0f59-4285-a516-44337960d9d9 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:28.082606 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 385/794] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 9 02:18:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:28.082606 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9ccc0-7851-49c5-82ea-620c7b197b98 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:28.082606 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9ccc0-7851-49c5-82ea-620c7b197b98 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:28.082606 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9ccc0-7851-49c5-82ea-620c7b197b98 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:28.082606 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 386/795] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:28.082606 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9ccc0-7851-49c5-82ea-620c7b197b98 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:28.137940 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29918455-310c-4eb2-83a2-c52fabf3fc7d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:28.175300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa498e4-6134-4d1d-ba2b-f6479b4d8601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:28.175934 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa498e4-6134-4d1d-ba2b-f6479b4d8601 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:28.176213 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa498e4-6134-4d1d-ba2b-f6479b4d8601 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:28.176485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa498e4-6134-4d1d-ba2b-f6479b4d8601 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:28.187225 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa498e4-6134-4d1d-ba2b-f6479b4d8601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:28.188722 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa498e4-6134-4d1d-ba2b-f6479b4d8601 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:28.193511 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9ccc0-7851-49c5-82ea-620c7b197b98 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:28.204784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-5fa498e4-6134-4d1d-ba2b-f6479b4d8601 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:28.204784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:28.204784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:28.204784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:28.204784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:28.204784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:28.204784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:28.204784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:28.204784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:28.204784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:28.204784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:28.204784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:28.204784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:28.204784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:28.204784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:28.204784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:28.205787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:28.205787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:28.205787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:28.205787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:28.205787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:28.205787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:28.205787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:28.205787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:28.205787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:28.205787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:28.205787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:28.205787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:28.205787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:28.205787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:28.205787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:28.205787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:28.205787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:28.206665 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:28.206665 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:28.206665 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:28.206665 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 410/796] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:28.206665 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa498e4-6134-4d1d-ba2b-f6479b4d8601 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:28.228603 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:28.238034 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d198a2-9ee2-4a91-a795-0b846cd2fab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:28.238919 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d198a2-9ee2-4a91-a795-0b846cd2fab3 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:28.238919 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d198a2-9ee2-4a91-a795-0b846cd2fab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:28.239207 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d198a2-9ee2-4a91-a795-0b846cd2fab3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:28.253830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d198a2-9ee2-4a91-a795-0b846cd2fab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:18:28.258617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-63d198a2-9ee2-4a91-a795-0b846cd2fab3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:18:28.258617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:28.258617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:28.258617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:28.258617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:28.258617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:28.258617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:28.258617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:28.258617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:28.258617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:28.258617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:28.258617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:28.258617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:18:28.258617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:18:28.258617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:18:28.258617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:18:28.259546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:18:28.259546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:18:28.259546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:18:28.259546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:18:28.259546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:28.259546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:28.259546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:28.259546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:28.259546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:28.259546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:28.259546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:28.259546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:28.259546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:28.259546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:28.259546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:28.259546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:28.260375 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:28.260375 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:28.260375 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:28.260375 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:28.260375 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:18:28.260375 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:18:28.260375 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:18:28.260375 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:18:28.260375 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:18:28.260375 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:18:28.260375 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:18:28.260375 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:28.260375 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 387/797] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:18:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:28.261069 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e035c-f5be-4c7b-a3d3-21cfb7a8b6f3 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:28.261471 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e035c-f5be-4c7b-a3d3-21cfb7a8b6f3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:28.261471 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e035c-f5be-4c7b-a3d3-21cfb7a8b6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:28.268089 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:28.280273 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-d76e035c-f5be-4c7b-a3d3-21cfb7a8b6f3 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:28.281493 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d76e035c-f5be-4c7b-a3d3-21cfb7a8b6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:28.325043 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa498e4-6134-4d1d-ba2b-f6479b4d8601 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:28.350445 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 388/798] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:28.351291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e035c-f5be-4c7b-a3d3-21cfb7a8b6f3 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:28.377386 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c079e-e98b-4e6f-ab60-347b70b18a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:28.377998 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c079e-e98b-4e6f-ab60-347b70b18a0f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:28.378293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c079e-e98b-4e6f-ab60-347b70b18a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:28.378554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c079e-e98b-4e6f-ab60-347b70b18a0f None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:28.379192 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c079e-e98b-4e6f-ab60-347b70b18a0f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:28.379490 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c079e-e98b-4e6f-ab60-347b70b18a0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:28.380858 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c079e-e98b-4e6f-ab60-347b70b18a0f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:28.386750 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 411/799] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 9 02:18:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:28.386958 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c079e-e98b-4e6f-ab60-347b70b18a0f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:28.471532 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:28.481540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e035c-f5be-4c7b-a3d3-21cfb7a8b6f3 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:28.490935 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c079e-e98b-4e6f-ab60-347b70b18a0f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:28.511757 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:28.518339 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5929844-9d97-4719-bf3d-991437bc854a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:28.518969 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5929844-9d97-4719-bf3d-991437bc854a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:28.519255 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5929844-9d97-4719-bf3d-991437bc854a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:28.519528 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5929844-9d97-4719-bf3d-991437bc854a None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:28.520172 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5929844-9d97-4719-bf3d-991437bc854a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:28.520474 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5929844-9d97-4719-bf3d-991437bc854a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:28.521874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5929844-9d97-4719-bf3d-991437bc854a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:28.524448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5dca6-fc28-471b-81c9-15020cea7c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:28.525061 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5dca6-fc28-471b-81c9-15020cea7c25 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:28.525340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5dca6-fc28-471b-81c9-15020cea7c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:28.525609 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5dca6-fc28-471b-81c9-15020cea7c25 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:28.526262 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5dca6-fc28-471b-81c9-15020cea7c25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:28.526563 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5dca6-fc28-471b-81c9-15020cea7c25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:28.527902 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5dca6-fc28-471b-81c9-15020cea7c25 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:28.532882 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 389/800] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:28.533699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5929844-9d97-4719-bf3d-991437bc854a None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:28.535834 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 412/801] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:18:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:28.536580 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5dca6-fc28-471b-81c9-15020cea7c25 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:28.633814 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5929844-9d97-4719-bf3d-991437bc854a None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:28.636676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5dca6-fc28-471b-81c9-15020cea7c25 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:28.665660 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce1079-7562-4c83-89df-fdd3634c2bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:28.666275 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce1079-7562-4c83-89df-fdd3634c2bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:28.666558 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce1079-7562-4c83-89df-fdd3634c2bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:28.666824 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce1079-7562-4c83-89df-fdd3634c2bd2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:28.668812 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264543ea-1e40-4181-84f9-56eaf50c3333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:28.669453 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264543ea-1e40-4181-84f9-56eaf50c3333 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:28.669733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264543ea-1e40-4181-84f9-56eaf50c3333 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:28.670004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264543ea-1e40-4181-84f9-56eaf50c3333 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:28.670684 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264543ea-1e40-4181-84f9-56eaf50c3333 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:28.672042 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264543ea-1e40-4181-84f9-56eaf50c3333 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:28.677250 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce1079-7562-4c83-89df-fdd3634c2bd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:18:28.682219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-a0ce1079-7562-4c83-89df-fdd3634c2bd2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:28.682219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:28.682219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:28.682219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:28.682219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:28.682219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:28.682219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:28.682219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:28.682219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:28.682219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:28.682219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:28.682219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:28.682219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:18:28.682219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:18:28.682219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:18:28.682219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:18:28.683298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:18:28.683298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:18:28.683298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:18:28.683298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:18:28.683298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:28.683298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:28.683298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:28.683298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:28.683298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:28.683298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:28.683298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:28.683298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:28.683298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:28.683298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:28.683298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:28.683298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:28.685112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:28.685112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:28.685112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:28.685112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:28.685112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:18:28.685112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:18:28.685112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:18:28.685112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:18:28.685112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:18:28.685112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:18:28.685112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:28.685112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:28.685112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 390/802] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 9 02:18:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:28.685112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28581bd0-a559-478d-9588-89ade27d6e41 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:28.691614 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28581bd0-a559-478d-9588-89ade27d6e41 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:28.691614 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28581bd0-a559-478d-9588-89ade27d6e41 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:28.691614 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 391/803] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:28.691614 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28581bd0-a559-478d-9588-89ade27d6e41 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:28.695737 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:28.702142 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 413/804] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:18:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:18:28.702990 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264543ea-1e40-4181-84f9-56eaf50c3333 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:28.749138 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:28.808050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28581bd0-a559-478d-9588-89ade27d6e41 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:28.831159 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264543ea-1e40-4181-84f9-56eaf50c3333 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:28.844535 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b8df9-6017-44db-b900-7696f978005f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:28.845238 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b8df9-6017-44db-b900-7696f978005f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:28.845519 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b8df9-6017-44db-b900-7696f978005f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:28.846731 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b8df9-6017-44db-b900-7696f978005f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:28.852725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b8df9-6017-44db-b900-7696f978005f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:28.854386 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b8df9-6017-44db-b900-7696f978005f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:28.867416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-9b3b8df9-6017-44db-b900-7696f978005f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:28.867416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:28.867416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:28.867416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:28.867416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:28.867416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:28.867416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:28.867416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:28.867416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:28.867416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:28.867416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:28.867416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:28.867416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:28.867416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:28.867416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:28.868310 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:28.868310 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:28.868310 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:28.868310 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:28.868310 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:28.868310 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:28.868310 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:28.868310 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:28.868310 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:28.868310 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:28.868310 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:28.868310 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:28.868310 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:28.868310 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:28.868310 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:28.868310 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:28.868310 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:28.869591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:28.869591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:28.869591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:28.869591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:28.869591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:28.869591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:28.869591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:28.869591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:28.869591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 392/805] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:28.869591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b8df9-6017-44db-b900-7696f978005f None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:28.876769 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe22d9-0bc0-4fc4-a253-744e236f4e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:28.877445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe22d9-0bc0-4fc4-a253-744e236f4e88 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:28.877719 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe22d9-0bc0-4fc4-a253-744e236f4e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:28.877986 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe22d9-0bc0-4fc4-a253-744e236f4e88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:28.889510 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe22d9-0bc0-4fc4-a253-744e236f4e88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:28.890903 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe22d9-0bc0-4fc4-a253-744e236f4e88 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:28.905388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-4dfe22d9-0bc0-4fc4-a253-744e236f4e88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:28.905388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:28.905388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:28.905388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:28.905388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:28.905388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:28.905388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:28.905388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:28.905388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:28.905388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:28.905388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:28.905388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:28.905388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:28.905388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:28.905388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:28.905388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:28.906506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:28.906506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:28.906506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:28.906506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:28.906506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:28.906506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:28.906506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:28.906506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:28.906506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:28.906506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:28.906506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:28.906506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:28.906506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:28.906506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:28.906506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:28.906506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:28.906506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:28.907492 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:28.907492 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:28.907492 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:28.907492 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 414/806] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:28.907870 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746c98b-4669-40c2-b092-3fbc9fdd74dd None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:28.908089 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746c98b-4669-40c2-b092-3fbc9fdd74dd None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:28.908361 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746c98b-4669-40c2-b092-3fbc9fdd74dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:28.926598 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a746c98b-4669-40c2-b092-3fbc9fdd74dd None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:28.927777 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a746c98b-4669-40c2-b092-3fbc9fdd74dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:28.980299 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b8df9-6017-44db-b900-7696f978005f None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:28.981747 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:28.990324 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:29.017056 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 415/807] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:29.017056 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746c98b-4669-40c2-b092-3fbc9fdd74dd None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:29.029008 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de441b5-aee8-4080-8d28-f2a8ba805d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:29.029745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de441b5-aee8-4080-8d28-f2a8ba805d3f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:29.030094 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de441b5-aee8-4080-8d28-f2a8ba805d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:29.030431 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de441b5-aee8-4080-8d28-f2a8ba805d3f None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:29.031289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de441b5-aee8-4080-8d28-f2a8ba805d3f None admin] RBAC: Adding query filter params (name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:29.031661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de441b5-aee8-4080-8d28-f2a8ba805d3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:29.033809 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de441b5-aee8-4080-8d28-f2a8ba805d3f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:29.043136 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 393/808] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 9 02:18:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:29.044019 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de441b5-aee8-4080-8d28-f2a8ba805d3f None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:29.138488 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746c98b-4669-40c2-b092-3fbc9fdd74dd None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:29.164199 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de441b5-aee8-4080-8d28-f2a8ba805d3f None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:29.173999 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c99ce6-9bca-43b3-b340-2108ac632a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:29.174614 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c99ce6-9bca-43b3-b340-2108ac632a2d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:29.174881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c99ce6-9bca-43b3-b340-2108ac632a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:29.175151 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c99ce6-9bca-43b3-b340-2108ac632a2d None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:29.175844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c99ce6-9bca-43b3-b340-2108ac632a2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:29.176149 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c99ce6-9bca-43b3-b340-2108ac632a2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:29.177611 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c99ce6-9bca-43b3-b340-2108ac632a2d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:29.194009 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 416/809] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:29.194009 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c99ce6-9bca-43b3-b340-2108ac632a2d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:29.209887 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b3707-53f6-4b74-983b-a10fe5b0674c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:29.210495 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b3707-53f6-4b74-983b-a10fe5b0674c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:29.210771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b3707-53f6-4b74-983b-a10fe5b0674c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:29.211041 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b3707-53f6-4b74-983b-a10fe5b0674c None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:29.211676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b3707-53f6-4b74-983b-a10fe5b0674c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:29.211971 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b3707-53f6-4b74-983b-a10fe5b0674c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:29.213370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b3707-53f6-4b74-983b-a10fe5b0674c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:29.230031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 394/810] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:29.230031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b3707-53f6-4b74-983b-a10fe5b0674c None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:29.240737 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:29.263492 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:29.304493 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c99ce6-9bca-43b3-b340-2108ac632a2d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:29.339839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b3707-53f6-4b74-983b-a10fe5b0674c None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:29.340080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deef7cc-8dbb-4d41-bd21-0f6f97a46124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:29.340869 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deef7cc-8dbb-4d41-bd21-0f6f97a46124 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:29.341491 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deef7cc-8dbb-4d41-bd21-0f6f97a46124 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:29.341939 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deef7cc-8dbb-4d41-bd21-0f6f97a46124 None admin] PATH_INFO: `/v3/services/network` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:29.343399 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deef7cc-8dbb-4d41-bd21-0f6f97a46124 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:29.345511 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deef7cc-8dbb-4d41-bd21-0f6f97a46124 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:29.357243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-9deef7cc-8dbb-4d41-bd21-0f6f97a46124 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 02:18:29.357243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:29.357243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 02:18:29.357243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 02:18:29.357243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 02:18:29.357243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 02:18:29.357243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 02:18:29.357243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:29.357243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 02:18:29.357243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:29.357243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:18:29.357243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:29.357243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:29.357243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:29.357243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:29.357243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:29.357243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:29.358478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:29.358478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:29.358478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:29.358478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:29.358478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:29.358478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:29.358478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 02:18:29.358478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 02:18:29.358478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 02:18:29.358478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 02:18:29.358478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:29.358478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:29.358478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:29.358478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:29.358478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:29.358478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:29.359529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:29.359529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:29.359529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:29.359529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:29.359529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:29.359529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:29.359529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:29.359529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:29.359529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:29.359529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:29.359529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 02:18:29.359529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:29.359529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 02:18:29.359529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:29.362296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 417/811] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:29 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:29.363193 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deef7cc-8dbb-4d41-bd21-0f6f97a46124 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:29.377502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188110a1-c032-4cb5-ad6e-be410c84ca5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:29.378134 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188110a1-c032-4cb5-ad6e-be410c84ca5b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:29.378414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188110a1-c032-4cb5-ad6e-be410c84ca5b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:29.378706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188110a1-c032-4cb5-ad6e-be410c84ca5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:29.389284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188110a1-c032-4cb5-ad6e-be410c84ca5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:29.390751 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188110a1-c032-4cb5-ad6e-be410c84ca5b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:29.405863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-188110a1-c032-4cb5-ad6e-be410c84ca5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:29.405863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:29.405863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:29.405863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:29.405863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:29.405863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:29.405863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:29.405863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:29.405863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:29.405863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:29.405863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:29.405863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:29.405863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:29.405863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:29.405863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:29.405863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:29.406788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:29.406788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:29.406788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:29.406788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:29.406788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:29.406788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:29.406788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:29.406788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:29.406788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:29.406788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:29.406788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:29.406788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:29.406788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:29.406788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:29.406788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:29.406788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:29.406788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:29.408239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:29.408239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:29.408239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:29.408239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 395/812] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:29.408477 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188110a1-c032-4cb5-ad6e-be410c84ca5b None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:29.485645 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deef7cc-8dbb-4d41-bd21-0f6f97a46124 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:29.492178 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:29.494941 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:29.511036 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188110a1-c032-4cb5-ad6e-be410c84ca5b None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:29.526770 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f8da9-7ea5-4433-9957-452cead76dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:29.527539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f8da9-7ea5-4433-9957-452cead76dba None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:29.527827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f8da9-7ea5-4433-9957-452cead76dba None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:29.528098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f8da9-7ea5-4433-9957-452cead76dba None admin] PATH_INFO: `/v3/projects/105476dcda7f48c28224d33c05860d6f/users/9151f210d29542dcb41ea3bc03390350/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:29.530111 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f8da9-7ea5-4433-9957-452cead76dba None admin] RBAC: Authorizing `identity:create_grant(project_id=105476dcda7f48c28224d33c05860d6f, user_id=9151f210d29542dcb41ea3bc03390350, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:29.531758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f8da9-7ea5-4433-9957-452cead76dba None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:29.544862 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c83dc-43c0-4bc4-b40a-33dcdf2d8582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:29.545515 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c83dc-43c0-4bc4-b40a-33dcdf2d8582 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:29.545795 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c83dc-43c0-4bc4-b40a-33dcdf2d8582 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:29.546115 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c83dc-43c0-4bc4-b40a-33dcdf2d8582 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:29.557403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 418/813] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 9 02:18:29 2022] PUT /identity/v3/projects/105476dcda7f48c28224d33c05860d6f/users/9151f210d29542dcb41ea3bc03390350/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:18:29.557403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f8da9-7ea5-4433-9957-452cead76dba None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:29.567643 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c83dc-43c0-4bc4-b40a-33dcdf2d8582 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:29.569156 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c83dc-43c0-4bc4-b40a-33dcdf2d8582 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:29.583622 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-6f1c83dc-43c0-4bc4-b40a-33dcdf2d8582 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 02:18:29.583622 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:29.583622 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:29.583622 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:29.583622 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:29.583622 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:29.583622 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:29.583622 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:29.583622 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:29.583622 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:29.583622 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:29.583622 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:29.583622 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:18:29.583622 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:18:29.583622 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:18:29.583622 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:18:29.584636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:29.584636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:29.584636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:18:29.584636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:29.584636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:18:29.584636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:29.584636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:29.584636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:29.584636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:29.584636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:29.584636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:29.584636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:29.584636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:29.584636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:29.584636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:29.584636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:29.584636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:29.584636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:29.585603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:29.585603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:29.585603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:18:29.585603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:18:29.585603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:18:29.585603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:18:29.585603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:18:29.585603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:18:29.585603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 02:18:29.585603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:29.589877 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 396/814] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 9 02:18:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:29.590976 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c83dc-43c0-4bc4-b40a-33dcdf2d8582 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:29.711368 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f8da9-7ea5-4433-9957-452cead76dba None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:29.711898 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c83dc-43c0-4bc4-b40a-33dcdf2d8582 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:29.755201 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f963c-d37d-486c-a7d0-aed4ef0a92df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:29.755591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab9eac-d584-40b9-a053-d16312a235d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:29.756026 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f963c-d37d-486c-a7d0-aed4ef0a92df None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:29.756026 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f963c-d37d-486c-a7d0-aed4ef0a92df None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:29.756273 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab9eac-d584-40b9-a053-d16312a235d7 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:29.756386 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f963c-d37d-486c-a7d0-aed4ef0a92df None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:29.756467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab9eac-d584-40b9-a053-d16312a235d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:29.756733 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab9eac-d584-40b9-a053-d16312a235d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:29.756893 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f963c-d37d-486c-a7d0-aed4ef0a92df None admin] RBAC: Adding query filter params (name=network) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:29.757225 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f963c-d37d-486c-a7d0-aed4ef0a92df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:29.757406 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab9eac-d584-40b9-a053-d16312a235d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:29.757706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab9eac-d584-40b9-a053-d16312a235d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:29.758686 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f963c-d37d-486c-a7d0-aed4ef0a92df None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:29.759046 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab9eac-d584-40b9-a053-d16312a235d7 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:29.769121 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 419/815] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 9 02:18:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:29.769996 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f963c-d37d-486c-a7d0-aed4ef0a92df None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:29.776368 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 397/816] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:29.777267 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab9eac-d584-40b9-a053-d16312a235d7 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:29.781356 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:29.808499 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:29.905854 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f963c-d37d-486c-a7d0-aed4ef0a92df None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:29.914076 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab9eac-d584-40b9-a053-d16312a235d7 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:29.951174 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a16bc-2ed4-4e89-89af-7afe2c098173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:29.952001 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a16bc-2ed4-4e89-89af-7afe2c098173 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:29.952633 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a16bc-2ed4-4e89-89af-7afe2c098173 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:29.952990 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a16bc-2ed4-4e89-89af-7afe2c098173 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:29.954719 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a16bc-2ed4-4e89-89af-7afe2c098173 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:29.955038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a16bc-2ed4-4e89-89af-7afe2c098173 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:29.956542 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a16bc-2ed4-4e89-89af-7afe2c098173 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:29.958442 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc05d3-7bdd-4ddd-a299-b5e05a4c943c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:29.960079 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc05d3-7bdd-4ddd-a299-b5e05a4c943c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:29.960452 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc05d3-7bdd-4ddd-a299-b5e05a4c943c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:29.960801 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc05d3-7bdd-4ddd-a299-b5e05a4c943c None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:29.961536 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc05d3-7bdd-4ddd-a299-b5e05a4c943c None admin] RBAC: Adding query filter params (type=network) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:29.961914 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc05d3-7bdd-4ddd-a299-b5e05a4c943c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:29.963344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc05d3-7bdd-4ddd-a299-b5e05a4c943c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:29.972480 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 398/817] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 9 02:18:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:29.972480 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc05d3-7bdd-4ddd-a299-b5e05a4c943c None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:29.986794 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 420/818] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 9 02:18:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:29.986794 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a16bc-2ed4-4e89-89af-7afe2c098173 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:30.049191 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:30.083438 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:30.089448 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc05d3-7bdd-4ddd-a299-b5e05a4c943c None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:30.104176 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a16bc-2ed4-4e89-89af-7afe2c098173 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:30.136864 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376e67c-4a20-4cdb-8efc-69310d6f8321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:30.138109 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376e67c-4a20-4cdb-8efc-69310d6f8321 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:30.138630 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376e67c-4a20-4cdb-8efc-69310d6f8321 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:30.139105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376e67c-4a20-4cdb-8efc-69310d6f8321 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:30.146872 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376e67c-4a20-4cdb-8efc-69310d6f8321 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:30.147100 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddb099-1994-4e07-b4e7-b7b323cd7461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:30.147665 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddb099-1994-4e07-b4e7-b7b323cd7461 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:30.147955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddb099-1994-4e07-b4e7-b7b323cd7461 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:30.148230 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddb099-1994-4e07-b4e7-b7b323cd7461 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:30.148896 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ddb099-1994-4e07-b4e7-b7b323cd7461 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:30.149681 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376e67c-4a20-4cdb-8efc-69310d6f8321 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:30.150293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ddb099-1994-4e07-b4e7-b7b323cd7461 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:30.162852 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-f376e67c-4a20-4cdb-8efc-69310d6f8321 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 02:18:30.162852 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:30.162852 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:30.162852 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:30.162852 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:30.162852 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:30.162852 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:30.162852 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:30.162852 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:30.162852 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:30.162852 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:30.162852 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:30.162852 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:18:30.162852 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:18:30.162852 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:18:30.162852 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:18:30.164270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:30.164270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:30.164270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:18:30.164270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:30.164270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:18:30.164270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:30.164270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:30.164270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:30.164270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:30.164270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:30.164270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:30.164270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:30.164270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:30.164270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:30.164270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:30.164270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:30.164270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:30.164270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:30.165794 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:30.165794 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:30.165794 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:18:30.165794 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:18:30.165794 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:18:30.165794 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:18:30.165794 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:18:30.165794 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:18:30.165794 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 02:18:30.165794 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:30.169586 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 399/819] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 9 02:18:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:30.170443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376e67c-4a20-4cdb-8efc-69310d6f8321 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:30.177574 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 421/820] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:18:29 2022] POST /identity/v3/endpoints => generated 337 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:18:30.178765 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddb099-1994-4e07-b4e7-b7b323cd7461 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:30.341462 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376e67c-4a20-4cdb-8efc-69310d6f8321 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:30.358242 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddb099-1994-4e07-b4e7-b7b323cd7461 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:30.386862 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:30.402759 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f9ae5-8380-4493-be43-fe61c0eb264b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:30.403729 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f9ae5-8380-4493-be43-fe61c0eb264b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:30.404317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f9ae5-8380-4493-be43-fe61c0eb264b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:30.404798 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f9ae5-8380-4493-be43-fe61c0eb264b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:30.406237 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b4402-e0d6-4c60-a463-7e1e4e7d11fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:30.406846 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b4402-e0d6-4c60-a463-7e1e4e7d11fb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:30.407150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b4402-e0d6-4c60-a463-7e1e4e7d11fb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:30.407425 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b4402-e0d6-4c60-a463-7e1e4e7d11fb None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:30.408159 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b4402-e0d6-4c60-a463-7e1e4e7d11fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:30.408467 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b4402-e0d6-4c60-a463-7e1e4e7d11fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:30.409932 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b4402-e0d6-4c60-a463-7e1e4e7d11fb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:30.429407 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:30.429715 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 422/821] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Aug 9 02:18:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:30.435069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b4402-e0d6-4c60-a463-7e1e4e7d11fb None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:30.483729 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f9ae5-8380-4493-be43-fe61c0eb264b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:30.486036 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f9ae5-8380-4493-be43-fe61c0eb264b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:30.543899 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b4402-e0d6-4c60-a463-7e1e4e7d11fb None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:30.579859 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5de60-a033-4a53-a904-687f5087a81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:30.580669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5de60-a033-4a53-a904-687f5087a81b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:30.581069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5de60-a033-4a53-a904-687f5087a81b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:30.581449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5de60-a033-4a53-a904-687f5087a81b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:30.592513 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 400/822] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:18:30 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 02:18:30.593926 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5de60-a033-4a53-a904-687f5087a81b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:30.595691 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5de60-a033-4a53-a904-687f5087a81b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:30.599491 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f9ae5-8380-4493-be43-fe61c0eb264b None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:30.615881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-efe5de60-a033-4a53-a904-687f5087a81b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:30.615881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:30.615881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:30.615881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:30.615881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:30.615881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:30.615881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:30.615881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:30.615881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:30.615881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:30.615881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:30.615881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:30.615881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:30.615881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:30.615881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:30.615881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:30.616881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:30.616881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:30.616881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:30.616881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:30.616881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:30.616881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:30.616881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:30.616881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:30.616881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:30.616881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:30.616881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:30.616881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:30.616881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:30.616881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:30.616881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:30.616881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:30.616881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:30.617782 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:30.617782 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:30.617782 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:30.620135 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 423/823] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:18:30.625844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5de60-a033-4a53-a904-687f5087a81b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:30.632115 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:30.693889 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:30.706333 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f9ae5-8380-4493-be43-fe61c0eb264b None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:30.744982 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79121f04-3c62-49fd-a0b7-bd50befc8e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:30.745648 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79121f04-3c62-49fd-a0b7-bd50befc8e55 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:30.745930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79121f04-3c62-49fd-a0b7-bd50befc8e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:30.746205 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79121f04-3c62-49fd-a0b7-bd50befc8e55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:30.762088 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5de60-a033-4a53-a904-687f5087a81b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:30.764118 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79121f04-3c62-49fd-a0b7-bd50befc8e55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:30.766637 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79121f04-3c62-49fd-a0b7-bd50befc8e55 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:30.783405 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-79121f04-3c62-49fd-a0b7-bd50befc8e55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:30.783405 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:30.783405 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:30.783405 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:30.783405 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:30.783405 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:30.783405 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:30.783405 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:30.783405 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:30.783405 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:30.783405 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:30.783405 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:30.783405 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:30.783405 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:30.783405 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:30.783405 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:30.784417 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:30.784417 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:30.784417 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:30.784417 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:30.784417 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:30.784417 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:30.784417 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:30.784417 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:30.784417 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:30.784417 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:30.784417 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:30.784417 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:30.784417 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:30.784417 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:30.784417 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:30.784417 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:30.784417 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:30.785309 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:30.785309 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:30.785309 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:30.785309 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 401/824] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:30.791423 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79121f04-3c62-49fd-a0b7-bd50befc8e55 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:30.811983 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287c247-db8d-46d9-8a93-d29a7e802b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:30.813290 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287c247-db8d-46d9-8a93-d29a7e802b05 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:30.813810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287c247-db8d-46d9-8a93-d29a7e802b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:30.814598 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287c247-db8d-46d9-8a93-d29a7e802b05 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:30.815526 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287c247-db8d-46d9-8a93-d29a7e802b05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:30.816478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287c247-db8d-46d9-8a93-d29a7e802b05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:30.818118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287c247-db8d-46d9-8a93-d29a7e802b05 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:30.841488 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 424/825] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:30.844085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287c247-db8d-46d9-8a93-d29a7e802b05 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:30.884544 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:30.910051 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79121f04-3c62-49fd-a0b7-bd50befc8e55 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:30.945878 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b76cb4-2f58-4ecb-b7eb-33044094f16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:30.946491 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b76cb4-2f58-4ecb-b7eb-33044094f16a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:30.946778 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b76cb4-2f58-4ecb-b7eb-33044094f16a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:30.947056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b76cb4-2f58-4ecb-b7eb-33044094f16a None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:30.947703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b76cb4-2f58-4ecb-b7eb-33044094f16a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:30.948011 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b76cb4-2f58-4ecb-b7eb-33044094f16a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:30.949419 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b76cb4-2f58-4ecb-b7eb-33044094f16a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:30.966144 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 402/826] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:30.966144 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e076731-ebcf-420c-b260-f5067660ed7f None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:30.966144 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e076731-ebcf-420c-b260-f5067660ed7f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:30.966144 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e076731-ebcf-420c-b260-f5067660ed7f None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:30.966144 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 403/827] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:30.967005 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e076731-ebcf-420c-b260-f5067660ed7f None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:30.984884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287c247-db8d-46d9-8a93-d29a7e802b05 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:30.999042 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:31.031009 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e02b74-e4ee-4b04-8df9-75c03b218d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:31.032059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e02b74-e4ee-4b04-8df9-75c03b218d6b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:31.033206 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e02b74-e4ee-4b04-8df9-75c03b218d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:31.033489 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e02b74-e4ee-4b04-8df9-75c03b218d6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:31.040554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e02b74-e4ee-4b04-8df9-75c03b218d6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:31.042518 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e02b74-e4ee-4b04-8df9-75c03b218d6b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:31.054016 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-f9e02b74-e4ee-4b04-8df9-75c03b218d6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:31.054016 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:31.054016 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:31.054016 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:31.054016 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:31.054016 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:31.054016 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:31.054016 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:31.054016 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:31.054016 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:31.054016 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:31.054016 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:31.054016 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:31.054016 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:31.054016 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:31.055075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:31.055075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:31.055075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:31.055075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:31.055075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:31.055075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:31.055075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:31.055075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:31.055075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:31.055075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:31.055075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:31.055075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:31.055075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:31.055075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:31.055075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:31.055075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:31.055075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:31.056740 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:31.056740 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:31.056740 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:31.056740 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:31.056740 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:31.056740 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:31.056740 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:31.056740 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:31.059863 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 425/828] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:31.061095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd768a8b-c2c1-4d53-8569-4ecaf090065f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:31.061385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd768a8b-c2c1-4d53-8569-4ecaf090065f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:31.061664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd768a8b-c2c1-4d53-8569-4ecaf090065f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:31.079548 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-cd768a8b-c2c1-4d53-8569-4ecaf090065f None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:31.080739 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cd768a8b-c2c1-4d53-8569-4ecaf090065f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:31.082150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e076731-ebcf-420c-b260-f5067660ed7f None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:31.120291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa8ed9-d9e9-436e-b927-d897026919ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:31.121037 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa8ed9-d9e9-436e-b927-d897026919ed None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:31.121423 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa8ed9-d9e9-436e-b927-d897026919ed None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:31.121813 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa8ed9-d9e9-436e-b927-d897026919ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:31.128866 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa8ed9-d9e9-436e-b927-d897026919ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:31.130391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa8ed9-d9e9-436e-b927-d897026919ed None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:31.132667 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:31.144022 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-1daa8ed9-d9e9-436e-b927-d897026919ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:31.144022 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:31.144022 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:31.144022 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:31.144022 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:31.144022 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:31.144022 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:31.144022 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:31.144022 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:31.144022 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:31.144022 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:31.144022 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:31.144022 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:31.144022 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:31.144022 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:31.145150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:31.145150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:31.145150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:31.145150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:31.145150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:31.145150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:31.145150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:31.145150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:31.145150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:31.145150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:31.145150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:31.145150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:31.145150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:31.145150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:31.145150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:31.145150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:31.145150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:31.146040 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:31.146040 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:31.146040 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:31.146040 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:31.146040 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:31.146040 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:31.146040 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:31.146040 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:31.146040 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 404/829] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:31.146040 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa8ed9-d9e9-436e-b927-d897026919ed None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:31.161973 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 426/830] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:31.163360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd768a8b-c2c1-4d53-8569-4ecaf090065f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:31.268696 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa8ed9-d9e9-436e-b927-d897026919ed None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:31.272962 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:31.276290 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd768a8b-c2c1-4d53-8569-4ecaf090065f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:31.303512 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f7144-b392-4ac5-9bb2-8dc6af08f0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:31.304225 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f7144-b392-4ac5-9bb2-8dc6af08f0ee None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:31.304580 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f7144-b392-4ac5-9bb2-8dc6af08f0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:31.304924 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f7144-b392-4ac5-9bb2-8dc6af08f0ee None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:31.305719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f7144-b392-4ac5-9bb2-8dc6af08f0ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:31.306095 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f7144-b392-4ac5-9bb2-8dc6af08f0ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:31.307595 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f7144-b392-4ac5-9bb2-8dc6af08f0ee None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:31.313834 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29839f35-2032-49ad-bc16-0977ddd6517e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:31.314523 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29839f35-2032-49ad-bc16-0977ddd6517e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:31.314871 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29839f35-2032-49ad-bc16-0977ddd6517e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:31.315215 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29839f35-2032-49ad-bc16-0977ddd6517e None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:31.315916 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29839f35-2032-49ad-bc16-0977ddd6517e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:31.316221 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29839f35-2032-49ad-bc16-0977ddd6517e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:31.317666 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29839f35-2032-49ad-bc16-0977ddd6517e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:31.325741 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 405/831] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:31.325741 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f7144-b392-4ac5-9bb2-8dc6af08f0ee None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:31.337844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 427/832] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:31.337844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29839f35-2032-49ad-bc16-0977ddd6517e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:31.386890 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:31.432072 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f7144-b392-4ac5-9bb2-8dc6af08f0ee None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:31.457890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29839f35-2032-49ad-bc16-0977ddd6517e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:31.467086 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d48c92-cb5c-4272-9e17-79c83ccccc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:31.467705 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d48c92-cb5c-4272-9e17-79c83ccccc08 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:31.467980 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d48c92-cb5c-4272-9e17-79c83ccccc08 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:31.468247 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d48c92-cb5c-4272-9e17-79c83ccccc08 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:31.468826 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d48c92-cb5c-4272-9e17-79c83ccccc08 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:31.470240 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d48c92-cb5c-4272-9e17-79c83ccccc08 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:31.479344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-b1d48c92-cb5c-4272-9e17-79c83ccccc08 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 02:18:31.479344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:31.479344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 02:18:31.479344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 02:18:31.479344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 02:18:31.479344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 02:18:31.479344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 02:18:31.479344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:31.479344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 02:18:31.479344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:31.479344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:18:31.479344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:31.479344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:31.479344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:31.479344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:31.479344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:31.479344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:31.480518 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:31.480518 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:31.480518 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:31.480518 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:31.480518 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:31.480518 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:31.480518 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 02:18:31.480518 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 02:18:31.480518 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 02:18:31.480518 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 02:18:31.480518 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:31.480518 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:31.480518 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:31.480518 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:31.480518 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:31.480518 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:31.481590 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:31.481590 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:31.481590 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:31.481590 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:31.481590 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:31.481590 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:31.481590 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:31.481590 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:31.481590 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:31.481590 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:31.481590 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 02:18:31.481590 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:31.481590 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 02:18:31.481590 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:31.485344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 406/833] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 9 02:18:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:31.486285 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d48c92-cb5c-4272-9e17-79c83ccccc08 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:31.498377 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946112ce-697c-4793-9bad-b0709d387d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:31.499021 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946112ce-697c-4793-9bad-b0709d387d3b None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:31.499301 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946112ce-697c-4793-9bad-b0709d387d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:31.499569 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946112ce-697c-4793-9bad-b0709d387d3b None admin] PATH_INFO: `/v3/projects/105476dcda7f48c28224d33c05860d6f/users/07041df2276d4dd58fb0e49417a26e2c/roles/d521e5f58e7e4cd48ceed4404113cbd5` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:31.514754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946112ce-697c-4793-9bad-b0709d387d3b None admin] RBAC: Authorizing `identity:create_grant(project_id=105476dcda7f48c28224d33c05860d6f, user_id=07041df2276d4dd58fb0e49417a26e2c, role_id=d521e5f58e7e4cd48ceed4404113cbd5)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:31.516186 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946112ce-697c-4793-9bad-b0709d387d3b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:31.541054 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 428/834] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 9 02:18:31 2022] PUT /identity/v3/projects/105476dcda7f48c28224d33c05860d6f/users/07041df2276d4dd58fb0e49417a26e2c/roles/d521e5f58e7e4cd48ceed4404113cbd5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:18:31.541054 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946112ce-697c-4793-9bad-b0709d387d3b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:31.552541 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:31.623144 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d48c92-cb5c-4272-9e17-79c83ccccc08 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:31.657172 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:31.671785 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946112ce-697c-4793-9bad-b0709d387d3b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:31.673776 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999806b-ceae-4b1b-921a-8321d0e2b8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:31.674810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999806b-ceae-4b1b-921a-8321d0e2b8c0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:31.675221 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999806b-ceae-4b1b-921a-8321d0e2b8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:31.675625 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999806b-ceae-4b1b-921a-8321d0e2b8c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:31.677488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999806b-ceae-4b1b-921a-8321d0e2b8c0 None admin] RBAC: Adding query filter params (role.id=e2095c5a29d74c33b9dcb16f8e5343bf, scope.project.id=105476dcda7f48c28224d33c05860d6f, user.id=78fff294b9794a26aa1bbc231fa1133c) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:31.677917 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999806b-ceae-4b1b-921a-8321d0e2b8c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:31.679499 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999806b-ceae-4b1b-921a-8321d0e2b8c0 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:31.693453 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 407/835] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:18:31 2022] GET /identity/v3/role_assignments?user.id=78fff294b9794a26aa1bbc231fa1133c&scope.project.id=105476dcda7f48c28224d33c05860d6f&role.id=e2095c5a29d74c33b9dcb16f8e5343bf => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:31.718052 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f0e00-0623-45a5-a06a-85851b5cf58b None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:31.718565 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f0e00-0623-45a5-a06a-85851b5cf58b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:31.718973 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f0e00-0623-45a5-a06a-85851b5cf58b None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:31.719073 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66c7bb-8e23-4292-8c05-20be3924251b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:31.719732 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66c7bb-8e23-4292-8c05-20be3924251b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:31.720022 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66c7bb-8e23-4292-8c05-20be3924251b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:31.720292 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66c7bb-8e23-4292-8c05-20be3924251b None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:31.721096 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 408/836] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:18:31.721205 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66c7bb-8e23-4292-8c05-20be3924251b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:31.721312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66c7bb-8e23-4292-8c05-20be3924251b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:31.722697 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66c7bb-8e23-4292-8c05-20be3924251b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:31.727117 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbd650-036f-461a-9889-4d08748784be None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:31.727407 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbd650-036f-461a-9889-4d08748784be None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:31.727706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbd650-036f-461a-9889-4d08748784be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:31.730685 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 429/837] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 9 02:18:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:31.737738 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66c7bb-8e23-4292-8c05-20be3924251b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:31.749766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-64bbd650-036f-461a-9889-4d08748784be None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:31.751904 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-64bbd650-036f-461a-9889-4d08748784be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:31.829309 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:31.832499 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 409/838] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 02:18:31.855998 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbd650-036f-461a-9889-4d08748784be None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:31.857174 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66c7bb-8e23-4292-8c05-20be3924251b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:31.898239 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbf27e-6a3b-4029-9dbf-d4b0a3448c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:31.898853 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbf27e-6a3b-4029-9dbf-d4b0a3448c9c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:31.899130 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbf27e-6a3b-4029-9dbf-d4b0a3448c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:31.899399 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbf27e-6a3b-4029-9dbf-d4b0a3448c9c None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:31.900027 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbf27e-6a3b-4029-9dbf-d4b0a3448c9c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:31.900324 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbf27e-6a3b-4029-9dbf-d4b0a3448c9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:31.901723 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbf27e-6a3b-4029-9dbf-d4b0a3448c9c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:31.913228 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 430/839] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 9 02:18:31 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:18:31.975402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbd650-036f-461a-9889-4d08748784be None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:31.995218 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:32.016487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceaac3-08b9-4c94-8b21-4631a9550970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:32.017176 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceaac3-08b9-4c94-8b21-4631a9550970 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:32.017463 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceaac3-08b9-4c94-8b21-4631a9550970 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:32.017736 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceaac3-08b9-4c94-8b21-4631a9550970 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:32.030115 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ceaac3-08b9-4c94-8b21-4631a9550970 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:18:32.035618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-c4ceaac3-08b9-4c94-8b21-4631a9550970 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:18:32.035618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:32.035618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:32.035618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:32.035618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:32.035618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:32.035618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:32.035618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:32.035618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:32.035618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:32.035618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:32.035618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:32.035618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:18:32.035618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:18:32.035618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:18:32.035618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:18:32.036604 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:18:32.036604 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:18:32.036604 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:18:32.036604 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:18:32.036604 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:32.036604 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:32.036604 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:32.036604 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:32.036604 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:32.036604 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:32.036604 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:32.036604 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:32.036604 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:32.036604 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:32.036604 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:32.036604 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:32.037480 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:32.037480 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:32.037480 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:32.037480 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:32.037480 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:18:32.037480 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:18:32.037480 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:18:32.037480 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:18:32.037480 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:18:32.037480 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:18:32.037480 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:18:32.037480 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:32.037480 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 410/840] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:18:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:18:32.043004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbf27e-6a3b-4029-9dbf-d4b0a3448c9c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:32.152229 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbf27e-6a3b-4029-9dbf-d4b0a3448c9c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:32.187799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef5dcd-e58b-4ab8-a8e3-933d56b79df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:32.188713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef5dcd-e58b-4ab8-a8e3-933d56b79df6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:32.189218 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef5dcd-e58b-4ab8-a8e3-933d56b79df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:32.189687 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef5dcd-e58b-4ab8-a8e3-933d56b79df6 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:32.190527 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef5dcd-e58b-4ab8-a8e3-933d56b79df6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:32.191011 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef5dcd-e58b-4ab8-a8e3-933d56b79df6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:32.192673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef5dcd-e58b-4ab8-a8e3-933d56b79df6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:32.198418 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:32.203082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 431/841] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:18:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:32.214812 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceaac3-08b9-4c94-8b21-4631a9550970 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:32.326776 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceaac3-08b9-4c94-8b21-4631a9550970 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:32.363739 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86399f-0d5b-4a3b-8832-96da67f738b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:32.364380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86399f-0d5b-4a3b-8832-96da67f738b3 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:32.364669 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86399f-0d5b-4a3b-8832-96da67f738b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:32.364947 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86399f-0d5b-4a3b-8832-96da67f738b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:32.376326 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86399f-0d5b-4a3b-8832-96da67f738b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:32.378858 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86399f-0d5b-4a3b-8832-96da67f738b3 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:32.396284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-bf86399f-0d5b-4a3b-8832-96da67f738b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:32.396284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:32.396284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:32.396284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:32.396284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:32.396284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:32.396284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:32.396284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:32.396284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:32.396284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:32.396284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:32.396284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:32.396284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:32.396284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:32.396284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:32.396284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:32.397332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:32.397332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:32.397332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:32.397332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:32.397332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:32.397332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:32.397332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:32.397332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:32.397332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:32.397332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:32.397332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:32.397332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:32.397332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:32.397332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:32.397332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:32.397332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:32.397332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:32.398534 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:32.398534 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:32.398534 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:32.398534 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 411/842] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:32.403053 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef5dcd-e58b-4ab8-a8e3-933d56b79df6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:32.507304 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef5dcd-e58b-4ab8-a8e3-933d56b79df6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:32.543117 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22177b3e-a867-46f3-b45c-e196d090c58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:32.543731 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22177b3e-a867-46f3-b45c-e196d090c58f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:32.544010 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22177b3e-a867-46f3-b45c-e196d090c58f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:32.544289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22177b3e-a867-46f3-b45c-e196d090c58f None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:32.544934 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22177b3e-a867-46f3-b45c-e196d090c58f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:32.545268 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22177b3e-a867-46f3-b45c-e196d090c58f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:32.546635 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22177b3e-a867-46f3-b45c-e196d090c58f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:32.558605 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 432/843] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:32.564954 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86399f-0d5b-4a3b-8832-96da67f738b3 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:32.595877 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:32.673763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86399f-0d5b-4a3b-8832-96da67f738b3 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:32.709289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4be7fb-ead2-4ed6-adc6-ad673479bd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:32.710294 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4be7fb-ead2-4ed6-adc6-ad673479bd58 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:32.710786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4be7fb-ead2-4ed6-adc6-ad673479bd58 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:32.711211 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4be7fb-ead2-4ed6-adc6-ad673479bd58 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:32.719141 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4be7fb-ead2-4ed6-adc6-ad673479bd58 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:32.721340 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4be7fb-ead2-4ed6-adc6-ad673479bd58 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:32.732678 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-9a4be7fb-ead2-4ed6-adc6-ad673479bd58 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 02:18:32.732678 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:32.732678 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:32.732678 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:32.732678 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:32.732678 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:32.732678 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:32.732678 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:32.732678 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:32.732678 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:32.732678 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:32.732678 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:32.732678 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:18:32.732678 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:18:32.732678 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:18:32.732678 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:18:32.733849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:32.733849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:32.733849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:18:32.733849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:32.733849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:18:32.733849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:32.733849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:32.733849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:32.733849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:32.733849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:32.733849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:32.733849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:32.733849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:32.733849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:32.733849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:32.733849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:32.733849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:32.733849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:32.735025 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:32.735025 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:32.735025 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:18:32.735025 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:18:32.735025 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:18:32.735025 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:18:32.735025 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:18:32.735025 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:18:32.735025 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 02:18:32.735025 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:32.737231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 412/844] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:18:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:32.746214 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22177b3e-a867-46f3-b45c-e196d090c58f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:32.807728 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:32.850232 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22177b3e-a867-46f3-b45c-e196d090c58f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:32.884872 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916427a-7f0b-46a0-9042-19c05842a89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:32.885519 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916427a-7f0b-46a0-9042-19c05842a89a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:32.885801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916427a-7f0b-46a0-9042-19c05842a89a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:32.886075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916427a-7f0b-46a0-9042-19c05842a89a None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:32.886807 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d916427a-7f0b-46a0-9042-19c05842a89a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:32.887115 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d916427a-7f0b-46a0-9042-19c05842a89a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:32.888548 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d916427a-7f0b-46a0-9042-19c05842a89a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:32.907991 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 433/845] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Aug 9 02:18:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:32.913752 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4be7fb-ead2-4ed6-adc6-ad673479bd58 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:33.014048 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:33.028214 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4be7fb-ead2-4ed6-adc6-ad673479bd58 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:33.065237 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c84f2-1bf7-4921-a097-d6c6db7b4852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:33.065777 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c84f2-1bf7-4921-a097-d6c6db7b4852 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:33.066061 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c84f2-1bf7-4921-a097-d6c6db7b4852 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:33.066333 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c84f2-1bf7-4921-a097-d6c6db7b4852 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:33.145256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c84f2-1bf7-4921-a097-d6c6db7b4852 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:33.146705 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c84f2-1bf7-4921-a097-d6c6db7b4852 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:33.249515 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:33.264685 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 413/846] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:18:32 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 02:18:33.270848 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916427a-7f0b-46a0-9042-19c05842a89a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:33.378825 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916427a-7f0b-46a0-9042-19c05842a89a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:33.397408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:33.415650 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c09a4-d370-4123-8a07-155f9eaf9b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:33.416285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c09a4-d370-4123-8a07-155f9eaf9b18 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:33.416563 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c09a4-d370-4123-8a07-155f9eaf9b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:33.416833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c09a4-d370-4123-8a07-155f9eaf9b18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:33.427976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c09a4-d370-4123-8a07-155f9eaf9b18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:33.429527 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c09a4-d370-4123-8a07-155f9eaf9b18 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:33.444408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-487c09a4-d370-4123-8a07-155f9eaf9b18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:33.444408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:33.444408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:33.444408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:33.444408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:33.444408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:33.444408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:33.444408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:33.444408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:33.444408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:33.444408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:33.444408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:33.444408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:33.444408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:33.444408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:33.444408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:33.445382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:33.445382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:33.445382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:33.445382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:33.445382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:33.445382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:33.445382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:33.445382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:33.445382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:33.445382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:33.445382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:33.445382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:33.445382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:33.445382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:33.445382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:33.445382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:33.445382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:33.446299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:33.446299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:33.446299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:33.446299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 434/847] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:33.454700 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c84f2-1bf7-4921-a097-d6c6db7b4852 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:33.563084 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c84f2-1bf7-4921-a097-d6c6db7b4852 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:33.600404 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d8f0b-55ee-4953-b966-52de1a4874af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:33.601013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d8f0b-55ee-4953-b966-52de1a4874af None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:33.601319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d8f0b-55ee-4953-b966-52de1a4874af None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:33.601590 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d8f0b-55ee-4953-b966-52de1a4874af None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:33.602298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d8f0b-55ee-4953-b966-52de1a4874af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:33.602603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d8f0b-55ee-4953-b966-52de1a4874af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:33.604015 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d8f0b-55ee-4953-b966-52de1a4874af None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:33.617112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 414/848] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:33.626692 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c09a4-d370-4123-8a07-155f9eaf9b18 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:33.671932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57655a25-987d-4429-881c-6c3f7e120edf None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:33.672216 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57655a25-987d-4429-881c-6c3f7e120edf None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:33.672400 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57655a25-987d-4429-881c-6c3f7e120edf None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:33.674995 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 415/849] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:18:33.678889 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecb289-e48c-4491-96ed-f7619a4f7461 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:33.679171 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecb289-e48c-4491-96ed-f7619a4f7461 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:33.679442 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecb289-e48c-4491-96ed-f7619a4f7461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:33.698753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-35ecb289-e48c-4491-96ed-f7619a4f7461 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:33.699945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-35ecb289-e48c-4491-96ed-f7619a4f7461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:33.743072 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c09a4-d370-4123-8a07-155f9eaf9b18 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:33.748464 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:33.781153 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 416/850] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:33.787282 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1dc2a-9519-4ee0-b67a-164831b639b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:33.787920 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1dc2a-9519-4ee0-b67a-164831b639b7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:33.788199 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1dc2a-9519-4ee0-b67a-164831b639b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:33.788471 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1dc2a-9519-4ee0-b67a-164831b639b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:33.795408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1dc2a-9519-4ee0-b67a-164831b639b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:33.796861 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1dc2a-9519-4ee0-b67a-164831b639b7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:33.800533 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecb289-e48c-4491-96ed-f7619a4f7461 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:33.810080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-97b1dc2a-9519-4ee0-b67a-164831b639b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:33.810080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:33.810080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:33.810080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:33.810080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:33.810080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:33.810080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:33.810080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:33.810080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:33.810080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:33.810080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:33.810080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:33.810080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:33.810080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:33.810080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:33.811039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:33.811039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:33.811039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:33.811039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:33.811039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:33.811039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:33.811039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:33.811039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:33.811039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:33.811039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:33.811039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:33.811039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:33.811039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:33.811039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:33.811039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:33.811039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:33.811039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:33.811922 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:33.811922 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:33.811922 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:33.811922 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:33.811922 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:33.811922 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:33.811922 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:33.811922 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:33.811922 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 435/851] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:33.819185 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1dc2a-9519-4ee0-b67a-164831b639b7 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:33.856914 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:33.914696 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecb289-e48c-4491-96ed-f7619a4f7461 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:33.951145 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1dc2a-9519-4ee0-b67a-164831b639b7 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:33.954026 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e644d62-cbc4-4717-9e0a-31bb92dccbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:33.954753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e644d62-cbc4-4717-9e0a-31bb92dccbaa None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:33.955087 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e644d62-cbc4-4717-9e0a-31bb92dccbaa None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:33.955423 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e644d62-cbc4-4717-9e0a-31bb92dccbaa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:33.968936 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e644d62-cbc4-4717-9e0a-31bb92dccbaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:18:33.979330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-5e644d62-cbc4-4717-9e0a-31bb92dccbaa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:33.979330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:33.979330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:33.979330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:33.979330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:33.979330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:33.979330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:33.979330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:33.979330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:33.979330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:33.979330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:33.979330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:33.979330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:18:33.979330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:18:33.979330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:18:33.979330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:18:33.980338 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:18:33.980338 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:18:33.980338 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:18:33.980338 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:18:33.980338 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:33.980338 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:33.980338 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:33.980338 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:33.980338 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:33.980338 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:33.980338 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:33.980338 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:33.980338 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:33.980338 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:33.980338 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:33.980338 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:33.981232 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:33.981232 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:33.981232 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:33.981232 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:33.981232 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:18:33.981232 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:18:33.981232 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:18:33.981232 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:18:33.981232 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:18:33.981232 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:18:33.981232 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:18:33.981232 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:33.985547 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 417/852] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 9 02:18:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:18:33.990670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e644d62-cbc4-4717-9e0a-31bb92dccbaa None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:33.998338 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f95ba-aedf-41da-a8eb-cd9621733079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:33.998956 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f95ba-aedf-41da-a8eb-cd9621733079 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:33.999247 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f95ba-aedf-41da-a8eb-cd9621733079 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:33.999519 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f95ba-aedf-41da-a8eb-cd9621733079 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:34.000221 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f95ba-aedf-41da-a8eb-cd9621733079 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:34.000531 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f95ba-aedf-41da-a8eb-cd9621733079 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:34.003127 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f95ba-aedf-41da-a8eb-cd9621733079 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:34.016065 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 436/853] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:34.017363 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720727a3-d7c8-4ec5-ad7c-f5f40a546b20 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:34.017815 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720727a3-d7c8-4ec5-ad7c-f5f40a546b20 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:34.018098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720727a3-d7c8-4ec5-ad7c-f5f40a546b20 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:34.019404 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 437/854] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:34.020300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c5536-61fc-4282-acb0-8c2c9e7e3a03 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:34.020580 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c5536-61fc-4282-acb0-8c2c9e7e3a03 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:34.021073 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c5536-61fc-4282-acb0-8c2c9e7e3a03 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:34.022245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 438/855] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:34.022792 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c5536-61fc-4282-acb0-8c2c9e7e3a03 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:34.038300 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:34.098072 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e644d62-cbc4-4717-9e0a-31bb92dccbaa None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:34.115018 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:34.126975 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c5536-61fc-4282-acb0-8c2c9e7e3a03 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:34.133276 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc846b3-b952-4353-b58e-93aad06238d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:34.133884 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc846b3-b952-4353-b58e-93aad06238d1 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:34.134167 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc846b3-b952-4353-b58e-93aad06238d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:34.134450 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc846b3-b952-4353-b58e-93aad06238d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:34.135110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc846b3-b952-4353-b58e-93aad06238d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:34.135422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc846b3-b952-4353-b58e-93aad06238d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:34.136805 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc846b3-b952-4353-b58e-93aad06238d1 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:34.144959 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 418/856] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 9 02:18:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:34.145985 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524af4a-9af7-46b0-9a9d-445413e843d1 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:34.146275 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524af4a-9af7-46b0-9a9d-445413e843d1 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:34.146555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524af4a-9af7-46b0-9a9d-445413e843d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:34.160567 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480592f1-581c-4719-bd37-7b20ae9cee68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:34.161190 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480592f1-581c-4719-bd37-7b20ae9cee68 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:34.161468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480592f1-581c-4719-bd37-7b20ae9cee68 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:34.161735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480592f1-581c-4719-bd37-7b20ae9cee68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:34.162446 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480592f1-581c-4719-bd37-7b20ae9cee68 None admin] RBAC: Adding query filter params (role.id=e2095c5a29d74c33b9dcb16f8e5343bf, scope.project.id=105476dcda7f48c28224d33c05860d6f, user.id=9151f210d29542dcb41ea3bc03390350) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:34.162748 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480592f1-581c-4719-bd37-7b20ae9cee68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:34.163762 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-5524af4a-9af7-46b0-9a9d-445413e843d1 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:34.164151 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480592f1-581c-4719-bd37-7b20ae9cee68 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:34.164957 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5524af4a-9af7-46b0-9a9d-445413e843d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:34.169784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 439/857] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:18:34 2022] GET /identity/v3/role_assignments?user.id=9151f210d29542dcb41ea3bc03390350&scope.project.id=105476dcda7f48c28224d33c05860d6f&role.id=e2095c5a29d74c33b9dcb16f8e5343bf => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:34.170959 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d3e03-6889-487c-9dc1-bc569eaecd31 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:34.171245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d3e03-6889-487c-9dc1-bc569eaecd31 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:34.171515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d3e03-6889-487c-9dc1-bc569eaecd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:34.191527 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-195d3e03-6889-487c-9dc1-bc569eaecd31 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:34.192897 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-195d3e03-6889-487c-9dc1-bc569eaecd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:34.247474 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 419/858] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:34.248346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524af4a-9af7-46b0-9a9d-445413e843d1 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:34.292073 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 440/859] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:34.293596 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d3e03-6889-487c-9dc1-bc569eaecd31 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:34.299363 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:34.378943 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524af4a-9af7-46b0-9a9d-445413e843d1 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:34.406282 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:34.420707 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa9c58-6cbc-47e1-8665-0287277602e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:34.421682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa9c58-6cbc-47e1-8665-0287277602e7 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:34.422171 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa9c58-6cbc-47e1-8665-0287277602e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:34.422387 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa9c58-6cbc-47e1-8665-0287277602e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:34.424603 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d3e03-6889-487c-9dc1-bc569eaecd31 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:34.433718 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa9c58-6cbc-47e1-8665-0287277602e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:34.435172 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa9c58-6cbc-47e1-8665-0287277602e7 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:34.451231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-affa9c58-6cbc-47e1-8665-0287277602e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:34.451231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:34.451231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:34.451231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:34.451231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:34.451231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:34.451231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:34.451231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:34.451231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:34.451231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:34.451231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:34.451231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:34.451231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:34.451231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:34.451231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:34.451231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:34.452185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:34.452185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:34.452185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:34.452185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:34.452185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:34.452185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:34.452185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:34.452185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:34.452185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:34.452185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:34.452185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:34.452185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:34.452185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:34.452185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:34.452185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:34.452185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:34.452185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:34.453786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:34.453786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:34.453786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:34.453786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 420/860] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:34.453786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa9c58-6cbc-47e1-8665-0287277602e7 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:34.465817 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f35608-4438-476c-89e9-568c5d257926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:34.466452 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f35608-4438-476c-89e9-568c5d257926 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:34.466740 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f35608-4438-476c-89e9-568c5d257926 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:34.467016 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f35608-4438-476c-89e9-568c5d257926 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:34.467608 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f35608-4438-476c-89e9-568c5d257926 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:34.468982 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f35608-4438-476c-89e9-568c5d257926 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:34.478185 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-15f35608-4438-476c-89e9-568c5d257926 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 02:18:34.478185 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:34.478185 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 02:18:34.478185 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 02:18:34.478185 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 02:18:34.478185 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 02:18:34.478185 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 02:18:34.478185 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:34.478185 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 02:18:34.478185 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:34.478185 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:18:34.478185 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:34.478185 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:34.478185 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:34.478185 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:34.478185 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:34.479129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:34.479129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:34.479129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:34.479129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:34.479129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:34.479129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:34.479129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:34.479129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 02:18:34.479129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 02:18:34.479129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 02:18:34.479129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 02:18:34.479129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:34.479129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:34.479129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:34.479129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:34.479129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:34.479129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:34.480562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:34.480562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:34.480562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:34.480562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:34.480562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:34.480562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:34.480562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:34.480562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:34.480562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:34.480562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:34.480562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 02:18:34.480562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:34.480562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 02:18:34.480562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:34.480562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 441/861] 10.222.0.16 () {56 vars in 1132 bytes} [Tue Aug 9 02:18:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:34.481385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f35608-4438-476c-89e9-568c5d257926 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:34.547056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:34.568133 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa9c58-6cbc-47e1-8665-0287277602e7 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:34.591425 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f35608-4438-476c-89e9-568c5d257926 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:34.607038 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9cd01-e572-4d05-ae9a-d6e437123926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:34.607650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9cd01-e572-4d05-ae9a-d6e437123926 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:34.607979 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9cd01-e572-4d05-ae9a-d6e437123926 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:34.608354 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9cd01-e572-4d05-ae9a-d6e437123926 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:34.609006 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9cd01-e572-4d05-ae9a-d6e437123926 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:34.610522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9cd01-e572-4d05-ae9a-d6e437123926 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:34.625512 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 421/862] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 9 02:18:34 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:18:34.626694 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9cd01-e572-4d05-ae9a-d6e437123926 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:34.645166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69586b31-9c19-434b-b791-922641648a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:34.645920 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69586b31-9c19-434b-b791-922641648a4f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:34.646202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69586b31-9c19-434b-b791-922641648a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:34.646475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69586b31-9c19-434b-b791-922641648a4f None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:34.647205 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69586b31-9c19-434b-b791-922641648a4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:34.647682 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69586b31-9c19-434b-b791-922641648a4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:34.649374 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69586b31-9c19-434b-b791-922641648a4f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:34.665173 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 442/863] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:34.671468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69586b31-9c19-434b-b791-922641648a4f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:34.676606 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:34.762756 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9cd01-e572-4d05-ae9a-d6e437123926 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:34.807533 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf0f5f-dc8a-4577-90d2-2715ada6ced1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:34.808078 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf0f5f-dc8a-4577-90d2-2715ada6ced1 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:34.808361 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf0f5f-dc8a-4577-90d2-2715ada6ced1 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:34.808636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf0f5f-dc8a-4577-90d2-2715ada6ced1 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:34.809308 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf0f5f-dc8a-4577-90d2-2715ada6ced1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:34.809616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf0f5f-dc8a-4577-90d2-2715ada6ced1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:34.810299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69586b31-9c19-434b-b791-922641648a4f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:34.810997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf0f5f-dc8a-4577-90d2-2715ada6ced1 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:34.816843 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 422/864] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 9 02:18:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:34.823674 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf0f5f-dc8a-4577-90d2-2715ada6ced1 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:34.833976 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:34.856078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687206e-5113-4133-82d0-aa9bb21606c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:34.856710 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687206e-5113-4133-82d0-aa9bb21606c8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:34.856986 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687206e-5113-4133-82d0-aa9bb21606c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:34.857593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687206e-5113-4133-82d0-aa9bb21606c8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:34.866879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687206e-5113-4133-82d0-aa9bb21606c8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:34.869396 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687206e-5113-4133-82d0-aa9bb21606c8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:34.883044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-e687206e-5113-4133-82d0-aa9bb21606c8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 02:18:34.883044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:34.883044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:34.883044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:34.883044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:34.883044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:34.883044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:34.883044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:34.883044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:34.883044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:34.883044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:34.883044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:34.883044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:18:34.883044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:18:34.883044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:18:34.883044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:18:34.884106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:34.884106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:34.884106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:18:34.884106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:34.884106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:18:34.884106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:34.884106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:34.884106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:34.884106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:34.884106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:34.884106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:34.884106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:34.884106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:34.884106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:34.884106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:34.884106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:34.884106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:34.884106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:34.885844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:34.885844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:34.885844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:18:34.885844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:18:34.885844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:18:34.885844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:18:34.885844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:18:34.885844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:18:34.885844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 02:18:34.885844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:34.885844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 443/865] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 9 02:18:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:18:34.890142 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687206e-5113-4133-82d0-aa9bb21606c8 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:34.930787 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf0f5f-dc8a-4577-90d2-2715ada6ced1 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:34.957771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:34.968141 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf5f8a-19c4-4ceb-b79e-ca6fafc9c968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:34.968757 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf5f8a-19c4-4ceb-b79e-ca6fafc9c968 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:34.969054 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf5f8a-19c4-4ceb-b79e-ca6fafc9c968 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:34.969912 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf5f8a-19c4-4ceb-b79e-ca6fafc9c968 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:34.973640 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf5f8a-19c4-4ceb-b79e-ca6fafc9c968 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:34.974032 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf5f8a-19c4-4ceb-b79e-ca6fafc9c968 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:34.975422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf5f8a-19c4-4ceb-b79e-ca6fafc9c968 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:34.983792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 423/866] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 9 02:18:34 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:35.001648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687206e-5113-4133-82d0-aa9bb21606c8 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:35.040886 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd9257-59e3-46b1-a103-31c80b306697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:35.041552 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd9257-59e3-46b1-a103-31c80b306697 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:35.041834 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd9257-59e3-46b1-a103-31c80b306697 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:35.042181 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd9257-59e3-46b1-a103-31c80b306697 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:35.042985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd9257-59e3-46b1-a103-31c80b306697 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:35.043306 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd9257-59e3-46b1-a103-31c80b306697 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:35.044835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd9257-59e3-46b1-a103-31c80b306697 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:35.068949 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 444/867] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Aug 9 02:18:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:18:35.078175 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf5f8a-19c4-4ceb-b79e-ca6fafc9c968 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:35.154807 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:35.199809 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf5f8a-19c4-4ceb-b79e-ca6fafc9c968 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:35.238918 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1c440-5c05-4a88-8c50-7974246c8a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:35.239542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1c440-5c05-4a88-8c50-7974246c8a40 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:35.239857 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1c440-5c05-4a88-8c50-7974246c8a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:35.240341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1c440-5c05-4a88-8c50-7974246c8a40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:35.315273 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1c440-5c05-4a88-8c50-7974246c8a40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:35.316842 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1c440-5c05-4a88-8c50-7974246c8a40 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:35.393563 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:35.427053 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 424/868] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:18:35 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 02:18:35.432091 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd9257-59e3-46b1-a103-31c80b306697 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:35.559710 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd9257-59e3-46b1-a103-31c80b306697 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:35.583462 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:35.596129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd43a2-77fe-4f26-8110-f088c0ef3e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:35.596756 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd43a2-77fe-4f26-8110-f088c0ef3e55 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:35.597046 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd43a2-77fe-4f26-8110-f088c0ef3e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:35.597327 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd43a2-77fe-4f26-8110-f088c0ef3e55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:35.614278 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd43a2-77fe-4f26-8110-f088c0ef3e55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:35.616057 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd43a2-77fe-4f26-8110-f088c0ef3e55 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:35.635299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-69bd43a2-77fe-4f26-8110-f088c0ef3e55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:35.635299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:35.635299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:35.635299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:35.635299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:35.635299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:35.635299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:35.635299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:35.635299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:35.635299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:35.635299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:35.635299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:35.635299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:35.635299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:35.635299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:35.635299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:35.636481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:35.636481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:35.636481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:35.636481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:35.636481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:35.636481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:35.636481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:35.636481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:35.636481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:35.636481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:35.636481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:35.636481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:35.636481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:35.636481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:35.636481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:35.636481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:35.636481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:35.637457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:35.637457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:35.637457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:35.637457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 445/869] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:35.642211 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1c440-5c05-4a88-8c50-7974246c8a40 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:35.751788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1c440-5c05-4a88-8c50-7974246c8a40 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:35.784576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709f725-7905-439f-adc0-6d08be256fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:35.785211 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709f725-7905-439f-adc0-6d08be256fbd None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:35.785490 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709f725-7905-439f-adc0-6d08be256fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:35.785757 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709f725-7905-439f-adc0-6d08be256fbd None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:35.786436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709f725-7905-439f-adc0-6d08be256fbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:35.786697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709f725-7905-439f-adc0-6d08be256fbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:35.788057 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709f725-7905-439f-adc0-6d08be256fbd None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:35.800533 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 425/870] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:35.805945 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd43a2-77fe-4f26-8110-f088c0ef3e55 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:35.911128 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd43a2-77fe-4f26-8110-f088c0ef3e55 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:35.947427 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e822a-aaea-4860-84a4-b17f2fe7c98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:35.948050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e822a-aaea-4860-84a4-b17f2fe7c98e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:35.948327 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e822a-aaea-4860-84a4-b17f2fe7c98e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:35.948598 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e822a-aaea-4860-84a4-b17f2fe7c98e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:35.955437 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e822a-aaea-4860-84a4-b17f2fe7c98e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:35.956869 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e822a-aaea-4860-84a4-b17f2fe7c98e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:35.968076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-f98e822a-aaea-4860-84a4-b17f2fe7c98e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:35.968076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:35.968076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:35.968076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:35.968076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:35.968076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:35.968076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:35.968076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:35.968076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:35.968076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:35.968076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:35.968076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:35.968076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:35.968076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:35.968076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:35.968942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:35.968942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:35.968942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:35.968942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:35.968942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:35.968942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:35.968942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:35.968942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:35.968942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:35.968942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:35.968942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:35.968942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:35.968942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:35.968942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:35.968942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:35.968942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:35.968942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:35.970434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:35.970434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:35.970434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:35.970434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:35.970434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:35.970434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:35.970434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:35.970434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:35.970434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 446/871] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:35.979778 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709f725-7905-439f-adc0-6d08be256fbd None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:36.030254 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:36.077632 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709f725-7905-439f-adc0-6d08be256fbd None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:36.112426 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2ee49-ded7-4ca0-9bae-f609b9bf4923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:36.113038 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2ee49-ded7-4ca0-9bae-f609b9bf4923 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:36.113338 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2ee49-ded7-4ca0-9bae-f609b9bf4923 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:36.113609 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2ee49-ded7-4ca0-9bae-f609b9bf4923 None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:36.114299 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2ee49-ded7-4ca0-9bae-f609b9bf4923 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:36.114602 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2ee49-ded7-4ca0-9bae-f609b9bf4923 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:36.116270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2ee49-ded7-4ca0-9bae-f609b9bf4923 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:36.128598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 426/872] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:36.134628 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e822a-aaea-4860-84a4-b17f2fe7c98e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:36.170458 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:36.236015 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e0ea3-9887-4837-9e2d-19059c0f9dce None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:36.236366 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e0ea3-9887-4837-9e2d-19059c0f9dce None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:36.236566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e0ea3-9887-4837-9e2d-19059c0f9dce None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:36.237129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e822a-aaea-4860-84a4-b17f2fe7c98e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:36.238181 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 427/873] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:18:36.243492 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def4450-a6c4-4eb5-81d8-49b98f21fc0b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:36.243785 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def4450-a6c4-4eb5-81d8-49b98f21fc0b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:36.244059 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def4450-a6c4-4eb5-81d8-49b98f21fc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:36.262817 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-7def4450-a6c4-4eb5-81d8-49b98f21fc0b None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:36.264008 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-7def4450-a6c4-4eb5-81d8-49b98f21fc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:36.277375 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855d8f0-b673-45dc-9daa-d0a7e2afc214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:36.278243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855d8f0-b673-45dc-9daa-d0a7e2afc214 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:36.278518 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855d8f0-b673-45dc-9daa-d0a7e2afc214 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:36.279253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855d8f0-b673-45dc-9daa-d0a7e2afc214 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:36.280250 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855d8f0-b673-45dc-9daa-d0a7e2afc214 None admin] RBAC: Adding query filter params (role.id=d521e5f58e7e4cd48ceed4404113cbd5, scope.project.id=105476dcda7f48c28224d33c05860d6f, user.id=07041df2276d4dd58fb0e49417a26e2c) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:36.280618 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855d8f0-b673-45dc-9daa-d0a7e2afc214 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:36.282719 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7855d8f0-b673-45dc-9daa-d0a7e2afc214 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:36.290837 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 447/874] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:18:36 2022] GET /identity/v3/role_assignments?user.id=07041df2276d4dd58fb0e49417a26e2c&scope.project.id=105476dcda7f48c28224d33c05860d6f&role.id=d521e5f58e7e4cd48ceed4404113cbd5 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:36.349586 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 428/875] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:36 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:36.373728 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855d8f0-b673-45dc-9daa-d0a7e2afc214 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:36.489877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:36.494636 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855d8f0-b673-45dc-9daa-d0a7e2afc214 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:36.534809 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebfc56-7472-4577-84e6-71596b5bd7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:36.535348 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebfc56-7472-4577-84e6-71596b5bd7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:36.535624 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebfc56-7472-4577-84e6-71596b5bd7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:36.535892 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebfc56-7472-4577-84e6-71596b5bd7f5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:36.536471 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ebfc56-7472-4577-84e6-71596b5bd7f5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:36.537860 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ebfc56-7472-4577-84e6-71596b5bd7f5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:36.546555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-49ebfc56-7472-4577-84e6-71596b5bd7f5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 02:18:36.546555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:36.546555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 02:18:36.546555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 02:18:36.546555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 02:18:36.546555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 02:18:36.546555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 02:18:36.546555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:36.546555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 02:18:36.546555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:36.546555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:18:36.546555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:36.546555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:36.546555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:36.546555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:36.546555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:36.546555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:36.548255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:36.548255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:36.548255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:36.548255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:36.548255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:36.548255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:36.548255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 02:18:36.548255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 02:18:36.548255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 02:18:36.548255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 02:18:36.548255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:36.548255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:36.548255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:36.548255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:36.548255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:36.548255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:36.549166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:36.549166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:36.549166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:36.549166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:36.549166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:36.549166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:36.549166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:36.549166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:36.549166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:36.549166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:36.549166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 02:18:36.549166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:36.549166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 02:18:36.549166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:36.549166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 448/876] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 9 02:18:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:36.554260 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def4450-a6c4-4eb5-81d8-49b98f21fc0b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:36.584211 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:36.674138 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def4450-a6c4-4eb5-81d8-49b98f21fc0b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:36.709405 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec22d69-88b8-4aa4-8f8c-208c78c899dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:36.710010 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec22d69-88b8-4aa4-8f8c-208c78c899dd None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:36.710290 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec22d69-88b8-4aa4-8f8c-208c78c899dd None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:36.710562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec22d69-88b8-4aa4-8f8c-208c78c899dd None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:36.711193 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec22d69-88b8-4aa4-8f8c-208c78c899dd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:36.711491 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec22d69-88b8-4aa4-8f8c-208c78c899dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:36.712853 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec22d69-88b8-4aa4-8f8c-208c78c899dd None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:36.717753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 429/877] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 9 02:18:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:36.723315 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebfc56-7472-4577-84e6-71596b5bd7f5 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:36.831092 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebfc56-7472-4577-84e6-71596b5bd7f5 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:36.867059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0601b9f-6072-404b-a83f-8513dcc357ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:36.867668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0601b9f-6072-404b-a83f-8513dcc357ea None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:36.867942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0601b9f-6072-404b-a83f-8513dcc357ea None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:36.868211 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0601b9f-6072-404b-a83f-8513dcc357ea None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:36.868839 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0601b9f-6072-404b-a83f-8513dcc357ea None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:36.869169 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0601b9f-6072-404b-a83f-8513dcc357ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:36.870533 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0601b9f-6072-404b-a83f-8513dcc357ea None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:36.876144 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 449/878] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 9 02:18:36 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:36.888715 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16b0bd-fbb4-4a00-b2c6-6c82b537dba5 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:36.889055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16b0bd-fbb4-4a00-b2c6-6c82b537dba5 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:36.889326 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16b0bd-fbb4-4a00-b2c6-6c82b537dba5 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:36.892171 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 430/879] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:36.896896 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fd836-833b-42fe-bd90-41718478ded1 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:36.897326 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fd836-833b-42fe-bd90-41718478ded1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:36.897614 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fd836-833b-42fe-bd90-41718478ded1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:36.917166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-112fd836-833b-42fe-bd90-41718478ded1 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:36.918395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-112fd836-833b-42fe-bd90-41718478ded1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:36.942720 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:36.999909 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 450/880] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:36 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:37.018404 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16b0bd-fbb4-4a00-b2c6-6c82b537dba5 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:37.111002 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:37.129867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16b0bd-fbb4-4a00-b2c6-6c82b537dba5 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:37.165869 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67affe50-2f56-43c4-ad9c-d08b40cb06c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:37.166502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67affe50-2f56-43c4-ad9c-d08b40cb06c4 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:37.166784 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67affe50-2f56-43c4-ad9c-d08b40cb06c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:37.167057 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67affe50-2f56-43c4-ad9c-d08b40cb06c4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:37.167705 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67affe50-2f56-43c4-ad9c-d08b40cb06c4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:37.169181 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67affe50-2f56-43c4-ad9c-d08b40cb06c4 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:37.178771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-67affe50-2f56-43c4-ad9c-d08b40cb06c4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 02:18:37.178771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:37.178771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 02:18:37.178771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 02:18:37.178771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 02:18:37.178771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 02:18:37.178771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 02:18:37.178771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:37.178771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 02:18:37.178771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:37.178771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:18:37.178771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:37.178771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:37.178771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:37.178771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:37.178771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:37.178771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:37.179753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:37.179753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:37.179753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:37.179753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:37.179753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:37.179753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:37.179753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 02:18:37.179753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 02:18:37.179753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 02:18:37.179753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 02:18:37.179753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:37.179753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:37.179753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:37.179753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:37.179753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:37.179753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:37.180583 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:37.180583 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:37.180583 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:37.180583 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:37.180583 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:37.180583 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:37.180583 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:37.180583 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:37.180583 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:37.180583 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:37.180583 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 02:18:37.180583 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:37.180583 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 02:18:37.180583 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:37.183884 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 431/881] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 9 02:18:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:37.186475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fd836-833b-42fe-bd90-41718478ded1 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:37.288850 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fd836-833b-42fe-bd90-41718478ded1 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:37.321913 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68218e-cfda-45b8-b6c7-e24d96f5d71f None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:37.322220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68218e-cfda-45b8-b6c7-e24d96f5d71f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:37.322465 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68218e-cfda-45b8-b6c7-e24d96f5d71f None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:37.324457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981671d-0f31-4799-8666-cf6d0877f3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:37.325091 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981671d-0f31-4799-8666-cf6d0877f3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:37.325371 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981671d-0f31-4799-8666-cf6d0877f3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:37.325641 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981671d-0f31-4799-8666-cf6d0877f3e8 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:37.326270 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981671d-0f31-4799-8666-cf6d0877f3e8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:37.326579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981671d-0f31-4799-8666-cf6d0877f3e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:37.327666 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 432/882] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:18:37.327937 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981671d-0f31-4799-8666-cf6d0877f3e8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:37.329257 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4ddde-d338-42a9-9479-dc1b436437fa None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:37.329554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4ddde-d338-42a9-9479-dc1b436437fa None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:37.329833 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4ddde-d338-42a9-9479-dc1b436437fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:37.333172 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 451/883] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 9 02:18:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:37.339405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981671d-0f31-4799-8666-cf6d0877f3e8 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:37.354984 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-3cb4ddde-d338-42a9-9479-dc1b436437fa None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:37.356508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3cb4ddde-d338-42a9-9479-dc1b436437fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:37.368219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:37.453045 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 433/884] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:37 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:37.459230 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981671d-0f31-4799-8666-cf6d0877f3e8 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:37.471088 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4ddde-d338-42a9-9479-dc1b436437fa None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:37.500214 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31f181-9661-4f91-b9ea-1d6c1b821567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:37.501453 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31f181-9661-4f91-b9ea-1d6c1b821567 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:37.501944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31f181-9661-4f91-b9ea-1d6c1b821567 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:37.502426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31f181-9661-4f91-b9ea-1d6c1b821567 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:37.503260 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31f181-9661-4f91-b9ea-1d6c1b821567 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:37.503947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31f181-9661-4f91-b9ea-1d6c1b821567 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:37.505666 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31f181-9661-4f91-b9ea-1d6c1b821567 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:37.516003 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 452/885] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 9 02:18:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:37.517580 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31f181-9661-4f91-b9ea-1d6c1b821567 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:37.574681 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:37.604466 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4ddde-d338-42a9-9479-dc1b436437fa None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:37.627988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:37.646487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31f181-9661-4f91-b9ea-1d6c1b821567 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:37.653245 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6b8b5-67d6-478f-a809-61d226d4a43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:37.653862 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6b8b5-67d6-478f-a809-61d226d4a43b None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:37.654143 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6b8b5-67d6-478f-a809-61d226d4a43b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:37.654419 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6b8b5-67d6-478f-a809-61d226d4a43b None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:37.655081 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6b8b5-67d6-478f-a809-61d226d4a43b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:37.659414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6b8b5-67d6-478f-a809-61d226d4a43b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:37.681173 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 434/886] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 9 02:18:37 2022] POST /identity/v3/services => generated 269 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:18:37.701906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1407a-eb5a-4e3c-af54-d3792c2672ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:37.702956 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1407a-eb5a-4e3c-af54-d3792c2672ab None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:37.703985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1407a-eb5a-4e3c-af54-d3792c2672ab None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:37.704463 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1407a-eb5a-4e3c-af54-d3792c2672ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:37.705611 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1407a-eb5a-4e3c-af54-d3792c2672ab None admin] RBAC: Adding query filter params (interface=public, service_id=7ef81df7972448059401f49c81d59dee, region_id=RegionOne) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:37.706146 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1407a-eb5a-4e3c-af54-d3792c2672ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:37.708065 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1407a-eb5a-4e3c-af54-d3792c2672ab None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:37.718014 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 453/887] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 9 02:18:37 2022] GET /identity/v3/endpoints?service_id=7ef81df7972448059401f49c81d59dee&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:18:37.726258 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6b8b5-67d6-478f-a809-61d226d4a43b None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:37.837067 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6b8b5-67d6-478f-a809-61d226d4a43b None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:37.873620 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70591576-145b-48f9-ab34-7a0bfa4256e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:37.874230 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70591576-145b-48f9-ab34-7a0bfa4256e8 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:37.874514 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70591576-145b-48f9-ab34-7a0bfa4256e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:37.874786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70591576-145b-48f9-ab34-7a0bfa4256e8 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:37.875469 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70591576-145b-48f9-ab34-7a0bfa4256e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:37.876874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70591576-145b-48f9-ab34-7a0bfa4256e8 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:37.882848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 435/888] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 9 02:18:37 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:18:38.497653 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9595482-e115-45fc-b792-a9d4ae3e4246 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:38.498171 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9595482-e115-45fc-b792-a9d4ae3e4246 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:38.498171 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9595482-e115-45fc-b792-a9d4ae3e4246 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:38.499818 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 454/889] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:38.505677 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a48cd-303c-4d75-847a-fa3b86cd94e8 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:38.506090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a48cd-303c-4d75-847a-fa3b86cd94e8 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:38.506275 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a48cd-303c-4d75-847a-fa3b86cd94e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:38.512751 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:38.526288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-e94a48cd-303c-4d75-847a-fa3b86cd94e8 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:38.527486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e94a48cd-303c-4d75-847a-fa3b86cd94e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:38.597701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 436/890] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:38 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:38.621983 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9595482-e115-45fc-b792-a9d4ae3e4246 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:38.725976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9595482-e115-45fc-b792-a9d4ae3e4246 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:38.761248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688f1a8-e808-4f7c-bb04-15becfe1192e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:38.761798 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688f1a8-e808-4f7c-bb04-15becfe1192e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:38.762075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688f1a8-e808-4f7c-bb04-15becfe1192e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:38.762347 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688f1a8-e808-4f7c-bb04-15becfe1192e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:38.772665 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b688f1a8-e808-4f7c-bb04-15becfe1192e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:18:38.777319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-b688f1a8-e808-4f7c-bb04-15becfe1192e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 02:18:38.777319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:38.777319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:38.777319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:38.777319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:38.777319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:38.777319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:38.777319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:38.777319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:38.777319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:38.777319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:38.777319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:38.777319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:18:38.777319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:18:38.777319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:18:38.777319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:18:38.778231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:18:38.778231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:18:38.778231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:18:38.778231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:18:38.778231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:38.778231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:38.778231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:38.778231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:38.778231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:38.778231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:38.778231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:38.778231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:38.778231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:38.778231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:38.778231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:38.778231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:38.779056 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:38.779056 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:38.779056 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:38.779056 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:38.779056 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:18:38.779056 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:18:38.779056 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:18:38.779056 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:18:38.779056 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:18:38.779056 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:18:38.779056 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 02:18:38.779056 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:38.779056 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 455/891] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Aug 9 02:18:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:38.785367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a48cd-303c-4d75-847a-fa3b86cd94e8 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:38.890893 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a48cd-303c-4d75-847a-fa3b86cd94e8 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:38.924483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:38.934672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026977b-765b-42b7-a3ed-66390b5f5122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:38.935595 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026977b-765b-42b7-a3ed-66390b5f5122 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:38.936079 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026977b-765b-42b7-a3ed-66390b5f5122 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:38.936548 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026977b-765b-42b7-a3ed-66390b5f5122 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:38.937446 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026977b-765b-42b7-a3ed-66390b5f5122 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:38.938051 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026977b-765b-42b7-a3ed-66390b5f5122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:38.939612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026977b-765b-42b7-a3ed-66390b5f5122 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:38.948743 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 437/892] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 9 02:18:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:38.958106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688f1a8-e808-4f7c-bb04-15becfe1192e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:38.962675 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:39.001791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d900aa-b954-459b-b0c0-2d3fef59dc7c None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:39.002090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d900aa-b954-459b-b0c0-2d3fef59dc7c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:39.002340 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d900aa-b954-459b-b0c0-2d3fef59dc7c None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:39.003920 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 438/893] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:18:39.008732 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee984763-277b-4eb7-b2cc-7ab24e0ff2ee None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:39.009038 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee984763-277b-4eb7-b2cc-7ab24e0ff2ee None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:39.009331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee984763-277b-4eb7-b2cc-7ab24e0ff2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:39.027250 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-ee984763-277b-4eb7-b2cc-7ab24e0ff2ee None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:39.028444 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ee984763-277b-4eb7-b2cc-7ab24e0ff2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:39.067621 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688f1a8-e808-4f7c-bb04-15becfe1192e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:39.102870 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 439/894] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:39 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 02:18:39.103784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c66a28-770b-428a-be94-c4d9b68ade10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:39.104574 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c66a28-770b-428a-be94-c4d9b68ade10 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:39.105014 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c66a28-770b-428a-be94-c4d9b68ade10 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:39.105449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c66a28-770b-428a-be94-c4d9b68ade10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:39.116332 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c66a28-770b-428a-be94-c4d9b68ade10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:39.118033 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c66a28-770b-428a-be94-c4d9b68ade10 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:39.127264 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee984763-277b-4eb7-b2cc-7ab24e0ff2ee None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:39.133147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-c8c66a28-770b-428a-be94-c4d9b68ade10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:39.133147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:39.133147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:39.133147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:39.133147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:39.133147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:39.133147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:39.133147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:39.133147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:39.133147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:39.133147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:39.133147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:39.133147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:39.133147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:39.133147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:39.133147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:39.134263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:39.134263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:39.134263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:39.134263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:39.134263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:39.134263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:39.134263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:39.134263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:39.134263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:39.134263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:39.134263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:39.134263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:39.134263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:39.134263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:39.134263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:39.134263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:39.134263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:39.135315 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:39.135315 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:39.135315 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:39.136934 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 456/895] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:39.147405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c66a28-770b-428a-be94-c4d9b68ade10 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:39.227258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:39.238853 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee984763-277b-4eb7-b2cc-7ab24e0ff2ee None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:39.265170 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:39.278995 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140e80f-bf2f-4149-a7c9-7f8189d9fb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:39.279766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140e80f-bf2f-4149-a7c9-7f8189d9fb5c None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:39.280044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140e80f-bf2f-4149-a7c9-7f8189d9fb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:39.280313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140e80f-bf2f-4149-a7c9-7f8189d9fb5c None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:39.281169 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140e80f-bf2f-4149-a7c9-7f8189d9fb5c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:39.283121 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140e80f-bf2f-4149-a7c9-7f8189d9fb5c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:39.288623 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c66a28-770b-428a-be94-c4d9b68ade10 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:39.305909 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 440/896] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 9 02:18:39 2022] POST /identity/v3/services => generated 241 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:18:39.334451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3d0ce-9ca1-4db9-a817-6deb80bb6c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:39.335326 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3d0ce-9ca1-4db9-a817-6deb80bb6c8b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:39.335830 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3d0ce-9ca1-4db9-a817-6deb80bb6c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:39.336248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3d0ce-9ca1-4db9-a817-6deb80bb6c8b None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:39.337112 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3d0ce-9ca1-4db9-a817-6deb80bb6c8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:39.337568 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3d0ce-9ca1-4db9-a817-6deb80bb6c8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:39.339132 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3d0ce-9ca1-4db9-a817-6deb80bb6c8b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:39.357340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 457/897] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:39.359345 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140e80f-bf2f-4149-a7c9-7f8189d9fb5c None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:39.478179 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140e80f-bf2f-4149-a7c9-7f8189d9fb5c None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:39.516442 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c83cc-7706-4878-b699-2d64f1cd4b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:39.517077 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c83cc-7706-4878-b699-2d64f1cd4b79 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:39.517370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c83cc-7706-4878-b699-2d64f1cd4b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:39.517631 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c83cc-7706-4878-b699-2d64f1cd4b79 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:39.525738 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c83cc-7706-4878-b699-2d64f1cd4b79 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:39.527247 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c83cc-7706-4878-b699-2d64f1cd4b79 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:39.539799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-092c83cc-7706-4878-b699-2d64f1cd4b79 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 02:18:39.539799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:39.539799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:39.539799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:39.539799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:39.539799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:39.539799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:39.539799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:39.539799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:39.539799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:39.539799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:39.539799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:39.539799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:18:39.539799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:18:39.539799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:18:39.539799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:18:39.540763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:39.540763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:39.540763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:18:39.540763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:39.540763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:18:39.540763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:39.540763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:39.540763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:39.540763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:39.540763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:39.540763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:39.540763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:39.540763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:39.540763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:39.540763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:39.540763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:39.540763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:39.540763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:39.541818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:39.541818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:39.541818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:18:39.541818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:18:39.541818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:18:39.541818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:18:39.541818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:18:39.541818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:18:39.541818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 02:18:39.541818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:39.541818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 441/898] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 9 02:18:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:39.548811 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3d0ce-9ca1-4db9-a817-6deb80bb6c8b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:39.656973 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3d0ce-9ca1-4db9-a817-6deb80bb6c8b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:39.669449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:39.691445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02315d31-6c54-4350-b8f2-35e3940cb1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:39.692053 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02315d31-6c54-4350-b8f2-35e3940cb1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:39.692332 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02315d31-6c54-4350-b8f2-35e3940cb1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:39.692607 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02315d31-6c54-4350-b8f2-35e3940cb1d0 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:39.693362 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02315d31-6c54-4350-b8f2-35e3940cb1d0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:39.693668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02315d31-6c54-4350-b8f2-35e3940cb1d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:39.695096 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02315d31-6c54-4350-b8f2-35e3940cb1d0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:39.713236 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 458/899] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Aug 9 02:18:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:39.718503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c83cc-7706-4878-b699-2d64f1cd4b79 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:39.766602 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:39.824555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c83cc-7706-4878-b699-2d64f1cd4b79 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:39.854759 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f41a6e-c4c4-4b5e-a9e3-35fdf1769b2b None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:39.854951 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f41a6e-c4c4-4b5e-a9e3-35fdf1769b2b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:39.855227 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f41a6e-c4c4-4b5e-a9e3-35fdf1769b2b None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:39.856895 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 459/900] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:18:39.861229 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04a97a-599a-4aae-a17a-d486a5c3eb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:39.861614 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e8707-c324-4c00-9cc8-e5cd743e8517 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:39.861901 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e8707-c324-4c00-9cc8-e5cd743e8517 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:39.862176 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e8707-c324-4c00-9cc8-e5cd743e8517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:39.862714 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04a97a-599a-4aae-a17a-d486a5c3eb7c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:39.863196 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04a97a-599a-4aae-a17a-d486a5c3eb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:39.863671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04a97a-599a-4aae-a17a-d486a5c3eb7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:39.880486 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-053e8707-c324-4c00-9cc8-e5cd743e8517 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:39.881715 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-053e8707-c324-4c00-9cc8-e5cd743e8517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:39.936319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04a97a-599a-4aae-a17a-d486a5c3eb7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:39.938306 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04a97a-599a-4aae-a17a-d486a5c3eb7c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:39.961381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 460/901] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 02:18:39.977796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a867f91-f1e4-4362-9186-82dd4fd7a1f2 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:39.978084 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a867f91-f1e4-4362-9186-82dd4fd7a1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:39.978343 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a867f91-f1e4-4362-9186-82dd4fd7a1f2 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:39.979675 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 461/902] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:39.984629 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a867f91-f1e4-4362-9186-82dd4fd7a1f2 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:39.985680 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:40.047800 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 442/903] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:18:39 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 02:18:40.049462 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660ba67-46c5-4b7f-a300-a713f221efce None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:40.049935 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660ba67-46c5-4b7f-a300-a713f221efce None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:40.050501 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660ba67-46c5-4b7f-a300-a713f221efce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:40.068882 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c660ba67-46c5-4b7f-a300-a713f221efce None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:40.070124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c660ba67-46c5-4b7f-a300-a713f221efce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:40.092771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:40.098573 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a867f91-f1e4-4362-9186-82dd4fd7a1f2 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:40.135729 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c810d-c010-4e3e-9e09-1bdce3247072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:40.136353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c810d-c010-4e3e-9e09-1bdce3247072 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:40.136630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c810d-c010-4e3e-9e09-1bdce3247072 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:40.136898 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c810d-c010-4e3e-9e09-1bdce3247072 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:40.137510 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c810d-c010-4e3e-9e09-1bdce3247072 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:40.138866 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c810d-c010-4e3e-9e09-1bdce3247072 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:40.139440 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 443/904] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:40.140365 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660ba67-46c5-4b7f-a300-a713f221efce None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:40.154085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-890c810d-c010-4e3e-9e09-1bdce3247072 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 02:18:40.154085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:40.154085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 02:18:40.154085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 02:18:40.154085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 02:18:40.154085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 02:18:40.154085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 02:18:40.154085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:40.154085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 02:18:40.154085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:40.154085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:18:40.154085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:40.154085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:40.154085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:40.154085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:40.154085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:40.155025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:40.155025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:40.155025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:40.155025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:40.155025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:40.155025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:40.155025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:40.155025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 02:18:40.155025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 02:18:40.155025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 02:18:40.155025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 02:18:40.155025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:40.155025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:40.155025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:40.155025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:40.155025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:40.155025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:40.155877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:40.155877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:40.155877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:40.155877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:40.155877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:40.155877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:40.155877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:40.155877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:40.155877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:40.155877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:40.155877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 02:18:40.155877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:40.155877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 02:18:40.155877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:40.158405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 462/905] 10.222.0.16 () {56 vars in 1132 bytes} [Tue Aug 9 02:18:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:18:40.165702 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c810d-c010-4e3e-9e09-1bdce3247072 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:40.227980 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:40.257368 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660ba67-46c5-4b7f-a300-a713f221efce None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:40.271585 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c810d-c010-4e3e-9e09-1bdce3247072 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:40.295618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d63b20-dc36-44b8-9cfa-e1e36a94c52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:40.296613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d63b20-dc36-44b8-9cfa-e1e36a94c52a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:40.297158 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d63b20-dc36-44b8-9cfa-e1e36a94c52a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:40.297664 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d63b20-dc36-44b8-9cfa-e1e36a94c52a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:40.303737 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31409e-86bb-46ca-9805-f452564235ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:40.304357 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31409e-86bb-46ca-9805-f452564235ad None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:40.304633 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31409e-86bb-46ca-9805-f452564235ad None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:40.304901 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31409e-86bb-46ca-9805-f452564235ad None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:40.305918 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31409e-86bb-46ca-9805-f452564235ad None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:40.307665 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31409e-86bb-46ca-9805-f452564235ad None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:40.309468 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d63b20-dc36-44b8-9cfa-e1e36a94c52a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:40.311274 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d63b20-dc36-44b8-9cfa-e1e36a94c52a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:40.316642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-dc31409e-86bb-46ca-9805-f452564235ad None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 02:18:40.316642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:40.316642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 02:18:40.316642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 02:18:40.316642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 02:18:40.316642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 02:18:40.316642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 02:18:40.316642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:40.316642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 02:18:40.316642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:40.316642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:18:40.316642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:40.316642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:40.316642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:40.316642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:40.316642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:40.316642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:40.317654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:40.317654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:40.317654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:40.317654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:40.317654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:40.317654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:40.317654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 02:18:40.317654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 02:18:40.317654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 02:18:40.317654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 02:18:40.317654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:40.317654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:40.317654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:40.317654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:40.317654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:40.317654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:40.319845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:40.319845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:40.319845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:40.319845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:40.319845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:40.319845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:40.319845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:40.319845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:40.319845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:40.319845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:40.319845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 02:18:40.319845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:40.319845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 02:18:40.319845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:40.319845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 463/906] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 9 02:18:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:18:40.320639 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31409e-86bb-46ca-9805-f452564235ad None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:40.334125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-a2d63b20-dc36-44b8-9cfa-e1e36a94c52a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:40.334125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:40.334125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:40.334125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:40.334125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:40.334125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:40.334125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:40.334125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:40.334125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:40.334125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:40.334125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:40.334125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:40.334125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:40.334125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:40.334125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:40.334125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:40.335277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:40.335277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:40.335277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:40.335277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:40.335277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:40.335277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:40.335277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:40.335277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:40.335277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:40.335277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:40.335277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:40.335277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:40.335277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:40.335277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:40.335277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:40.335277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:40.335277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:40.336235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:40.336235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:40.336235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:40.336235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 444/907] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:40.337089 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d63b20-dc36-44b8-9cfa-e1e36a94c52a None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:40.354882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:40.431317 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31409e-86bb-46ca-9805-f452564235ad None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:40.440916 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d63b20-dc36-44b8-9cfa-e1e36a94c52a None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:40.467928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0cfbb-fd67-486c-9ea6-160dedb29bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:40.468539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0cfbb-fd67-486c-9ea6-160dedb29bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:40.468841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0cfbb-fd67-486c-9ea6-160dedb29bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:40.468976 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:40.469128 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0cfbb-fd67-486c-9ea6-160dedb29bf3 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:40.469763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0cfbb-fd67-486c-9ea6-160dedb29bf3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:40.470067 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0cfbb-fd67-486c-9ea6-160dedb29bf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:40.473057 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0cfbb-fd67-486c-9ea6-160dedb29bf3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:40.476180 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 464/908] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 9 02:18:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:40.477213 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0cfbb-fd67-486c-9ea6-160dedb29bf3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:40.483247 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45acf8b-50b2-42b3-8e49-b41515cf73a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:40.483860 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45acf8b-50b2-42b3-8e49-b41515cf73a7 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:40.484137 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45acf8b-50b2-42b3-8e49-b41515cf73a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:40.484425 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45acf8b-50b2-42b3-8e49-b41515cf73a7 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:40.485091 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45acf8b-50b2-42b3-8e49-b41515cf73a7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:40.485396 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45acf8b-50b2-42b3-8e49-b41515cf73a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:40.486751 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45acf8b-50b2-42b3-8e49-b41515cf73a7 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:40.492024 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 445/909] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 9 02:18:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:40.492800 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45acf8b-50b2-42b3-8e49-b41515cf73a7 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:40.587276 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:40.597983 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0cfbb-fd67-486c-9ea6-160dedb29bf3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:40.611092 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45acf8b-50b2-42b3-8e49-b41515cf73a7 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:40.640495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81498645-ad51-4615-bb02-86647f69919c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:40.641480 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81498645-ad51-4615-bb02-86647f69919c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:40.641826 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81498645-ad51-4615-bb02-86647f69919c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:40.642167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81498645-ad51-4615-bb02-86647f69919c None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:40.642877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81498645-ad51-4615-bb02-86647f69919c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:40.643268 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81498645-ad51-4615-bb02-86647f69919c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:40.644673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81498645-ad51-4615-bb02-86647f69919c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:40.644779 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b433ba-4531-4714-b0d4-01bc9e0a4f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:40.645340 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b433ba-4531-4714-b0d4-01bc9e0a4f12 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:40.645618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b433ba-4531-4714-b0d4-01bc9e0a4f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:40.645888 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b433ba-4531-4714-b0d4-01bc9e0a4f12 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:40.646509 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b433ba-4531-4714-b0d4-01bc9e0a4f12 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:40.646812 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b433ba-4531-4714-b0d4-01bc9e0a4f12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:40.648149 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b433ba-4531-4714-b0d4-01bc9e0a4f12 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:40.653220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 446/910] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 9 02:18:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:40.653698 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b433ba-4531-4714-b0d4-01bc9e0a4f12 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:40.662579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 465/911] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:40.663645 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81498645-ad51-4615-bb02-86647f69919c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:40.712083 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:40.758502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b433ba-4531-4714-b0d4-01bc9e0a4f12 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:40.774261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81498645-ad51-4615-bb02-86647f69919c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:40.792879 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747786e-62b2-469a-82d9-7085b6775fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:40.793511 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747786e-62b2-469a-82d9-7085b6775fda None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:40.793790 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747786e-62b2-469a-82d9-7085b6775fda None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:40.794059 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747786e-62b2-469a-82d9-7085b6775fda None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:40.794681 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5747786e-62b2-469a-82d9-7085b6775fda None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:40.794981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5747786e-62b2-469a-82d9-7085b6775fda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:40.796338 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5747786e-62b2-469a-82d9-7085b6775fda None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:40.802754 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 447/912] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 9 02:18:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:40.803816 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747786e-62b2-469a-82d9-7085b6775fda None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:40.810416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba599044-9954-4626-9e1b-eb3290a78dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:40.811020 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba599044-9954-4626-9e1b-eb3290a78dfa None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:40.811304 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba599044-9954-4626-9e1b-eb3290a78dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:40.811576 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba599044-9954-4626-9e1b-eb3290a78dfa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:40.812271 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba599044-9954-4626-9e1b-eb3290a78dfa None admin] RBAC: Adding query filter params (interface=public, service_id=b95c4ab7684d4180841f3f7307f15683, region_id=RegionOne) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:40.812633 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba599044-9954-4626-9e1b-eb3290a78dfa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:40.814513 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba599044-9954-4626-9e1b-eb3290a78dfa None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:40.820121 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 466/913] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 9 02:18:40 2022] GET /identity/v3/endpoints?service_id=b95c4ab7684d4180841f3f7307f15683&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:40.820884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba599044-9954-4626-9e1b-eb3290a78dfa None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:40.840923 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:40.913080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747786e-62b2-469a-82d9-7085b6775fda None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:40.931226 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:40.931393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba599044-9954-4626-9e1b-eb3290a78dfa None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:40.949817 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f52a86-565b-4eb0-9dba-0144e901789e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:40.950470 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f52a86-565b-4eb0-9dba-0144e901789e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:40.950911 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f52a86-565b-4eb0-9dba-0144e901789e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:40.951019 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f52a86-565b-4eb0-9dba-0144e901789e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:40.957825 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f52a86-565b-4eb0-9dba-0144e901789e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:40.959260 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f52a86-565b-4eb0-9dba-0144e901789e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:40.968163 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08551872-3594-46e4-8055-c3a7803d6239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:40.969351 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08551872-3594-46e4-8055-c3a7803d6239 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:40.969648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08551872-3594-46e4-8055-c3a7803d6239 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:40.969926 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08551872-3594-46e4-8055-c3a7803d6239 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:40.973275 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08551872-3594-46e4-8055-c3a7803d6239 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:40.973430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-45f52a86-565b-4eb0-9dba-0144e901789e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:40.973430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:40.973430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:40.973430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:40.973430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:40.973430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:40.973430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:40.973430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:40.973430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:40.973430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:40.973430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:40.973430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:40.973430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:40.973430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:40.973430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:40.974402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:40.974402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:40.974402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:40.974402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:40.974402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:40.974402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:40.974402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:40.974402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:40.974402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:40.974402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:40.974402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:40.974402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:40.974402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:40.974402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:40.974402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:40.974402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:40.974402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:40.975489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:40.975489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:40.975489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:40.975489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:40.975489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:40.975489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:40.975489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:40.975489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:40.976003 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08551872-3594-46e4-8055-c3a7803d6239 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:40.976083 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 448/914] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:40.976083 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f52a86-565b-4eb0-9dba-0144e901789e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:41.002796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 467/915] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:18:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:18:41.004106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08551872-3594-46e4-8055-c3a7803d6239 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:41.096905 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f52a86-565b-4eb0-9dba-0144e901789e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:41.138314 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:41.143046 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2582d0-ad53-4031-85a7-640c7aa38b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:41.143842 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2582d0-ad53-4031-85a7-640c7aa38b77 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:41.144210 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2582d0-ad53-4031-85a7-640c7aa38b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:41.144614 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2582d0-ad53-4031-85a7-640c7aa38b77 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:41.145362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2582d0-ad53-4031-85a7-640c7aa38b77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:41.146920 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2582d0-ad53-4031-85a7-640c7aa38b77 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:41.155100 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 449/916] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 9 02:18:40 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:18:41.187104 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08551872-3594-46e4-8055-c3a7803d6239 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:41.226949 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd01cbd-7d1b-4c80-858f-7f2cc320e24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:41.227883 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd01cbd-7d1b-4c80-858f-7f2cc320e24e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:41.228349 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd01cbd-7d1b-4c80-858f-7f2cc320e24e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:41.228803 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd01cbd-7d1b-4c80-858f-7f2cc320e24e None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:41.229733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd01cbd-7d1b-4c80-858f-7f2cc320e24e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:41.230300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd01cbd-7d1b-4c80-858f-7f2cc320e24e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:41.231983 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd01cbd-7d1b-4c80-858f-7f2cc320e24e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:41.247895 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 468/917] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:41.253769 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2582d0-ad53-4031-85a7-640c7aa38b77 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:41.301770 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:41.365768 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2582d0-ad53-4031-85a7-640c7aa38b77 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:41.403411 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1604a0-5259-4e77-86c3-95529641c0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:41.404021 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1604a0-5259-4e77-86c3-95529641c0bf None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:41.404297 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1604a0-5259-4e77-86c3-95529641c0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:41.404714 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1604a0-5259-4e77-86c3-95529641c0bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:41.405478 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1604a0-5259-4e77-86c3-95529641c0bf None admin] RBAC: Adding query filter params (role.id=78bcb32d82b5450992ffa64fd7350353, scope.project.id=105476dcda7f48c28224d33c05860d6f, user.id=07041df2276d4dd58fb0e49417a26e2c) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:41.405784 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1604a0-5259-4e77-86c3-95529641c0bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:41.407810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1604a0-5259-4e77-86c3-95529641c0bf None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:41.414248 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 450/918] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:18:41 2022] GET /identity/v3/role_assignments?user.id=07041df2276d4dd58fb0e49417a26e2c&scope.project.id=105476dcda7f48c28224d33c05860d6f&role.id=78bcb32d82b5450992ffa64fd7350353 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:18:41.435421 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8419d57-91f4-4cae-90f4-bcd21b555dce None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:41.436086 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8419d57-91f4-4cae-90f4-bcd21b555dce None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:41.436588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8419d57-91f4-4cae-90f4-bcd21b555dce None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:41.438713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 469/919] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:41.444128 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d075a-d410-4acd-8b37-28ea09e4ca9d None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:41.444440 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d075a-d410-4acd-8b37-28ea09e4ca9d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:41.444696 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d075a-d410-4acd-8b37-28ea09e4ca9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:41.465282 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-4a4d075a-d410-4acd-8b37-28ea09e4ca9d None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:41.466901 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4a4d075a-d410-4acd-8b37-28ea09e4ca9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:41.559655 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 451/920] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:41.577265 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8419d57-91f4-4cae-90f4-bcd21b555dce None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:41.689366 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8419d57-91f4-4cae-90f4-bcd21b555dce None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:41.720448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:41.725717 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d1ada-6429-405a-b859-e157dd698ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:41.726284 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d1ada-6429-405a-b859-e157dd698ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:41.726875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d1ada-6429-405a-b859-e157dd698ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:41.727202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d1ada-6429-405a-b859-e157dd698ac9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:41.727807 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d1ada-6429-405a-b859-e157dd698ac9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:41.729287 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d1ada-6429-405a-b859-e157dd698ac9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:41.739093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-455d1ada-6429-405a-b859-e157dd698ac9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 02:18:41.739093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:41.739093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 02:18:41.739093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 02:18:41.739093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 02:18:41.739093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 02:18:41.739093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 02:18:41.739093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:41.739093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 02:18:41.739093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:41.739093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:18:41.739093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:41.739093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:41.739093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:41.739093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:41.739093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:41.739093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:41.740388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:41.740388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:41.740388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:41.740388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:41.740388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:41.740388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:41.740388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 02:18:41.740388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 02:18:41.740388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 02:18:41.740388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 02:18:41.740388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:41.740388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:41.740388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:41.740388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:41.740388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:41.740388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:41.741254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:41.741254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:41.741254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:41.741254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:41.741254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:41.741254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:41.741254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:41.741254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:41.741254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:41.741254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:41.741254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 02:18:41.741254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:41.741254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 02:18:41.741254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:41.741254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 470/921] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 9 02:18:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:41.748671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d075a-d410-4acd-8b37-28ea09e4ca9d None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:41.783252 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:41.864546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d075a-d410-4acd-8b37-28ea09e4ca9d None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:41.901258 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889f106-1c04-46f9-bd45-842cd56959a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:41.901870 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889f106-1c04-46f9-bd45-842cd56959a5 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:41.902213 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889f106-1c04-46f9-bd45-842cd56959a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:41.902484 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889f106-1c04-46f9-bd45-842cd56959a5 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:41.903115 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889f106-1c04-46f9-bd45-842cd56959a5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:41.903422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889f106-1c04-46f9-bd45-842cd56959a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:41.904810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889f106-1c04-46f9-bd45-842cd56959a5 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:41.910031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 452/922] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 9 02:18:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:41.918107 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d1ada-6429-405a-b859-e157dd698ac9 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:42.024801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d1ada-6429-405a-b859-e157dd698ac9 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:42.058469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0f7bf-a91e-45b3-8824-8f5d60daa432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:42.059343 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0f7bf-a91e-45b3-8824-8f5d60daa432 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:42.059833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0f7bf-a91e-45b3-8824-8f5d60daa432 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:42.060312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0f7bf-a91e-45b3-8824-8f5d60daa432 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:42.061219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0f7bf-a91e-45b3-8824-8f5d60daa432 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:42.061732 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0f7bf-a91e-45b3-8824-8f5d60daa432 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:42.063938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0f7bf-a91e-45b3-8824-8f5d60daa432 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:42.069249 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 471/923] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 9 02:18:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:42.075450 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889f106-1c04-46f9-bd45-842cd56959a5 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:42.173888 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:42.179709 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889f106-1c04-46f9-bd45-842cd56959a5 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:42.216128 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c510ff-d7c9-439d-b7e0-cd43f9a96207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:42.216760 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c510ff-d7c9-439d-b7e0-cd43f9a96207 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:42.217073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c510ff-d7c9-439d-b7e0-cd43f9a96207 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:42.217332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c510ff-d7c9-439d-b7e0-cd43f9a96207 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:42.218060 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c510ff-d7c9-439d-b7e0-cd43f9a96207 None admin] RBAC: Adding query filter params (interface=public, service_id=ffa3db4a37414fd5a526efd878aff3b8, region_id=RegionOne) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:42.218371 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c510ff-d7c9-439d-b7e0-cd43f9a96207 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:42.219829 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c510ff-d7c9-439d-b7e0-cd43f9a96207 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:42.226096 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 453/924] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 9 02:18:42 2022] GET /identity/v3/endpoints?service_id=ffa3db4a37414fd5a526efd878aff3b8&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:42.231547 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0f7bf-a91e-45b3-8824-8f5d60daa432 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:42.299086 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:42.344541 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0f7bf-a91e-45b3-8824-8f5d60daa432 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:42.379693 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b3526-9d7b-4773-8061-67a0efaa6789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:42.380294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b3526-9d7b-4773-8061-67a0efaa6789 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:42.380567 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b3526-9d7b-4773-8061-67a0efaa6789 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:42.380832 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b3526-9d7b-4773-8061-67a0efaa6789 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:42.381459 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b3526-9d7b-4773-8061-67a0efaa6789 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:42.382821 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b3526-9d7b-4773-8061-67a0efaa6789 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:42.389191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 472/925] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 9 02:18:42 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:18:43.123629 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d3a62-5fc1-4304-9916-33bc570bf393 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:43.124173 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d3a62-5fc1-4304-9916-33bc570bf393 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:43.124173 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d3a62-5fc1-4304-9916-33bc570bf393 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:43.125872 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 454/926] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:43.131154 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050cd19-2e62-487c-87ed-076c3874c081 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:43.131578 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050cd19-2e62-487c-87ed-076c3874c081 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:43.131743 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050cd19-2e62-487c-87ed-076c3874c081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:43.151564 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-1050cd19-2e62-487c-87ed-076c3874c081 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:43.152739 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1050cd19-2e62-487c-87ed-076c3874c081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:43.222981 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 473/927] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:43.245679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d3a62-5fc1-4304-9916-33bc570bf393 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:43.324237 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908d146-947a-472f-a1f0-548704df82ad None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:43.324564 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908d146-947a-472f-a1f0-548704df82ad None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:43.324809 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908d146-947a-472f-a1f0-548704df82ad None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:43.329050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 474/928] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:43.332565 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd817b-db75-400f-9bf9-d0b22c5b25f4 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:43.332846 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd817b-db75-400f-9bf9-d0b22c5b25f4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:43.333152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd817b-db75-400f-9bf9-d0b22c5b25f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:43.351029 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b2dd817b-db75-400f-9bf9-d0b22c5b25f4 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:43.352229 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b2dd817b-db75-400f-9bf9-d0b22c5b25f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:43.356690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d3a62-5fc1-4304-9916-33bc570bf393 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:43.399024 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a82c5-62cc-4c93-bb16-616a8535f76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:43.399638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a82c5-62cc-4c93-bb16-616a8535f76a None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:43.399919 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a82c5-62cc-4c93-bb16-616a8535f76a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:43.400189 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a82c5-62cc-4c93-bb16-616a8535f76a None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:43.400888 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a82c5-62cc-4c93-bb16-616a8535f76a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:43.402370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a82c5-62cc-4c93-bb16-616a8535f76a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:43.404997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: WARNING keystone.server.flask.common [None req-d04a82c5-62cc-4c93-bb16-616a8535f76a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 09 02:18:43.421519 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:43.425610 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.sql.core [None req-d04a82c5-62cc-4c93-bb16-616a8535f76a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 09 02:18:43.425610 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 09 02:18:43.425610 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [parameters: {'id': '48a097d283f442098e64baceb528ef76', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 09 02:18:43.425610 dv-cinder-852461-1-smb devstack@keystone.service[80286]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80286) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 09 02:18:43.437954 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 475/929] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:43.445556 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-d04a82c5-62cc-4c93-bb16-616a8535f76a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 48a097d283f442098e64baceb528ef76.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 48a097d283f442098e64baceb528ef76. Aug 09 02:18:43.445556 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:43.445556 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 02:18:43.445556 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 02:18:43.445556 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 02:18:43.445556 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 02:18:43.445556 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 02:18:43.445556 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 02:18:43.445556 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 02:18:43.445556 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application conn.query(q) Aug 09 02:18:43.445556 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 02:18:43.445556 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 02:18:43.445556 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 02:18:43.446369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application result.read() Aug 09 02:18:43.446369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 02:18:43.446369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 02:18:43.446369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 02:18:43.446369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 02:18:43.446369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 02:18:43.446369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 02:18:43.446369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 02:18:43.446369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 02:18:43.446369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 09 02:18:43.446369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:43.446369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 09 02:18:43.446369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:43.446369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:43.446369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 09 02:18:43.446369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 09 02:18:43.446369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 09 02:18:43.446369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 09 02:18:43.447313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 02:18:43.447313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application next(self.gen) Aug 09 02:18:43.447313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 09 02:18:43.447313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application yield resource Aug 09 02:18:43.447313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 02:18:43.447313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application next(self.gen) Aug 09 02:18:43.447313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 09 02:18:43.447313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self.session.rollback() Aug 09 02:18:43.447313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 02:18:43.447313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self.force_reraise() Aug 09 02:18:43.447313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 02:18:43.447313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise self.value Aug 09 02:18:43.447313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 09 02:18:43.447313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 09 02:18:43.447313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 09 02:18:43.447313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application session.commit() Aug 09 02:18:43.447313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 09 02:18:43.448223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 09 02:18:43.448223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 09 02:18:43.448223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._prepare_impl() Aug 09 02:18:43.448223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 09 02:18:43.448223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self.session.flush() Aug 09 02:18:43.448223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 02:18:43.448223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._flush(objects) Aug 09 02:18:43.448223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 02:18:43.448223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 09 02:18:43.448223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 02:18:43.448223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application compat.raise_( Aug 09 02:18:43.448223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 02:18:43.448223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception Aug 09 02:18:43.448223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 02:18:43.448223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application flush_context.execute() Aug 09 02:18:43.448223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 02:18:43.448223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rec.execute(self) Aug 09 02:18:43.449839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 02:18:43.449839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 09 02:18:43.449839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 02:18:43.449839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 09 02:18:43.449839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 09 02:18:43.449839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 09 02:18:43.449839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 02:18:43.449839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 02:18:43.449839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 02:18:43.449839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 09 02:18:43.449839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 02:18:43.449839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 09 02:18:43.449839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 02:18:43.449839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 09 02:18:43.449839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 02:18:43.450659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 02:18:43.450659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 02:18:43.450659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception Aug 09 02:18:43.450659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 02:18:43.450659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 02:18:43.450659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 02:18:43.450659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 02:18:43.450659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 02:18:43.450659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 02:18:43.450659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 02:18:43.450659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application conn.query(q) Aug 09 02:18:43.450659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 02:18:43.450659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 02:18:43.450659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 02:18:43.450659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application result.read() Aug 09 02:18:43.450659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 02:18:43.450659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 02:18:43.452834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 02:18:43.452834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 02:18:43.452834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 02:18:43.452834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 02:18:43.452834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 02:18:43.452834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 02:18:43.452834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 09 02:18:43.452834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 09 02:18:43.452834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [parameters: {'id': '48a097d283f442098e64baceb528ef76', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 09 02:18:43.452834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 02:18:43.452834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:43.452834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:18:43.452834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:43.452834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:43.452834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 09 02:18:43.455521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 09 02:18:43.455521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 09 02:18:43.455521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 09 02:18:43.455521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 09 02:18:43.455521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:43.455521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:18:43.455521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:43.455521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:43.455521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:43.455521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:43.455521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:43.455521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:43.455521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:43.455521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:43.455521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:43.455521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:43.455521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:43.457974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:43.457974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 09 02:18:43.457974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 09 02:18:43.457974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:43.457974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:43.457974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 09 02:18:43.457974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 09 02:18:43.457974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 48a097d283f442098e64baceb528ef76. Aug 09 02:18:43.457974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:43.460118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd817b-db75-400f-9bf9-d0b22c5b25f4 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:43.466818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 455/930] 10.222.0.16 () {60 vars in 1140 bytes} [Tue Aug 9 02:18:43 2022] POST /identity/v3/projects => generated 262 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:43.468618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a82c5-62cc-4c93-bb16-616a8535f76a None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:43.509383 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:43.581938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd817b-db75-400f-9bf9-d0b22c5b25f4 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:43.603473 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a82c5-62cc-4c93-bb16-616a8535f76a None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:43.620913 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c616a-ffa4-4cfc-b8cb-d61109ff78a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:43.621698 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c616a-ffa4-4cfc-b8cb-d61109ff78a0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:43.621982 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c616a-ffa4-4cfc-b8cb-d61109ff78a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:43.622261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c616a-ffa4-4cfc-b8cb-d61109ff78a0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:43.623345 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c616a-ffa4-4cfc-b8cb-d61109ff78a0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:43.625733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c616a-ffa4-4cfc-b8cb-d61109ff78a0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:43.635555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-996c616a-ffa4-4cfc-b8cb-d61109ff78a0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 02:18:43.635555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:43.635555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 02:18:43.635555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 02:18:43.635555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 02:18:43.635555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 02:18:43.635555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 02:18:43.635555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:43.635555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 02:18:43.635555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:43.635555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:18:43.635555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:43.635555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:43.635555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:43.635555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:43.635555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:43.636502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:43.636502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:43.636502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:43.636502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:43.636502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:43.636502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:43.636502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:43.636502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 02:18:43.636502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 02:18:43.636502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 02:18:43.636502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 02:18:43.636502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:43.636502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:43.636502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:43.636502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:43.636502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:43.636502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:43.638188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:43.638188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:43.638188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:43.638188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:43.638188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:43.638188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:43.638188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:43.638188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:43.638188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:43.638188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:43.638188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 02:18:43.638188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:43.638188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 02:18:43.638188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:43.638188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 476/931] 10.222.0.16 () {56 vars in 1132 bytes} [Tue Aug 9 02:18:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:18:43.639080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfe2c2-e6eb-44a3-859a-c9d3169e24b4 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:43.639080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfe2c2-e6eb-44a3-859a-c9d3169e24b4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:43.639080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfe2c2-e6eb-44a3-859a-c9d3169e24b4 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:43.639260 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537efeb8-b267-4a49-85ef-61cbc8ef7c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:43.639850 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537efeb8-b267-4a49-85ef-61cbc8ef7c85 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:43.640133 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537efeb8-b267-4a49-85ef-61cbc8ef7c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:43.640430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537efeb8-b267-4a49-85ef-61cbc8ef7c85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:43.640678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 477/932] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:43.645239 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfe2c2-e6eb-44a3-859a-c9d3169e24b4 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:43.650652 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537efeb8-b267-4a49-85ef-61cbc8ef7c85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:43.652176 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537efeb8-b267-4a49-85ef-61cbc8ef7c85 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:43.664195 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-537efeb8-b267-4a49-85ef-61cbc8ef7c85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:43.664195 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:43.664195 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:43.664195 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:43.664195 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:43.664195 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:43.664195 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:43.664195 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:43.664195 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:43.664195 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:43.664195 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:43.664195 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:43.664195 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:43.664195 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:43.664195 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:43.665296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:43.665296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:43.665296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:43.665296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:43.665296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:43.665296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:43.665296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:43.665296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:43.665296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:43.665296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:43.665296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:43.665296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:43.665296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:43.665296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:43.665296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:43.665296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:43.665296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:43.666396 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:43.666396 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:43.666396 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:43.666396 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:43.666396 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:43.666396 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:43.666396 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:43.666396 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:43.670084 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 456/933] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:18:43.671275 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64f904-59de-48a7-aa8a-484cc2c15aff None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:43.671566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64f904-59de-48a7-aa8a-484cc2c15aff None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:43.672380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64f904-59de-48a7-aa8a-484cc2c15aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:43.691940 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-dc64f904-59de-48a7-aa8a-484cc2c15aff None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:43.693486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-dc64f904-59de-48a7-aa8a-484cc2c15aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:43.703660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:43.759302 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfe2c2-e6eb-44a3-859a-c9d3169e24b4 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:43.773369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 457/934] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:43.774833 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64f904-59de-48a7-aa8a-484cc2c15aff None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:43.785499 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:43.794750 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7391ac-91f9-42ed-861d-00b585bbc138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:43.795356 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7391ac-91f9-42ed-861d-00b585bbc138 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:43.795641 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7391ac-91f9-42ed-861d-00b585bbc138 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:43.795944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7391ac-91f9-42ed-861d-00b585bbc138 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:43.796529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7391ac-91f9-42ed-861d-00b585bbc138 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:43.797484 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7391ac-91f9-42ed-861d-00b585bbc138 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:43.798730 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7391ac-91f9-42ed-861d-00b585bbc138 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:43.805507 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 478/935] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 9 02:18:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:43.807138 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7391ac-91f9-42ed-861d-00b585bbc138 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:43.883709 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64f904-59de-48a7-aa8a-484cc2c15aff None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:43.918289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223b0dc-bad3-490e-b5c6-a7a173127e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:43.918897 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223b0dc-bad3-490e-b5c6-a7a173127e40 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:43.919177 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223b0dc-bad3-490e-b5c6-a7a173127e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:43.919450 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223b0dc-bad3-490e-b5c6-a7a173127e40 None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:43.919744 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7391ac-91f9-42ed-861d-00b585bbc138 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:43.920109 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223b0dc-bad3-490e-b5c6-a7a173127e40 None admin] RBAC: Adding query filter params (name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:43.920413 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223b0dc-bad3-490e-b5c6-a7a173127e40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:43.922391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223b0dc-bad3-490e-b5c6-a7a173127e40 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:43.933706 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:43.943189 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 458/936] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 9 02:18:43 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:43.943862 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223b0dc-bad3-490e-b5c6-a7a173127e40 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:43.969803 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd950b-8166-4017-b3a2-725061179783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:43.970448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd950b-8166-4017-b3a2-725061179783 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:43.970726 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd950b-8166-4017-b3a2-725061179783 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:43.970996 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd950b-8166-4017-b3a2-725061179783 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:43.986623 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd950b-8166-4017-b3a2-725061179783 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:18:43.992451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-2efd950b-8166-4017-b3a2-725061179783 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 02:18:43.992451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:43.992451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:43.992451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:43.992451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:43.992451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:43.992451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:43.992451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:43.992451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:43.992451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:43.992451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:43.992451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:43.992451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:18:43.992451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:18:43.992451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:18:43.992451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:18:43.993414 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:18:43.993414 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:18:43.993414 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:18:43.993414 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:18:43.993414 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:43.993414 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:43.993414 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:43.993414 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:43.993414 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:43.993414 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:43.993414 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:43.993414 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:43.993414 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:43.993414 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:43.993414 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:43.993414 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:43.994226 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:43.994226 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:43.994226 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:43.994226 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:43.994226 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:18:43.994226 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:18:43.994226 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:18:43.994226 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:18:43.994226 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:18:43.994226 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:18:43.994226 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 02:18:43.994226 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:43.998730 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 479/937] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Aug 9 02:18:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:43.999709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd950b-8166-4017-b3a2-725061179783 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:44.051896 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:44.102289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223b0dc-bad3-490e-b5c6-a7a173127e40 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:44.126231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd950b-8166-4017-b3a2-725061179783 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:44.145994 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f396c4-5b0b-42b7-afef-3c2e3289af68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:44.146631 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f396c4-5b0b-42b7-afef-3c2e3289af68 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:44.147049 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f396c4-5b0b-42b7-afef-3c2e3289af68 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:44.147156 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f396c4-5b0b-42b7-afef-3c2e3289af68 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:44.147790 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f396c4-5b0b-42b7-afef-3c2e3289af68 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:44.148096 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f396c4-5b0b-42b7-afef-3c2e3289af68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:44.150017 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f396c4-5b0b-42b7-afef-3c2e3289af68 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:44.156887 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 459/938] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 9 02:18:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:44.162451 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f396c4-5b0b-42b7-afef-3c2e3289af68 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:44.166482 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ec02f-45d3-4d43-9f42-d9d4e1d9611c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:44.167095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ec02f-45d3-4d43-9f42-d9d4e1d9611c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:44.167377 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ec02f-45d3-4d43-9f42-d9d4e1d9611c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:44.167650 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ec02f-45d3-4d43-9f42-d9d4e1d9611c None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:44.168320 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ec02f-45d3-4d43-9f42-d9d4e1d9611c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:44.168624 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ec02f-45d3-4d43-9f42-d9d4e1d9611c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:44.170043 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ec02f-45d3-4d43-9f42-d9d4e1d9611c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:44.179762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 480/939] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 9 02:18:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:44.185501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ec02f-45d3-4d43-9f42-d9d4e1d9611c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:44.228012 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:44.278794 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f396c4-5b0b-42b7-afef-3c2e3289af68 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:44.305186 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ec02f-45d3-4d43-9f42-d9d4e1d9611c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:44.311356 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:44.318299 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc222d-3e28-43be-b357-7980655013d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:44.319044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc222d-3e28-43be-b357-7980655013d4 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:44.319422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc222d-3e28-43be-b357-7980655013d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:44.319760 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc222d-3e28-43be-b357-7980655013d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:44.320537 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc222d-3e28-43be-b357-7980655013d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:44.322067 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc222d-3e28-43be-b357-7980655013d4 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:44.348368 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50038fe4-605e-42f3-abdb-10af68473ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:44.348968 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 460/940] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:18:44 2022] POST /identity/v3/endpoints => generated 347 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:18:44.349764 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50038fe4-605e-42f3-abdb-10af68473ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:44.350114 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50038fe4-605e-42f3-abdb-10af68473ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:44.350455 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50038fe4-605e-42f3-abdb-10af68473ac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:44.367727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50038fe4-605e-42f3-abdb-10af68473ac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:44.369518 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50038fe4-605e-42f3-abdb-10af68473ac8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:44.387515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-50038fe4-605e-42f3-abdb-10af68473ac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:44.387515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:44.387515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:44.387515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:44.387515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:44.387515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:44.387515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:44.387515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:44.387515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:44.387515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:44.387515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:44.387515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:44.387515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:44.387515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:44.387515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:44.387515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:44.388509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:44.388509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:44.388509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:44.388509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:44.388509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:44.388509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:44.388509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:44.388509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:44.388509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:44.388509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:44.388509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:44.388509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:44.388509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:44.388509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:44.388509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:44.388509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:44.388509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:44.389438 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:44.389438 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:44.389438 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:44.389438 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 481/941] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:18:44.396096 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc222d-3e28-43be-b357-7980655013d4 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:44.453865 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ce33f-4c6b-4dc7-afb2-713a22f188e0 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:44.454224 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ce33f-4c6b-4dc7-afb2-713a22f188e0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:44.454410 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ce33f-4c6b-4dc7-afb2-713a22f188e0 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:44.456100 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 482/942] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:18:44.461811 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83360c-78ee-4709-95c8-4718acd4fe5f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:44.462101 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83360c-78ee-4709-95c8-4718acd4fe5f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:44.462367 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83360c-78ee-4709-95c8-4718acd4fe5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:44.484218 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8b83360c-78ee-4709-95c8-4718acd4fe5f None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:44.485624 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8b83360c-78ee-4709-95c8-4718acd4fe5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:44.532571 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc222d-3e28-43be-b357-7980655013d4 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:44.569200 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 483/943] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 02:18:44.570227 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1126d-7f60-4a13-9d40-f2fdd15cafd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:44.570851 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1126d-7f60-4a13-9d40-f2fdd15cafd2 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:44.571134 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1126d-7f60-4a13-9d40-f2fdd15cafd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:44.571407 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1126d-7f60-4a13-9d40-f2fdd15cafd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:44.572054 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1126d-7f60-4a13-9d40-f2fdd15cafd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:44.572373 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1126d-7f60-4a13-9d40-f2fdd15cafd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:44.573772 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1126d-7f60-4a13-9d40-f2fdd15cafd2 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:44.586631 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 461/944] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:44.592006 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83360c-78ee-4709-95c8-4718acd4fe5f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:44.596807 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1126d-7f60-4a13-9d40-f2fdd15cafd2 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:44.612159 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:44.643295 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:44.707994 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83360c-78ee-4709-95c8-4718acd4fe5f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:44.724061 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1126d-7f60-4a13-9d40-f2fdd15cafd2 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:44.745628 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090de7f-c87d-4f76-910e-af493f935a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:44.746505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090de7f-c87d-4f76-910e-af493f935a27 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:44.746958 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090de7f-c87d-4f76-910e-af493f935a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:44.747384 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090de7f-c87d-4f76-910e-af493f935a27 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:44.756226 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090de7f-c87d-4f76-910e-af493f935a27 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:44.757899 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090de7f-c87d-4f76-910e-af493f935a27 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:44.768066 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861ff91-e0e3-4413-9daf-05495dc835c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:44.768706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861ff91-e0e3-4413-9daf-05495dc835c5 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:44.768990 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861ff91-e0e3-4413-9daf-05495dc835c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:44.769295 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861ff91-e0e3-4413-9daf-05495dc835c5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:44.769889 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861ff91-e0e3-4413-9daf-05495dc835c5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:44.771253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861ff91-e0e3-4413-9daf-05495dc835c5 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:44.774370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-1090de7f-c87d-4f76-910e-af493f935a27 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 02:18:44.774370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:44.774370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:44.774370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:44.774370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:44.774370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:44.774370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:44.774370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:44.774370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:44.774370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:44.774370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:44.774370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:44.774370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:18:44.774370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:18:44.774370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:18:44.774370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:18:44.775477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:44.775477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:44.775477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:18:44.775477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:44.775477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:18:44.775477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:44.775477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:44.775477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:44.775477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:44.775477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:44.775477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:44.775477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:44.775477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:44.775477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:44.775477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:44.775477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:44.775477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:44.775477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:44.776648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:44.776648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:44.776648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:18:44.776648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:18:44.776648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:18:44.776648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:18:44.776648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:18:44.776648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:18:44.776648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 02:18:44.776648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:44.783540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-1861ff91-e0e3-4413-9daf-05495dc835c5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 02:18:44.783540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:44.783540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 02:18:44.783540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 02:18:44.783540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 02:18:44.783540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 02:18:44.783540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 02:18:44.783540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:44.783540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 02:18:44.783540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:44.783540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:18:44.783540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:44.783540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:44.783540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:44.783540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:44.783540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:44.783540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:44.784746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:44.784746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:44.784746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:44.784746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:44.784746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:44.784746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:44.784746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 02:18:44.784746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 02:18:44.784746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 02:18:44.784746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 02:18:44.784746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:44.784746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:44.784746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:44.784746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:44.784746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:44.784746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:44.785810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:44.785810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:44.785810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:44.785810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:44.785810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:44.785810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:44.785810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:44.785810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:44.785810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:44.785810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:44.785810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 02:18:44.785810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:44.785810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 02:18:44.785810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:44.786748 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 484/946] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 9 02:18:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:44.787709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090de7f-c87d-4f76-910e-af493f935a27 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:44.790908 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 462/946] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 9 02:18:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:18:44.793348 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861ff91-e0e3-4413-9daf-05495dc835c5 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:44.886611 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:44.907922 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861ff91-e0e3-4413-9daf-05495dc835c5 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:44.915376 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:44.916839 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090de7f-c87d-4f76-910e-af493f935a27 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:44.943951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfa56e-1d28-4216-8095-6e7c5afa5d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:44.944734 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfa56e-1d28-4216-8095-6e7c5afa5d84 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:44.945112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfa56e-1d28-4216-8095-6e7c5afa5d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:44.945503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfa56e-1d28-4216-8095-6e7c5afa5d84 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:44.946231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfa56e-1d28-4216-8095-6e7c5afa5d84 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:44.946734 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfa56e-1d28-4216-8095-6e7c5afa5d84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:44.948284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfa56e-1d28-4216-8095-6e7c5afa5d84 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:44.958601 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 463/947] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 9 02:18:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:44.959473 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39dd4e-88ad-4a4b-9656-2ccc7c96b71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:44.960080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39dd4e-88ad-4a4b-9656-2ccc7c96b71d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:44.960357 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39dd4e-88ad-4a4b-9656-2ccc7c96b71d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:44.960626 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39dd4e-88ad-4a4b-9656-2ccc7c96b71d None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:44.961431 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39dd4e-88ad-4a4b-9656-2ccc7c96b71d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:44.961742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39dd4e-88ad-4a4b-9656-2ccc7c96b71d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:44.962383 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfa56e-1d28-4216-8095-6e7c5afa5d84 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:44.963171 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39dd4e-88ad-4a4b-9656-2ccc7c96b71d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:44.993112 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 485/948] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Aug 9 02:18:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:44.994400 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39dd4e-88ad-4a4b-9656-2ccc7c96b71d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:45.090028 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfa56e-1d28-4216-8095-6e7c5afa5d84 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:45.098236 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39dd4e-88ad-4a4b-9656-2ccc7c96b71d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:45.129133 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f8bb1-ed9a-4740-bb14-54fdf5eb2f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:45.130761 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f8bb1-ed9a-4740-bb14-54fdf5eb2f91 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:45.131347 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f8bb1-ed9a-4740-bb14-54fdf5eb2f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:45.131827 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f8bb1-ed9a-4740-bb14-54fdf5eb2f91 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:45.132666 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f8bb1-ed9a-4740-bb14-54fdf5eb2f91 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:45.133404 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f8bb1-ed9a-4740-bb14-54fdf5eb2f91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:45.134643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a757bd8-479a-439c-bede-be09d4bc3dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:45.135224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f8bb1-ed9a-4740-bb14-54fdf5eb2f91 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:45.135333 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a757bd8-479a-439c-bede-be09d4bc3dad None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:45.135539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a757bd8-479a-439c-bede-be09d4bc3dad None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:45.135812 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a757bd8-479a-439c-bede-be09d4bc3dad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:45.137983 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:45.143314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 464/949] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 9 02:18:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:45.149228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f8bb1-ed9a-4740-bb14-54fdf5eb2f91 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:45.153035 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a757bd8-479a-439c-bede-be09d4bc3dad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:45.157706 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a757bd8-479a-439c-bede-be09d4bc3dad None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:45.178285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-3a757bd8-479a-439c-bede-be09d4bc3dad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:45.178285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:45.178285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:45.178285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:45.178285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:45.178285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:45.178285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:45.178285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:45.178285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:45.178285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:45.178285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:45.178285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:45.178285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:45.178285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:45.178285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:45.178285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:45.179673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:45.179673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:45.179673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:45.179673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:45.179673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:45.179673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:45.179673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:45.179673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:45.179673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:45.179673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:45.179673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:45.179673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:45.179673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:45.179673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:45.179673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:45.179673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:45.179673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:45.180554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:45.180554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:45.180554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:45.188069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 486/950] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:18:45.190144 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a757bd8-479a-439c-bede-be09d4bc3dad None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:45.197438 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:45.274044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f8bb1-ed9a-4740-bb14-54fdf5eb2f91 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:45.301151 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a757bd8-479a-439c-bede-be09d4bc3dad None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:45.311114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58f9d5-53e6-4b4f-939c-2a2fb03538af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:45.311731 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58f9d5-53e6-4b4f-939c-2a2fb03538af None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:45.312014 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58f9d5-53e6-4b4f-939c-2a2fb03538af None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:45.312864 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58f9d5-53e6-4b4f-939c-2a2fb03538af None admin] PATH_INFO: `/v3/endpoints` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:45.313681 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58f9d5-53e6-4b4f-939c-2a2fb03538af None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:45.315168 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58f9d5-53e6-4b4f-939c-2a2fb03538af None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:45.339471 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 465/951] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:18:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:18:45.357063 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36a4e8-5b40-4eb8-bc9d-bf84b6f05de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:45.357063 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36a4e8-5b40-4eb8-bc9d-bf84b6f05de3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:45.357063 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36a4e8-5b40-4eb8-bc9d-bf84b6f05de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:45.357063 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36a4e8-5b40-4eb8-bc9d-bf84b6f05de3 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:45.357467 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36a4e8-5b40-4eb8-bc9d-bf84b6f05de3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:45.357467 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36a4e8-5b40-4eb8-bc9d-bf84b6f05de3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:45.357467 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36a4e8-5b40-4eb8-bc9d-bf84b6f05de3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:45.370470 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 487/952] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:45.376923 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58f9d5-53e6-4b4f-939c-2a2fb03538af None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:45.483016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:45.495540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58f9d5-53e6-4b4f-939c-2a2fb03538af None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:45.530145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3c589-6fd5-412b-aa84-cf59ca170116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:45.530785 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3c589-6fd5-412b-aa84-cf59ca170116 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:45.531657 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3c589-6fd5-412b-aa84-cf59ca170116 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:45.531931 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3c589-6fd5-412b-aa84-cf59ca170116 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:45.538951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3c589-6fd5-412b-aa84-cf59ca170116 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:45.540423 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3c589-6fd5-412b-aa84-cf59ca170116 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:45.553521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-37a3c589-6fd5-412b-aa84-cf59ca170116 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:45.553521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:45.553521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:45.553521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:45.553521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:45.553521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:45.553521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:45.553521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:45.553521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:45.553521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:45.553521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:45.553521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:45.553521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:45.553521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:45.553521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:45.554467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:45.554467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:45.554467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:45.554467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:45.554467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:45.554467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:45.554467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:45.554467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:45.554467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:45.554467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:45.554467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:45.554467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:45.554467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:45.554467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:45.554467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:45.554467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:45.554467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:45.555499 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:45.555499 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:45.555499 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:45.555499 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:45.555499 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:45.555499 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:45.555499 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:45.555499 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:45.555499 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 466/953] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:45.562203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36a4e8-5b40-4eb8-bc9d-bf84b6f05de3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:45.610651 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:45.668852 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36a4e8-5b40-4eb8-bc9d-bf84b6f05de3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:45.704093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e51802-6d26-49df-a103-9c5c8844b683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:45.704815 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e51802-6d26-49df-a103-9c5c8844b683 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:45.705333 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e51802-6d26-49df-a103-9c5c8844b683 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:45.705646 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e51802-6d26-49df-a103-9c5c8844b683 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:45.706414 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e51802-6d26-49df-a103-9c5c8844b683 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:45.706724 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e51802-6d26-49df-a103-9c5c8844b683 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:45.708176 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e51802-6d26-49df-a103-9c5c8844b683 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:45.720603 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 488/954] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:45.735011 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3c589-6fd5-412b-aa84-cf59ca170116 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:45.839788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3c589-6fd5-412b-aa84-cf59ca170116 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:45.875184 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77dc87-f6cc-492a-a3a5-7f73a3f20641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:45.875837 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77dc87-f6cc-492a-a3a5-7f73a3f20641 None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:45.876115 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77dc87-f6cc-492a-a3a5-7f73a3f20641 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:45.876442 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77dc87-f6cc-492a-a3a5-7f73a3f20641 None admin] PATH_INFO: `/v3/projects/105476dcda7f48c28224d33c05860d6f/users/07041df2276d4dd58fb0e49417a26e2c/roles/78bcb32d82b5450992ffa64fd7350353` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:45.878679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77dc87-f6cc-492a-a3a5-7f73a3f20641 None admin] RBAC: Authorizing `identity:create_grant(project_id=105476dcda7f48c28224d33c05860d6f, user_id=07041df2276d4dd58fb0e49417a26e2c, role_id=78bcb32d82b5450992ffa64fd7350353)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:45.880231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77dc87-f6cc-492a-a3a5-7f73a3f20641 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:45.898584 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 467/955] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 9 02:18:45 2022] PUT /identity/v3/projects/105476dcda7f48c28224d33c05860d6f/users/07041df2276d4dd58fb0e49417a26e2c/roles/78bcb32d82b5450992ffa64fd7350353 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:18:46.207813 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89ef2d-c688-4b67-95fb-1c2df5159418 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:46.208369 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89ef2d-c688-4b67-95fb-1c2df5159418 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:46.208369 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89ef2d-c688-4b67-95fb-1c2df5159418 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:46.210072 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 489/956] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:46.215494 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc791b90-238d-4255-a747-cdb49748ad28 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:46.215937 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc791b90-238d-4255-a747-cdb49748ad28 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:46.216033 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc791b90-238d-4255-a747-cdb49748ad28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:46.234829 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-fc791b90-238d-4255-a747-cdb49748ad28 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:46.236037 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-fc791b90-238d-4255-a747-cdb49748ad28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:46.239004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:46.307788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 468/957] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:46.332248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89ef2d-c688-4b67-95fb-1c2df5159418 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:46.437059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89ef2d-c688-4b67-95fb-1c2df5159418 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:46.438682 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:46.475496 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea944ef-66c5-48c6-8e27-7fad0278d20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:46.476026 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea944ef-66c5-48c6-8e27-7fad0278d20d None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:46.476307 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea944ef-66c5-48c6-8e27-7fad0278d20d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:46.476582 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea944ef-66c5-48c6-8e27-7fad0278d20d None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:46.477252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea944ef-66c5-48c6-8e27-7fad0278d20d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:46.478693 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea944ef-66c5-48c6-8e27-7fad0278d20d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:46.481268 dv-cinder-852461-1-smb devstack@keystone.service[80285]: WARNING keystone.server.flask.common [None req-8ea944ef-66c5-48c6-8e27-7fad0278d20d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 09 02:18:46.495518 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.sql.core [None req-8ea944ef-66c5-48c6-8e27-7fad0278d20d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 09 02:18:46.495518 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 09 02:18:46.495518 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [parameters: {'user_id': '180b856d85d849548661b1115d1428fc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 09 02:18:46.495518 dv-cinder-852461-1-smb devstack@keystone.service[80285]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80285) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 09 02:18:46.497726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90738b48-295d-4a77-8d28-c6036fcb24a5 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:46.498217 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90738b48-295d-4a77-8d28-c6036fcb24a5 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:46.498714 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90738b48-295d-4a77-8d28-c6036fcb24a5 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:46.500522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 469/958] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:46.504179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-8ea944ef-66c5-48c6-8e27-7fad0278d20d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 09 02:18:46.504179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:46.504179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 02:18:46.504179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 02:18:46.504179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 02:18:46.504179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 02:18:46.504179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 02:18:46.504179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 02:18:46.504179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 02:18:46.504179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application conn.query(q) Aug 09 02:18:46.504179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 02:18:46.504179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 02:18:46.504179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 02:18:46.504179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application result.read() Aug 09 02:18:46.504179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 02:18:46.505110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 02:18:46.505110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 02:18:46.505110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 02:18:46.505110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 02:18:46.505110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 02:18:46.505110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 02:18:46.505110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 02:18:46.505110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 09 02:18:46.505110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:46.505110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 09 02:18:46.505110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:46.505110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:46.505110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 09 02:18:46.505110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 09 02:18:46.505110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 09 02:18:46.505110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 09 02:18:46.505110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 02:18:46.505110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application next(self.gen) Aug 09 02:18:46.506131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 09 02:18:46.506131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application yield resource Aug 09 02:18:46.506131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 02:18:46.506131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application next(self.gen) Aug 09 02:18:46.506131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 09 02:18:46.506131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.session.rollback() Aug 09 02:18:46.506131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 02:18:46.506131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.force_reraise() Aug 09 02:18:46.506131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 02:18:46.506131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise self.value Aug 09 02:18:46.506131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 09 02:18:46.506131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 09 02:18:46.506131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 09 02:18:46.506131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application session.commit() Aug 09 02:18:46.506131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 09 02:18:46.506131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 09 02:18:46.506131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 09 02:18:46.507106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._prepare_impl() Aug 09 02:18:46.507106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 09 02:18:46.507106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.session.flush() Aug 09 02:18:46.507106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 02:18:46.507106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._flush(objects) Aug 09 02:18:46.507106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 02:18:46.507106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 09 02:18:46.507106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 02:18:46.507106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application compat.raise_( Aug 09 02:18:46.507106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 02:18:46.507106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception Aug 09 02:18:46.507106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 02:18:46.507106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application flush_context.execute() Aug 09 02:18:46.507106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 02:18:46.507106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rec.execute(self) Aug 09 02:18:46.507106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 02:18:46.507106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 09 02:18:46.508015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 02:18:46.508015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 09 02:18:46.508015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 09 02:18:46.508015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 09 02:18:46.508015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 02:18:46.508015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 02:18:46.508015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 02:18:46.508015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 09 02:18:46.508015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 02:18:46.508015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 09 02:18:46.508015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 02:18:46.508015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 09 02:18:46.508015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 02:18:46.508015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 02:18:46.508015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 02:18:46.508015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception Aug 09 02:18:46.510191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 02:18:46.510191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 02:18:46.510191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 02:18:46.510191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 02:18:46.510191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 02:18:46.510191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 02:18:46.510191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 02:18:46.510191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application conn.query(q) Aug 09 02:18:46.510191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 02:18:46.510191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 02:18:46.510191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 02:18:46.510191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application result.read() Aug 09 02:18:46.510191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 02:18:46.510191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 02:18:46.510191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 02:18:46.510191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 02:18:46.511202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 02:18:46.511202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 02:18:46.511202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 02:18:46.511202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 02:18:46.511202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 09 02:18:46.511202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 09 02:18:46.511202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [parameters: {'user_id': '180b856d85d849548661b1115d1428fc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 09 02:18:46.511202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 02:18:46.511202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:46.511202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:18:46.511202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:46.511202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:46.511202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:46.511202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:46.511202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:46.512294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:46.512294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:46.512294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:46.512294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:46.512294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:46.512294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:46.512294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:46.512294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 09 02:18:46.512294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 09 02:18:46.512294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:46.512294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:46.512294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:18:46.512294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:46.512294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:18:46.512294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:46.512294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 09 02:18:46.512294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 09 02:18:46.513543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 09 02:18:46.513543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 09 02:18:46.513543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 09 02:18:46.513543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 09 02:18:46.513543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 09 02:18:46.513543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:46.513543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 490/959] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Aug 9 02:18:46 2022] POST /identity/v3/users => generated 160 bytes in 172 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:46.518445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea944ef-66c5-48c6-8e27-7fad0278d20d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:46.518670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed283df-56df-45f1-91ea-1f80a908c045 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:46.518670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed283df-56df-45f1-91ea-1f80a908c045 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:46.518670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed283df-56df-45f1-91ea-1f80a908c045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:46.538900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-2ed283df-56df-45f1-91ea-1f80a908c045 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:46.541767 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2ed283df-56df-45f1-91ea-1f80a908c045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:46.634134 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 470/960] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:46.644396 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea944ef-66c5-48c6-8e27-7fad0278d20d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:46.652087 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed283df-56df-45f1-91ea-1f80a908c045 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:46.683525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5d246-ab9a-4e78-a5da-1df6df1d3efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:46.684530 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5d246-ab9a-4e78-a5da-1df6df1d3efe None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:46.685044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5d246-ab9a-4e78-a5da-1df6df1d3efe None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:46.685533 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5d246-ab9a-4e78-a5da-1df6df1d3efe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:46.695308 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d5d246-ab9a-4e78-a5da-1df6df1d3efe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:46.698290 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d5d246-ab9a-4e78-a5da-1df6df1d3efe None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:46.713727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-84d5d246-ab9a-4e78-a5da-1df6df1d3efe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 02:18:46.713727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:46.713727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:46.713727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:46.713727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:46.713727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:46.713727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:46.713727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:46.713727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:46.713727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:46.713727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:46.713727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:46.713727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:18:46.713727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:18:46.713727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:18:46.713727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:18:46.714718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:46.714718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:46.714718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:18:46.714718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:46.714718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:18:46.714718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:46.714718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:46.714718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:46.714718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:46.714718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:46.714718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:46.714718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:46.714718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:46.714718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:46.714718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:46.714718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:46.714718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:46.714718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:46.715698 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:46.715698 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:46.715698 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:18:46.715698 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:18:46.715698 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:18:46.715698 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:18:46.715698 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:18:46.715698 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:18:46.715698 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 02:18:46.715698 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:46.718184 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 491/961] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:18:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:46.724536 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5d246-ab9a-4e78-a5da-1df6df1d3efe None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:46.741834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:46.758913 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:46.775107 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed283df-56df-45f1-91ea-1f80a908c045 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:46.810643 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e837bd-957c-4f1e-84db-7c809442829f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:46.812108 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e837bd-957c-4f1e-84db-7c809442829f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:46.812108 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e837bd-957c-4f1e-84db-7c809442829f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:46.812108 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e837bd-957c-4f1e-84db-7c809442829f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:46.812800 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e837bd-957c-4f1e-84db-7c809442829f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:46.815064 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e837bd-957c-4f1e-84db-7c809442829f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:46.824145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-60e837bd-957c-4f1e-84db-7c809442829f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 02:18:46.824145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:46.824145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 02:18:46.824145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 02:18:46.824145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 02:18:46.824145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 02:18:46.824145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 02:18:46.824145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:46.824145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 02:18:46.824145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:46.824145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:18:46.824145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:46.824145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:46.824145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:46.824145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:46.824145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:46.824145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:46.825256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:46.825256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:46.825256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:46.825256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:46.825256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:46.825256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:46.825256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 02:18:46.825256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 02:18:46.825256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 02:18:46.825256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 02:18:46.825256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:46.825256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:46.825256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:46.825256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:46.825256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:46.825256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:46.826112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:46.826112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:46.826112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:46.826112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:46.826112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:46.826112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:46.826112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:46.826112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:46.826112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:46.826112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:46.826112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 02:18:46.826112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:46.826112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 02:18:46.826112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:46.829400 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 471/962] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:18:46.831917 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e837bd-957c-4f1e-84db-7c809442829f None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:46.850722 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5d246-ab9a-4e78-a5da-1df6df1d3efe None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:46.888041 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc48fa6-770f-42be-acbe-a51022444085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:46.889115 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc48fa6-770f-42be-acbe-a51022444085 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:46.889699 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc48fa6-770f-42be-acbe-a51022444085 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:46.890720 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc48fa6-770f-42be-acbe-a51022444085 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:46.891629 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc48fa6-770f-42be-acbe-a51022444085 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:46.892279 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc48fa6-770f-42be-acbe-a51022444085 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:46.894053 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc48fa6-770f-42be-acbe-a51022444085 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:46.935398 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e837bd-957c-4f1e-84db-7c809442829f None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:46.941606 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 492/963] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 9 02:18:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:18:46.981765 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34c88d-d02a-47a6-a17a-dce89fd76a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:46.982404 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34c88d-d02a-47a6-a17a-dce89fd76a35 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:46.982688 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34c88d-d02a-47a6-a17a-dce89fd76a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:46.982965 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34c88d-d02a-47a6-a17a-dce89fd76a35 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:46.983614 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34c88d-d02a-47a6-a17a-dce89fd76a35 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:46.983962 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34c88d-d02a-47a6-a17a-dce89fd76a35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:46.985391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34c88d-d02a-47a6-a17a-dce89fd76a35 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:46.986707 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:46.994987 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 472/964] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 9 02:18:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:18:46.998713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc48fa6-770f-42be-acbe-a51022444085 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:47.095434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:47.117536 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc48fa6-770f-42be-acbe-a51022444085 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:47.155593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb27881-351d-4fdb-aaa0-eeae91ad9d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:47.156261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb27881-351d-4fdb-aaa0-eeae91ad9d0d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:47.156546 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb27881-351d-4fdb-aaa0-eeae91ad9d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:47.156821 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb27881-351d-4fdb-aaa0-eeae91ad9d0d None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:47.157503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb27881-351d-4fdb-aaa0-eeae91ad9d0d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:47.157914 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb27881-351d-4fdb-aaa0-eeae91ad9d0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:47.159303 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb27881-351d-4fdb-aaa0-eeae91ad9d0d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:47.164558 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 493/965] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 9 02:18:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:47.537641 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d2af0-227d-495a-9f83-817cbd6981a9 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:47.538186 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d2af0-227d-495a-9f83-817cbd6981a9 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:47.538186 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d2af0-227d-495a-9f83-817cbd6981a9 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:47.539675 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 473/966] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:47.544766 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff7de7-bcf4-4f54-9e87-763ba7a347c3 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:47.545175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff7de7-bcf4-4f54-9e87-763ba7a347c3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:47.545351 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff7de7-bcf4-4f54-9e87-763ba7a347c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:47.563736 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-17ff7de7-bcf4-4f54-9e87-763ba7a347c3 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:47.565287 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-17ff7de7-bcf4-4f54-9e87-763ba7a347c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:47.637417 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 494/967] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:47.660496 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d2af0-227d-495a-9f83-817cbd6981a9 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:47.763117 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d2af0-227d-495a-9f83-817cbd6981a9 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:47.796740 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74631c-fb97-4a61-be8d-1566668f4842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:47.797270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74631c-fb97-4a61-be8d-1566668f4842 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:47.797550 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74631c-fb97-4a61-be8d-1566668f4842 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:47.797825 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74631c-fb97-4a61-be8d-1566668f4842 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:47.798415 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74631c-fb97-4a61-be8d-1566668f4842 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:47.799796 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74631c-fb97-4a61-be8d-1566668f4842 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:47.808699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-ac74631c-fb97-4a61-be8d-1566668f4842 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 02:18:47.808699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:47.808699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 02:18:47.808699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 02:18:47.808699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 02:18:47.808699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 02:18:47.808699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 02:18:47.808699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:47.808699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 02:18:47.808699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:47.808699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:18:47.808699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:47.808699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:47.808699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:47.808699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:47.808699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:47.808699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:47.809871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:47.809871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:47.809871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:47.809871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:47.809871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:47.809871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:47.809871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 02:18:47.809871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 02:18:47.809871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 02:18:47.809871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 02:18:47.809871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:47.809871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:47.809871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:47.809871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:47.809871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:47.809871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:47.810677 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:47.810677 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:47.810677 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:47.810677 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:47.810677 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:47.810677 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:47.810677 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:47.810677 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:47.810677 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:47.810677 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:47.810677 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 02:18:47.810677 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:47.810677 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 02:18:47.810677 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:47.813339 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 474/968] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 9 02:18:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:47.816221 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff7de7-bcf4-4f54-9e87-763ba7a347c3 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:47.932668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:47.975445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff7de7-bcf4-4f54-9e87-763ba7a347c3 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:47.975992 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ded31-cb6c-4c24-8d80-eb9039f994f3 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:47.976865 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ded31-cb6c-4c24-8d80-eb9039f994f3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:47.977175 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ded31-cb6c-4c24-8d80-eb9039f994f3 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:47.978764 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 475/969] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:18:47.983634 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178b3ba-599f-4c27-8c6a-0b453d47ac28 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:47.983951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178b3ba-599f-4c27-8c6a-0b453d47ac28 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:47.984223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178b3ba-599f-4c27-8c6a-0b453d47ac28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:48.003314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-e178b3ba-599f-4c27-8c6a-0b453d47ac28 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:48.004494 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e178b3ba-599f-4c27-8c6a-0b453d47ac28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:48.016157 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f396974-0940-4062-9237-04e6b4c12998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:48.016767 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f396974-0940-4062-9237-04e6b4c12998 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:48.017072 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f396974-0940-4062-9237-04e6b4c12998 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:48.017350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f396974-0940-4062-9237-04e6b4c12998 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:48.017968 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f396974-0940-4062-9237-04e6b4c12998 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:48.018286 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f396974-0940-4062-9237-04e6b4c12998 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:48.019648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f396974-0940-4062-9237-04e6b4c12998 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:48.024628 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 495/970] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 9 02:18:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:48.029998 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f396974-0940-4062-9237-04e6b4c12998 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:48.061482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:48.075940 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 476/971] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 02:18:48.098659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178b3ba-599f-4c27-8c6a-0b453d47ac28 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:48.134371 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f396974-0940-4062-9237-04e6b4c12998 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:48.170907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aebfb6-5c29-41a3-b6d2-a3200bb01077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:48.172050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aebfb6-5c29-41a3-b6d2-a3200bb01077 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:48.172333 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aebfb6-5c29-41a3-b6d2-a3200bb01077 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:48.173293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aebfb6-5c29-41a3-b6d2-a3200bb01077 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:48.173293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aebfb6-5c29-41a3-b6d2-a3200bb01077 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:48.173602 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aebfb6-5c29-41a3-b6d2-a3200bb01077 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:48.174912 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aebfb6-5c29-41a3-b6d2-a3200bb01077 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:48.180170 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 496/972] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 9 02:18:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:18:48.185706 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aebfb6-5c29-41a3-b6d2-a3200bb01077 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:48.190194 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:48.209356 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178b3ba-599f-4c27-8c6a-0b453d47ac28 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:48.251945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b9f68-bf99-4ccf-b22a-faba358d3355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:48.252580 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b9f68-bf99-4ccf-b22a-faba358d3355 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:48.252855 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b9f68-bf99-4ccf-b22a-faba358d3355 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:48.253155 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b9f68-bf99-4ccf-b22a-faba358d3355 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:48.263991 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b9f68-bf99-4ccf-b22a-faba358d3355 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:18:48.268735 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-a65b9f68-bf99-4ccf-b22a-faba358d3355 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 02:18:48.268735 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:48.268735 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:48.268735 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:48.268735 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:48.268735 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:48.268735 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:48.268735 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:48.268735 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:48.268735 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:48.268735 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:48.268735 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:48.268735 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:18:48.268735 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:18:48.268735 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:18:48.268735 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:18:48.269835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:18:48.269835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:18:48.269835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:18:48.269835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:18:48.269835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:48.269835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:48.269835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:48.269835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:48.269835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:48.269835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:48.269835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:48.269835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:48.269835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:48.269835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:48.269835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:48.269835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:48.270682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:48.270682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:48.270682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:48.270682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:48.270682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:18:48.270682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:18:48.270682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:18:48.270682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:18:48.270682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:18:48.270682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:18:48.270682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 02:18:48.270682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:48.273336 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 477/973] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Aug 9 02:18:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:18:48.275993 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b9f68-bf99-4ccf-b22a-faba358d3355 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:48.298988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aebfb6-5c29-41a3-b6d2-a3200bb01077 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:48.329479 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:48.339129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83990628-8274-47c4-837a-9bbe2aaec1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:48.339759 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83990628-8274-47c4-837a-9bbe2aaec1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:48.340049 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83990628-8274-47c4-837a-9bbe2aaec1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:48.340317 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83990628-8274-47c4-837a-9bbe2aaec1c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:48.341293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83990628-8274-47c4-837a-9bbe2aaec1c6 None admin] RBAC: Adding query filter params (interface=admin, service_id=ffa3db4a37414fd5a526efd878aff3b8, region_id=RegionOne) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:48.341409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83990628-8274-47c4-837a-9bbe2aaec1c6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:48.342781 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83990628-8274-47c4-837a-9bbe2aaec1c6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:48.348625 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 497/974] 10.222.0.16 () {56 vars in 1249 bytes} [Tue Aug 9 02:18:48 2022] GET /identity/v3/endpoints?service_id=ffa3db4a37414fd5a526efd878aff3b8&interface=admin®ion_id=RegionOne => generated 193 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:18:48.353890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83990628-8274-47c4-837a-9bbe2aaec1c6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:48.383118 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b9f68-bf99-4ccf-b22a-faba358d3355 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:48.419078 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e19640-c442-4379-aa7d-9007582ad8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:48.419761 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e19640-c442-4379-aa7d-9007582ad8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:48.420044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e19640-c442-4379-aa7d-9007582ad8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:48.420318 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e19640-c442-4379-aa7d-9007582ad8d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:48.420980 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e19640-c442-4379-aa7d-9007582ad8d4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:48.421850 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e19640-c442-4379-aa7d-9007582ad8d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:48.423210 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e19640-c442-4379-aa7d-9007582ad8d4 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:48.424806 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:48.437808 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 478/975] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 9 02:18:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:18:48.439240 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e19640-c442-4379-aa7d-9007582ad8d4 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:48.462246 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83990628-8274-47c4-837a-9bbe2aaec1c6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:48.497504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce5228-580b-42a0-b586-49958f4fb16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:48.498167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce5228-580b-42a0-b586-49958f4fb16c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:48.498443 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce5228-580b-42a0-b586-49958f4fb16c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:48.498742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce5228-580b-42a0-b586-49958f4fb16c None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:48.499346 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce5228-580b-42a0-b586-49958f4fb16c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:48.500725 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce5228-580b-42a0-b586-49958f4fb16c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:48.506621 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 498/976] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 9 02:18:48 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:18:48.558241 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e19640-c442-4379-aa7d-9007582ad8d4 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:48.573554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:48.596826 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2141719-40d7-4b96-a7a1-d36b71f0cdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:48.597419 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2141719-40d7-4b96-a7a1-d36b71f0cdee None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:48.597703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2141719-40d7-4b96-a7a1-d36b71f0cdee None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:48.597977 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2141719-40d7-4b96-a7a1-d36b71f0cdee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:48.611494 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2141719-40d7-4b96-a7a1-d36b71f0cdee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:48.612994 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2141719-40d7-4b96-a7a1-d36b71f0cdee None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:48.628710 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-f2141719-40d7-4b96-a7a1-d36b71f0cdee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:48.628710 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:48.628710 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:48.628710 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:48.628710 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:48.628710 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:48.628710 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:48.628710 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:48.628710 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:48.628710 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:48.628710 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:48.628710 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:48.628710 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:48.628710 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:48.628710 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:48.628710 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:48.629792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:48.629792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:48.629792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:48.629792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:48.629792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:48.629792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:48.629792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:48.629792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:48.629792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:48.629792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:48.629792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:48.629792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:48.629792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:48.629792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:48.629792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:48.629792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:48.629792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:48.630700 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:48.630700 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:48.630700 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:48.630700 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 479/977] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:18:48.635631 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce5228-580b-42a0-b586-49958f4fb16c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:48.743377 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce5228-580b-42a0-b586-49958f4fb16c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:48.772080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:48.778210 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d490db1-41f7-4951-98ed-f51fa652c7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:48.778824 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d490db1-41f7-4951-98ed-f51fa652c7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:48.779108 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d490db1-41f7-4951-98ed-f51fa652c7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:48.779383 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d490db1-41f7-4951-98ed-f51fa652c7a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:48.780030 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d490db1-41f7-4951-98ed-f51fa652c7a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:48.780337 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d490db1-41f7-4951-98ed-f51fa652c7a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:48.782302 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d490db1-41f7-4951-98ed-f51fa652c7a0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:48.799318 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 499/978] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:18:48.800754 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2141719-40d7-4b96-a7a1-d36b71f0cdee None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:48.904734 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2141719-40d7-4b96-a7a1-d36b71f0cdee None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:48.938144 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0e1b0-25ac-416a-a619-b87557966847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:48.938784 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0e1b0-25ac-416a-a619-b87557966847 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:48.939071 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0e1b0-25ac-416a-a619-b87557966847 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:48.939336 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0e1b0-25ac-416a-a619-b87557966847 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:48.947084 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0e1b0-25ac-416a-a619-b87557966847 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:48.948525 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0e1b0-25ac-416a-a619-b87557966847 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:48.960150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-8bc0e1b0-25ac-416a-a619-b87557966847 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 02:18:48.960150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:48.960150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:48.960150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:48.960150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:48.960150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:48.960150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:48.960150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:48.960150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:48.960150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:48.960150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:48.960150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:48.960150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:18:48.960150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:18:48.960150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:18:48.960150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:18:48.961126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:48.961126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:48.961126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:18:48.961126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:48.961126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:18:48.961126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:48.961126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:48.961126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:48.961126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:48.961126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:48.961126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:48.961126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:48.961126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:48.961126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:48.961126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:48.961126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:48.961126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:48.961126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:48.962049 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:48.962049 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:48.962049 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:18:48.962049 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:18:48.962049 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:18:48.962049 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:18:48.962049 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:18:48.962049 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:18:48.962049 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 02:18:48.962049 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:48.962049 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 480/979] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 9 02:18:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:48.968885 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d490db1-41f7-4951-98ed-f51fa652c7a0 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:49.072117 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d490db1-41f7-4951-98ed-f51fa652c7a0 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:49.106254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905abe97-cb29-45d9-a600-ffbebde034bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:49.106861 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905abe97-cb29-45d9-a600-ffbebde034bb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:49.107135 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905abe97-cb29-45d9-a600-ffbebde034bb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:49.107403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905abe97-cb29-45d9-a600-ffbebde034bb None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:49.108121 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905abe97-cb29-45d9-a600-ffbebde034bb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:49.108441 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905abe97-cb29-45d9-a600-ffbebde034bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:49.110031 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905abe97-cb29-45d9-a600-ffbebde034bb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:49.127759 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 500/980] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Aug 9 02:18:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:49.133159 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0e1b0-25ac-416a-a619-b87557966847 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:49.162766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:49.237342 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0e1b0-25ac-416a-a619-b87557966847 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:49.250330 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a61268-c430-499d-bd4a-49785f01945c None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:49.250611 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a61268-c430-499d-bd4a-49785f01945c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:49.250888 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a61268-c430-499d-bd4a-49785f01945c None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:49.252372 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 501/981] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:49.257146 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f38d32-809c-454a-85db-b98603d7fee3 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:49.257436 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f38d32-809c-454a-85db-b98603d7fee3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:49.257726 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f38d32-809c-454a-85db-b98603d7fee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:49.273724 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41676d0e-394f-408d-b953-166c6f3fc86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:49.274333 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41676d0e-394f-408d-b953-166c6f3fc86e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:49.274613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41676d0e-394f-408d-b953-166c6f3fc86e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:49.274883 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41676d0e-394f-408d-b953-166c6f3fc86e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:49.275918 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-72f38d32-809c-454a-85db-b98603d7fee3 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:49.277203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-72f38d32-809c-454a-85db-b98603d7fee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:49.324389 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:49.343148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41676d0e-394f-408d-b953-166c6f3fc86e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:49.344590 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41676d0e-394f-408d-b953-166c6f3fc86e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:49.347188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 502/982] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 02:18:49.369575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f38d32-809c-454a-85db-b98603d7fee3 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:49.370720 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:49.450895 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 481/983] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:18:49 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 02:18:49.456307 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41676d0e-394f-408d-b953-166c6f3fc86e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:49.486889 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f38d32-809c-454a-85db-b98603d7fee3 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:49.523680 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed1a9b-5f8d-4a6c-964b-ed5bc025ccbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:49.524288 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed1a9b-5f8d-4a6c-964b-ed5bc025ccbe None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:49.524570 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed1a9b-5f8d-4a6c-964b-ed5bc025ccbe None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:49.524844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed1a9b-5f8d-4a6c-964b-ed5bc025ccbe None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:49.525530 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed1a9b-5f8d-4a6c-964b-ed5bc025ccbe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:49.526891 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed1a9b-5f8d-4a6c-964b-ed5bc025ccbe None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:49.549062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 503/984] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 9 02:18:49 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:18:49.575066 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41676d0e-394f-408d-b953-166c6f3fc86e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:49.605912 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:49.625140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c25cfa-3148-40cf-8cc9-f0d2fbed7fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:49.625808 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c25cfa-3148-40cf-8cc9-f0d2fbed7fff None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:49.626093 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c25cfa-3148-40cf-8cc9-f0d2fbed7fff None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:49.626368 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c25cfa-3148-40cf-8cc9-f0d2fbed7fff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:49.638050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c25cfa-3148-40cf-8cc9-f0d2fbed7fff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:49.639582 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c25cfa-3148-40cf-8cc9-f0d2fbed7fff None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:49.656543 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-52c25cfa-3148-40cf-8cc9-f0d2fbed7fff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:49.656543 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:49.656543 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:49.656543 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:49.656543 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:49.656543 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:49.656543 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:49.656543 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:49.656543 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:49.656543 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:49.656543 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:49.656543 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:49.656543 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:49.656543 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:49.656543 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:49.656543 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:49.657874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:49.657874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:49.657874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:49.657874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:49.657874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:49.657874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:49.657874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:49.657874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:49.657874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:49.657874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:49.657874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:49.657874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:49.657874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:49.657874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:49.657874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:49.657874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:49.657874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:49.658861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:49.658861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:49.658861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:49.661377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 482/985] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:18:49.663710 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed1a9b-5f8d-4a6c-964b-ed5bc025ccbe None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:49.710874 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:49.774540 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed1a9b-5f8d-4a6c-964b-ed5bc025ccbe None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:49.808787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406a897-f23d-4e21-9476-4c862dfe9699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:49.809418 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406a897-f23d-4e21-9476-4c862dfe9699 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:49.809695 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406a897-f23d-4e21-9476-4c862dfe9699 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:49.809964 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406a897-f23d-4e21-9476-4c862dfe9699 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:49.810590 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406a897-f23d-4e21-9476-4c862dfe9699 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:49.810891 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406a897-f23d-4e21-9476-4c862dfe9699 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:49.812275 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406a897-f23d-4e21-9476-4c862dfe9699 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:49.824241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 504/986] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:49.830096 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c25cfa-3148-40cf-8cc9-f0d2fbed7fff None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:49.940625 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c25cfa-3148-40cf-8cc9-f0d2fbed7fff None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:49.982679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135c293-47b6-4592-a348-825f3cf824c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:49.983578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135c293-47b6-4592-a348-825f3cf824c6 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:49.983989 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135c293-47b6-4592-a348-825f3cf824c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:49.984359 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135c293-47b6-4592-a348-825f3cf824c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:49.991638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135c293-47b6-4592-a348-825f3cf824c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:49.993209 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135c293-47b6-4592-a348-825f3cf824c6 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:50.005392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-4135c293-47b6-4592-a348-825f3cf824c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:50.005392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:50.005392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:50.005392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:50.005392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:50.005392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:50.005392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:50.005392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:50.005392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:50.005392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:50.005392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:50.005392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:50.005392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:50.005392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:50.005392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:50.006508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:50.006508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:50.006508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:50.006508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:50.006508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:50.006508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:50.006508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:50.006508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:50.006508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:50.006508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:50.006508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:50.006508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:50.006508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:50.006508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:50.006508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:50.006508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:50.006508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:50.007601 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:50.007601 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:50.007601 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:50.007601 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:50.007601 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:50.007601 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:50.007601 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:50.007601 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:50.009104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 483/987] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:50.014764 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406a897-f23d-4e21-9476-4c862dfe9699 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:50.116547 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:50.119709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406a897-f23d-4e21-9476-4c862dfe9699 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:50.155098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96378b-48b7-4616-8fb8-9510d7dc424f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:50.155729 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96378b-48b7-4616-8fb8-9510d7dc424f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:50.156007 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96378b-48b7-4616-8fb8-9510d7dc424f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:50.156277 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96378b-48b7-4616-8fb8-9510d7dc424f None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:50.156972 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a96378b-48b7-4616-8fb8-9510d7dc424f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:50.157305 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a96378b-48b7-4616-8fb8-9510d7dc424f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:50.158727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a96378b-48b7-4616-8fb8-9510d7dc424f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:50.170316 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 505/988] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:50.176233 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135c293-47b6-4592-a348-825f3cf824c6 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:50.216603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:50.284102 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135c293-47b6-4592-a348-825f3cf824c6 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:50.317684 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de9dda-7638-468b-bbdd-1e6d5ff4100e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:50.318470 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de9dda-7638-468b-bbdd-1e6d5ff4100e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:50.318757 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de9dda-7638-468b-bbdd-1e6d5ff4100e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:50.319028 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de9dda-7638-468b-bbdd-1e6d5ff4100e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:50.319750 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de9dda-7638-468b-bbdd-1e6d5ff4100e None admin] RBAC: Adding query filter params (role.id=78bcb32d82b5450992ffa64fd7350353, scope.project.id=105476dcda7f48c28224d33c05860d6f, user.id=07041df2276d4dd58fb0e49417a26e2c) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:50.320058 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de9dda-7638-468b-bbdd-1e6d5ff4100e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:50.321508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de9dda-7638-468b-bbdd-1e6d5ff4100e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:50.337062 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 484/989] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:18:50 2022] GET /identity/v3/role_assignments?user.id=07041df2276d4dd58fb0e49417a26e2c&scope.project.id=105476dcda7f48c28224d33c05860d6f&role.id=78bcb32d82b5450992ffa64fd7350353 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:50.552459 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d7a50-29ac-4cdb-85eb-93a723784946 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:50.552819 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d7a50-29ac-4cdb-85eb-93a723784946 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:50.552938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d7a50-29ac-4cdb-85eb-93a723784946 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:50.554348 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 506/990] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:50.559570 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93190aff-a191-48ac-82a8-6aa124e4fae3 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:50.559867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93190aff-a191-48ac-82a8-6aa124e4fae3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:50.560152 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93190aff-a191-48ac-82a8-6aa124e4fae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:50.578547 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-93190aff-a191-48ac-82a8-6aa124e4fae3 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:50.579742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-93190aff-a191-48ac-82a8-6aa124e4fae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:50.649503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 485/991] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:50.672411 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d7a50-29ac-4cdb-85eb-93a723784946 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:50.777898 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d7a50-29ac-4cdb-85eb-93a723784946 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:50.813738 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c516d-f466-434a-bc7a-9f70af1d973e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:50.814746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c516d-f466-434a-bc7a-9f70af1d973e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:50.815176 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c516d-f466-434a-bc7a-9f70af1d973e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:50.815608 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c516d-f466-434a-bc7a-9f70af1d973e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:50.816336 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c516d-f466-434a-bc7a-9f70af1d973e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:50.817873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c516d-f466-434a-bc7a-9f70af1d973e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:50.826961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-1b6c516d-f466-434a-bc7a-9f70af1d973e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 02:18:50.826961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:50.826961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 02:18:50.826961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 02:18:50.826961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 02:18:50.826961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 02:18:50.826961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 02:18:50.826961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:50.826961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 02:18:50.826961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:50.826961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:18:50.826961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:50.826961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:50.826961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:50.826961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:50.826961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:50.826961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:50.828074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:50.828074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:50.828074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:50.828074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:50.828074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:50.828074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:50.828074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 02:18:50.828074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 02:18:50.828074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 02:18:50.828074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 02:18:50.828074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:50.828074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:50.828074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:50.828074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:50.828074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:50.828074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:50.828928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:50.828928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:50.828928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:50.828928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:50.828928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:50.828928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:50.828928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:50.828928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:50.828928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:50.828928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:50.828928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 02:18:50.828928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:50.828928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 02:18:50.828928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:50.828928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 507/992] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 9 02:18:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:50.835296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93190aff-a191-48ac-82a8-6aa124e4fae3 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:50.865900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:50.940040 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93190aff-a191-48ac-82a8-6aa124e4fae3 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:50.979717 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c2afa-f5c6-46ad-a92c-271a496413cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:50.980333 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c2afa-f5c6-46ad-a92c-271a496413cf None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:50.980610 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c2afa-f5c6-46ad-a92c-271a496413cf None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:50.980878 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c2afa-f5c6-46ad-a92c-271a496413cf None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:50.981553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c2afa-f5c6-46ad-a92c-271a496413cf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:50.981856 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c2afa-f5c6-46ad-a92c-271a496413cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:50.983214 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c2afa-f5c6-46ad-a92c-271a496413cf None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:50.993825 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 486/993] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 9 02:18:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:50.995337 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c516d-f466-434a-bc7a-9f70af1d973e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:51.022119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:51.100967 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c516d-f466-434a-bc7a-9f70af1d973e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:51.134571 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f74bec-7726-4b4e-ba0e-389729ef2081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:51.135300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f74bec-7726-4b4e-ba0e-389729ef2081 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:51.135677 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f74bec-7726-4b4e-ba0e-389729ef2081 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:51.136044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f74bec-7726-4b4e-ba0e-389729ef2081 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:51.136766 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f74bec-7726-4b4e-ba0e-389729ef2081 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:51.137280 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f74bec-7726-4b4e-ba0e-389729ef2081 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:51.138735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f74bec-7726-4b4e-ba0e-389729ef2081 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:51.144366 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 508/994] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 9 02:18:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:51.149924 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c2afa-f5c6-46ad-a92c-271a496413cf None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:51.240074 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:51.249626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c2afa-f5c6-46ad-a92c-271a496413cf None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:51.283659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace1a7a-70b5-499c-9850-64745e9cb309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:51.284405 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace1a7a-70b5-499c-9850-64745e9cb309 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:51.284781 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace1a7a-70b5-499c-9850-64745e9cb309 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:51.285200 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace1a7a-70b5-499c-9850-64745e9cb309 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:51.286016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace1a7a-70b5-499c-9850-64745e9cb309 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:51.287483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace1a7a-70b5-499c-9850-64745e9cb309 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:51.303696 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 487/995] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:18:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:18:51.592423 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e80559-3a40-4c6e-ade6-8050dfc47595 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:51.592799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e80559-3a40-4c6e-ade6-8050dfc47595 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:51.593013 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e80559-3a40-4c6e-ade6-8050dfc47595 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:51.594530 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 509/996] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:51.599388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca255223-5fb2-4631-8e02-1a5921bb4574 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:51.599839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca255223-5fb2-4631-8e02-1a5921bb4574 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:51.599996 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca255223-5fb2-4631-8e02-1a5921bb4574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:51.618607 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-ca255223-5fb2-4631-8e02-1a5921bb4574 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:51.619797 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ca255223-5fb2-4631-8e02-1a5921bb4574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:51.692399 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 488/997] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:51 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:51.714754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e80559-3a40-4c6e-ade6-8050dfc47595 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:51.807736 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:51.829241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e80559-3a40-4c6e-ade6-8050dfc47595 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:51.867722 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22877d-0d68-4065-a61f-f60c2fcc0c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:51.868269 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22877d-0d68-4065-a61f-f60c2fcc0c62 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:51.868547 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22877d-0d68-4065-a61f-f60c2fcc0c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:51.868806 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22877d-0d68-4065-a61f-f60c2fcc0c62 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:51.869406 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b22877d-0d68-4065-a61f-f60c2fcc0c62 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:51.870760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b22877d-0d68-4065-a61f-f60c2fcc0c62 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:51.879823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-6b22877d-0d68-4065-a61f-f60c2fcc0c62 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 02:18:51.879823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:51.879823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 02:18:51.879823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 02:18:51.879823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 02:18:51.879823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 02:18:51.879823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 02:18:51.879823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:51.879823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 02:18:51.879823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:51.879823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:18:51.879823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:51.879823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:51.879823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:51.879823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:51.879823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:51.879823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:51.880779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:51.880779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:51.880779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:51.880779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:51.880779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:51.880779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:51.880779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 02:18:51.880779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 02:18:51.880779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 02:18:51.880779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 02:18:51.880779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:51.880779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:51.880779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:51.880779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:51.880779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:51.880779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:51.882317 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:51.882317 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:51.882317 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:51.882317 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:51.882317 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:51.882317 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:51.882317 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:51.882317 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:51.882317 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:51.882317 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:51.882317 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 02:18:51.882317 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:51.882317 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 02:18:51.882317 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:51.882317 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 510/998] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:51.889234 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca255223-5fb2-4631-8e02-1a5921bb4574 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:51.966894 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:51.998558 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca255223-5fb2-4631-8e02-1a5921bb4574 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:52.033667 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c539e3-d788-4da3-abb3-445069409e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:52.034440 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c539e3-d788-4da3-abb3-445069409e46 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:52.034822 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c539e3-d788-4da3-abb3-445069409e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:52.035188 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c539e3-d788-4da3-abb3-445069409e46 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:52.035909 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c539e3-d788-4da3-abb3-445069409e46 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:52.036309 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c539e3-d788-4da3-abb3-445069409e46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:52.037782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c539e3-d788-4da3-abb3-445069409e46 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:52.042773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 489/999] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 9 02:18:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:18:52.048795 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22877d-0d68-4065-a61f-f60c2fcc0c62 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:52.149815 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22877d-0d68-4065-a61f-f60c2fcc0c62 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:52.183610 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6fa33-9a9c-4d3a-8ed0-63aca49c7f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:52.184330 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6fa33-9a9c-4d3a-8ed0-63aca49c7f5d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:52.184708 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6fa33-9a9c-4d3a-8ed0-63aca49c7f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:52.185105 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6fa33-9a9c-4d3a-8ed0-63aca49c7f5d None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:52.185827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6fa33-9a9c-4d3a-8ed0-63aca49c7f5d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:52.186229 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6fa33-9a9c-4d3a-8ed0-63aca49c7f5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:52.188240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6fa33-9a9c-4d3a-8ed0-63aca49c7f5d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:52.197864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 511/1000] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 9 02:18:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:52.199350 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c539e3-d788-4da3-abb3-445069409e46 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:52.298188 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c539e3-d788-4da3-abb3-445069409e46 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:52.331343 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667ad38-a8f0-4540-875f-90d8b5f0f2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:52.332081 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667ad38-a8f0-4540-875f-90d8b5f0f2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:52.332462 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667ad38-a8f0-4540-875f-90d8b5f0f2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:52.332832 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667ad38-a8f0-4540-875f-90d8b5f0f2c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:52.333657 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667ad38-a8f0-4540-875f-90d8b5f0f2c6 None admin] RBAC: Adding query filter params (interface=public, service_id=be6da08cefc644e7a7f8a0f6654528fb, region_id=RegionOne) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:52.334063 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667ad38-a8f0-4540-875f-90d8b5f0f2c6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:52.335527 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667ad38-a8f0-4540-875f-90d8b5f0f2c6 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:52.345696 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 490/1001] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 9 02:18:52 2022] GET /identity/v3/endpoints?service_id=be6da08cefc644e7a7f8a0f6654528fb&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:18:52.347219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6fa33-9a9c-4d3a-8ed0-63aca49c7f5d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:52.365805 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5b612-40f1-482f-b1dd-cac04094b43f None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:52.366218 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5b612-40f1-482f-b1dd-cac04094b43f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:52.366590 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5b612-40f1-482f-b1dd-cac04094b43f None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:52.367251 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:52.368179 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 491/1002] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:18:52.373760 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5c391-7326-4fe3-9d9b-4ad01671078d None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:52.374063 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5c391-7326-4fe3-9d9b-4ad01671078d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:52.374343 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5c391-7326-4fe3-9d9b-4ad01671078d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:52.387087 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:52.394107 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-1ca5c391-7326-4fe3-9d9b-4ad01671078d None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:52.395269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1ca5c391-7326-4fe3-9d9b-4ad01671078d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:52.463575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6fa33-9a9c-4d3a-8ed0-63aca49c7f5d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:52.468803 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 492/1003] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:52 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:52.490765 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5c391-7326-4fe3-9d9b-4ad01671078d None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:52.502071 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321876e-da43-4a2a-90f1-22a5540950cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:52.502682 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321876e-da43-4a2a-90f1-22a5540950cc None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:52.502959 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321876e-da43-4a2a-90f1-22a5540950cc None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:52.503229 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321876e-da43-4a2a-90f1-22a5540950cc None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:52.503836 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321876e-da43-4a2a-90f1-22a5540950cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:52.505255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321876e-da43-4a2a-90f1-22a5540950cc None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:52.511614 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 512/1004] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 9 02:18:52 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:18:52.597836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5c391-7326-4fe3-9d9b-4ad01671078d None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:52.633061 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5aba9-99a2-4142-80d5-3f18af6b5210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:52.633764 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5aba9-99a2-4142-80d5-3f18af6b5210 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:52.633999 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5aba9-99a2-4142-80d5-3f18af6b5210 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:52.634270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5aba9-99a2-4142-80d5-3f18af6b5210 None admin] PATH_INFO: `/v3/services/image` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:52.634921 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5aba9-99a2-4142-80d5-3f18af6b5210 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:52.636313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa5aba9-99a2-4142-80d5-3f18af6b5210 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:52.639262 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:52.646562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-7aa5aba9-99a2-4142-80d5-3f18af6b5210 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 02:18:52.646562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:52.646562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 02:18:52.646562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 02:18:52.646562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 02:18:52.646562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 02:18:52.646562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 02:18:52.646562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:52.646562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 02:18:52.646562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:52.646562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:18:52.646562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:52.646562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:52.646562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:52.646562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:52.646562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:52.646562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:52.647635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:52.647635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:52.647635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:52.647635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:52.647635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:52.647635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:52.647635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 02:18:52.647635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 02:18:52.647635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 02:18:52.647635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 02:18:52.647635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:52.647635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:52.647635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:52.647635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:52.647635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:52.647635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:52.648486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:52.648486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:52.648486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:52.648486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:52.648486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:52.648486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:52.648486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:52.648486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:52.648486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:52.648486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:52.648486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 02:18:52.648486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:52.648486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 02:18:52.648486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:52.648486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 493/1005] 10.222.0.16 () {56 vars in 1105 bytes} [Tue Aug 9 02:18:52 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:18:52.653732 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321876e-da43-4a2a-90f1-22a5540950cc None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:52.742457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:52.761992 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321876e-da43-4a2a-90f1-22a5540950cc None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:52.796574 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3320a88-a6e8-464c-8e3b-531de5fb80eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:52.797211 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3320a88-a6e8-464c-8e3b-531de5fb80eb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:52.797489 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3320a88-a6e8-464c-8e3b-531de5fb80eb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:52.797758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3320a88-a6e8-464c-8e3b-531de5fb80eb None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:52.798384 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3320a88-a6e8-464c-8e3b-531de5fb80eb None admin] RBAC: Adding query filter params (name=image) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:52.798687 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3320a88-a6e8-464c-8e3b-531de5fb80eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:52.800046 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3320a88-a6e8-464c-8e3b-531de5fb80eb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:52.804905 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 513/1006] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:52.810626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5aba9-99a2-4142-80d5-3f18af6b5210 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:52.912532 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5aba9-99a2-4142-80d5-3f18af6b5210 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:52.947288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b4202-4430-483c-b805-7d074f681ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:52.947995 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b4202-4430-483c-b805-7d074f681ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:52.948349 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b4202-4430-483c-b805-7d074f681ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:52.948694 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b4202-4430-483c-b805-7d074f681ce2 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:52.949424 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b4202-4430-483c-b805-7d074f681ce2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:52.949803 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b4202-4430-483c-b805-7d074f681ce2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:52.951254 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b4202-4430-483c-b805-7d074f681ce2 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:52.965126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 494/1007] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:53.349739 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e454fd-0499-4ba8-8fd1-c27dd2cc235a None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:53.350152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e454fd-0499-4ba8-8fd1-c27dd2cc235a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:53.350333 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e454fd-0499-4ba8-8fd1-c27dd2cc235a None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:53.351818 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 514/1008] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:53.356720 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9870681-9363-4de0-b263-f9e42fd40043 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:53.357014 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9870681-9363-4de0-b263-f9e42fd40043 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:53.357322 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9870681-9363-4de0-b263-f9e42fd40043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:53.375526 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-f9870681-9363-4de0-b263-f9e42fd40043 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:53.376716 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f9870681-9363-4de0-b263-f9e42fd40043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:53.436267 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:53.445211 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 495/1009] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:53 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:53.468679 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e454fd-0499-4ba8-8fd1-c27dd2cc235a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:53.569593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e454fd-0499-4ba8-8fd1-c27dd2cc235a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:53.604617 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8ea0b-62eb-463c-8667-2784e9bec745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:53.605201 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8ea0b-62eb-463c-8667-2784e9bec745 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:53.605493 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8ea0b-62eb-463c-8667-2784e9bec745 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:53.605753 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8ea0b-62eb-463c-8667-2784e9bec745 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:53.606859 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8ea0b-62eb-463c-8667-2784e9bec745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:53.608459 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8ea0b-62eb-463c-8667-2784e9bec745 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:53.610441 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 515/1010] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:53.616490 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9870681-9363-4de0-b263-f9e42fd40043 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:53.718571 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9870681-9363-4de0-b263-f9e42fd40043 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:53.752640 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084258a7-fa4d-49a1-8129-6b54d762bbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:53.753274 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084258a7-fa4d-49a1-8129-6b54d762bbf3 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:53.753558 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084258a7-fa4d-49a1-8129-6b54d762bbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:53.753832 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084258a7-fa4d-49a1-8129-6b54d762bbf3 None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:53.754471 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084258a7-fa4d-49a1-8129-6b54d762bbf3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:53.755888 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084258a7-fa4d-49a1-8129-6b54d762bbf3 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:53.789046 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 496/1011] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 9 02:18:53 2022] POST /identity/v3/projects => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:18:54.549984 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a13f4-de2c-412c-8942-8d090a0cf543 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:54.550557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a13f4-de2c-412c-8942-8d090a0cf543 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:54.550557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a13f4-de2c-412c-8942-8d090a0cf543 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:54.551911 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 516/1012] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:54.557123 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb64330-93e9-40c7-90b4-5f183226181f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:54.557414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb64330-93e9-40c7-90b4-5f183226181f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:54.557688 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb64330-93e9-40c7-90b4-5f183226181f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:54.575468 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-ffb64330-93e9-40c7-90b4-5f183226181f None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:54.576650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ffb64330-93e9-40c7-90b4-5f183226181f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:54.620349 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:54.650591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 497/1013] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:54 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:54.669545 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a13f4-de2c-412c-8942-8d090a0cf543 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:54.685238 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:54.774266 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a13f4-de2c-412c-8942-8d090a0cf543 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:54.808696 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0e99b-632e-45db-a0e8-ef999dec3c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:54.809292 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0e99b-632e-45db-a0e8-ef999dec3c98 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:54.809572 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0e99b-632e-45db-a0e8-ef999dec3c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:54.809846 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0e99b-632e-45db-a0e8-ef999dec3c98 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:54.810424 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0e99b-632e-45db-a0e8-ef999dec3c98 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:54.811896 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0e99b-632e-45db-a0e8-ef999dec3c98 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:54.820716 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-85c0e99b-632e-45db-a0e8-ef999dec3c98 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 02:18:54.820716 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:54.820716 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 02:18:54.820716 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 02:18:54.820716 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 02:18:54.820716 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 02:18:54.820716 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 02:18:54.820716 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:54.820716 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 02:18:54.820716 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:54.820716 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:18:54.820716 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:54.820716 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:54.820716 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:54.820716 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:54.820716 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:54.820716 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:54.821873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:54.821873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:54.821873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:54.821873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:54.821873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:54.821873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:54.821873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 02:18:54.821873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 02:18:54.821873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 02:18:54.821873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 02:18:54.821873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:54.821873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:54.821873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:54.821873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:54.821873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:54.821873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:54.822742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:54.822742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:54.822742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:54.822742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:54.822742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:54.822742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:54.822742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:54.822742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:54.822742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:54.822742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:54.822742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 02:18:54.822742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:54.822742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 02:18:54.822742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:54.826890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 517/1014] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:54.828786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb64330-93e9-40c7-90b4-5f183226181f None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:54.930297 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb64330-93e9-40c7-90b4-5f183226181f None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:54.964515 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c45752-6151-4e96-b2bf-3a3a90629b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:54.965161 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c45752-6151-4e96-b2bf-3a3a90629b62 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:54.965445 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c45752-6151-4e96-b2bf-3a3a90629b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:54.965718 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c45752-6151-4e96-b2bf-3a3a90629b62 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:54.966347 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c45752-6151-4e96-b2bf-3a3a90629b62 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:54.966650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c45752-6151-4e96-b2bf-3a3a90629b62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:54.968643 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c45752-6151-4e96-b2bf-3a3a90629b62 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:54.973729 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6524c-6e27-4c70-862d-731cbdaeee21 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:54.974011 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6524c-6e27-4c70-862d-731cbdaeee21 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:54.974282 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6524c-6e27-4c70-862d-731cbdaeee21 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:54.975623 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 518/1015] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:18:54.980719 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e4b2e-0cb2-471a-81bc-b624e0a5677d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:54.981418 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e4b2e-0cb2-471a-81bc-b624e0a5677d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:54.981418 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e4b2e-0cb2-471a-81bc-b624e0a5677d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:54.987198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 498/1016] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 9 02:18:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:54.993099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c45752-6151-4e96-b2bf-3a3a90629b62 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:55.000008 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-225e4b2e-0cb2-471a-81bc-b624e0a5677d None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:55.001242 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-225e4b2e-0cb2-471a-81bc-b624e0a5677d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:55.036086 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:55.071232 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 519/1017] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:54 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:55.094452 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e4b2e-0cb2-471a-81bc-b624e0a5677d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:55.099771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c45752-6151-4e96-b2bf-3a3a90629b62 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:55.102182 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:55.142116 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073382c-317b-4eaf-ae08-2d68504fc358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:55.142919 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073382c-317b-4eaf-ae08-2d68504fc358 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:55.143555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073382c-317b-4eaf-ae08-2d68504fc358 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:55.143845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073382c-317b-4eaf-ae08-2d68504fc358 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:55.144745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073382c-317b-4eaf-ae08-2d68504fc358 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:55.145084 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073382c-317b-4eaf-ae08-2d68504fc358 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:55.146885 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073382c-317b-4eaf-ae08-2d68504fc358 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:55.152325 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 499/1018] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 9 02:18:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:18:55.158433 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073382c-317b-4eaf-ae08-2d68504fc358 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:55.202963 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e4b2e-0cb2-471a-81bc-b624e0a5677d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:55.239713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e3448-46ad-4f55-b27c-31aa1d4016f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:55.240362 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e3448-46ad-4f55-b27c-31aa1d4016f6 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:55.240645 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e3448-46ad-4f55-b27c-31aa1d4016f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:55.240923 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e3448-46ad-4f55-b27c-31aa1d4016f6 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:55.241607 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e3448-46ad-4f55-b27c-31aa1d4016f6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:55.242988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e3448-46ad-4f55-b27c-31aa1d4016f6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:55.259637 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 520/1019] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 9 02:18:55 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:18:55.268149 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073382c-317b-4eaf-ae08-2d68504fc358 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:55.271601 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:55.316884 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfe878-44d8-43f4-a07c-cb77c9341c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:55.317557 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfe878-44d8-43f4-a07c-cb77c9341c51 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:55.317843 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfe878-44d8-43f4-a07c-cb77c9341c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:55.318119 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfe878-44d8-43f4-a07c-cb77c9341c51 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:55.318806 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfe878-44d8-43f4-a07c-cb77c9341c51 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:55.320199 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfe878-44d8-43f4-a07c-cb77c9341c51 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:55.349273 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 500/1020] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:18:55 2022] POST /identity/v3/endpoints => generated 334 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:18:55.806999 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11778b7-1977-45c6-a659-45bc07c95b17 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:55.807521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11778b7-1977-45c6-a659-45bc07c95b17 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:55.807521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11778b7-1977-45c6-a659-45bc07c95b17 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:55.808911 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 521/1021] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:55.814581 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57b4f5-d1f5-47b5-9217-5e1efd9bccd3 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:55.814878 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57b4f5-d1f5-47b5-9217-5e1efd9bccd3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:55.815149 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57b4f5-d1f5-47b5-9217-5e1efd9bccd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:55.832861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-fb57b4f5-d1f5-47b5-9217-5e1efd9bccd3 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:55.834073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-fb57b4f5-d1f5-47b5-9217-5e1efd9bccd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:55.907525 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 501/1022] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:55.930330 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11778b7-1977-45c6-a659-45bc07c95b17 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:56.004390 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:56.042547 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11778b7-1977-45c6-a659-45bc07c95b17 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:56.077271 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a8abb-e542-4467-bd8a-ccd888b19b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:56.077825 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a8abb-e542-4467-bd8a-ccd888b19b36 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:56.078107 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a8abb-e542-4467-bd8a-ccd888b19b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:56.078375 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a8abb-e542-4467-bd8a-ccd888b19b36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:56.079477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a8abb-e542-4467-bd8a-ccd888b19b36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:56.080911 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a8abb-e542-4467-bd8a-ccd888b19b36 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:56.087091 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 522/1023] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:56.088313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57b4f5-d1f5-47b5-9217-5e1efd9bccd3 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:56.169906 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:56.189859 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57b4f5-d1f5-47b5-9217-5e1efd9bccd3 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:56.223106 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38610d0a-f992-4867-866d-0eda9ff92dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:56.223707 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38610d0a-f992-4867-866d-0eda9ff92dbc None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:56.223984 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38610d0a-f992-4867-866d-0eda9ff92dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:56.224249 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38610d0a-f992-4867-866d-0eda9ff92dbc None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:56.224893 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38610d0a-f992-4867-866d-0eda9ff92dbc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:56.226336 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38610d0a-f992-4867-866d-0eda9ff92dbc None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:56.261071 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 502/1024] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 9 02:18:56 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:18:57.310348 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ade14-10c8-4e01-ad0c-f0e09f1bbc03 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:57.310864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ade14-10c8-4e01-ad0c-f0e09f1bbc03 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:57.310976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ade14-10c8-4e01-ad0c-f0e09f1bbc03 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:57.312801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 523/1025] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:57.318112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f138478-04de-4fd3-be6c-25cfb18dc07f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:57.318516 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f138478-04de-4fd3-be6c-25cfb18dc07f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:57.318658 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f138478-04de-4fd3-be6c-25cfb18dc07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:57.336711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-6f138478-04de-4fd3-be6c-25cfb18dc07f None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:57.337929 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6f138478-04de-4fd3-be6c-25cfb18dc07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:57.408667 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 503/1026] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:57.431236 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ade14-10c8-4e01-ad0c-f0e09f1bbc03 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:57.455997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5fc24-049f-476f-84da-2da8bf54e4a4 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:57.456282 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5fc24-049f-476f-84da-2da8bf54e4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:57.456757 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5fc24-049f-476f-84da-2da8bf54e4a4 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:57.458517 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 504/1027] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:18:57.463369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f321a-499d-4a02-88fe-03ed31206693 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:57.463649 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f321a-499d-4a02-88fe-03ed31206693 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:57.464121 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f321a-499d-4a02-88fe-03ed31206693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:57.482107 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-295f321a-499d-4a02-88fe-03ed31206693 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:57.484200 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-295f321a-499d-4a02-88fe-03ed31206693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:57.540837 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ade14-10c8-4e01-ad0c-f0e09f1bbc03 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:57.547573 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:57.557152 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 505/1028] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:18:57.576849 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff92362-97e3-4779-bd09-d3d816fcf8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:57.577518 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff92362-97e3-4779-bd09-d3d816fcf8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:57.577802 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff92362-97e3-4779-bd09-d3d816fcf8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:57.578074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff92362-97e3-4779-bd09-d3d816fcf8d9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:57.578375 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f321a-499d-4a02-88fe-03ed31206693 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:57.578654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff92362-97e3-4779-bd09-d3d816fcf8d9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:57.580013 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff92362-97e3-4779-bd09-d3d816fcf8d9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:57.582587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:57.590203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-9ff92362-97e3-4779-bd09-d3d816fcf8d9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 02:18:57.590203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:57.590203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 02:18:57.590203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 02:18:57.590203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 02:18:57.590203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 02:18:57.590203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 02:18:57.590203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:57.590203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 02:18:57.590203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:57.590203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:18:57.590203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:57.590203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:57.590203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:57.590203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:57.590203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:57.590203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:57.591263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:57.591263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:57.591263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:57.591263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:57.591263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:57.591263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:57.591263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 02:18:57.591263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 02:18:57.591263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 02:18:57.591263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 02:18:57.591263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:57.591263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:57.591263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:57.591263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:57.591263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:57.591263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:57.592082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:57.592082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:57.592082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:57.592082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:57.592082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:57.592082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:57.592082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:57.592082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:57.592082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:57.592082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:57.592082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 02:18:57.592082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:18:57.592082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 02:18:57.592082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:57.595184 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 524/1029] 10.222.0.16 () {56 vars in 1105 bytes} [Tue Aug 9 02:18:57 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:57.600786 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff92362-97e3-4779-bd09-d3d816fcf8d9 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:57.687703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f321a-499d-4a02-88fe-03ed31206693 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:57.706210 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff92362-97e3-4779-bd09-d3d816fcf8d9 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:57.723742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc9fc7-6829-4687-a58c-2df047d86f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:57.724375 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc9fc7-6829-4687-a58c-2df047d86f55 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:57.724656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc9fc7-6829-4687-a58c-2df047d86f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:57.724929 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc9fc7-6829-4687-a58c-2df047d86f55 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:57.735746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc9fc7-6829-4687-a58c-2df047d86f55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:18:57.740703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-3ebc9fc7-6829-4687-a58c-2df047d86f55 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 02:18:57.740703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:57.740703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:57.740703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:57.740703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:57.740703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:57.740703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:57.740703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:57.740703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:57.740703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:57.740703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:57.740703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:57.740703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:18:57.740703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:18:57.740703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:18:57.740703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:18:57.741952 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:18:57.741952 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:18:57.741952 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:18:57.741952 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:18:57.741952 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:57.741952 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:57.741952 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:57.741952 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:57.741952 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:57.741952 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:57.741952 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:57.741952 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:57.741952 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:57.741952 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:57.741952 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:57.741952 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:57.742799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:57.742799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:57.742799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:57.742799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:57.742799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:18:57.742799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:18:57.742799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:18:57.742799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:18:57.742799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:18:57.742799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:18:57.742799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 02:18:57.742799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:57.742799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 506/1030] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Aug 9 02:18:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:18:57.744449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c1a84-f777-4a98-936f-6e8627b93ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:57.745081 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c1a84-f777-4a98-936f-6e8627b93ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:57.745361 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c1a84-f777-4a98-936f-6e8627b93ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:57.745635 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c1a84-f777-4a98-936f-6e8627b93ed7 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:57.746266 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c1a84-f777-4a98-936f-6e8627b93ed7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:57.746802 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c1a84-f777-4a98-936f-6e8627b93ed7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:57.747926 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c1a84-f777-4a98-936f-6e8627b93ed7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:57.749727 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc9fc7-6829-4687-a58c-2df047d86f55 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:57.757793 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 525/1031] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:18:57.758587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c1a84-f777-4a98-936f-6e8627b93ed7 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:57.815368 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:57.823849 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:57.861520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc9fc7-6829-4687-a58c-2df047d86f55 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:57.866059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c1a84-f777-4a98-936f-6e8627b93ed7 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:57.901673 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9650c59-975d-402d-a111-f59c7890e10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:57.902323 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9650c59-975d-402d-a111-f59c7890e10c None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:57.902610 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9650c59-975d-402d-a111-f59c7890e10c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:57.902885 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9650c59-975d-402d-a111-f59c7890e10c None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:57.903559 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9650c59-975d-402d-a111-f59c7890e10c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:57.903868 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9650c59-975d-402d-a111-f59c7890e10c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:57.905915 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9650c59-975d-402d-a111-f59c7890e10c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:57.907473 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b091d-d1f3-4079-8812-f1760a8b2d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:57.908321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b091d-d1f3-4079-8812-f1760a8b2d1c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:57.908612 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b091d-d1f3-4079-8812-f1760a8b2d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:57.908888 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b091d-d1f3-4079-8812-f1760a8b2d1c None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:57.909552 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b091d-d1f3-4079-8812-f1760a8b2d1c None admin] RBAC: Adding query filter params (type=image) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:57.909887 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b091d-d1f3-4079-8812-f1760a8b2d1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:57.911249 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b091d-d1f3-4079-8812-f1760a8b2d1c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:57.914867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 507/1032] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 9 02:18:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:57.919186 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 526/1033] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:18:57.921978 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9650c59-975d-402d-a111-f59c7890e10c None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:57.924263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b091d-d1f3-4079-8812-f1760a8b2d1c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:58.031297 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9650c59-975d-402d-a111-f59c7890e10c None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:58.043118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b091d-d1f3-4079-8812-f1760a8b2d1c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:58.052984 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:58.067903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99117e61-e585-4eca-a196-3867a5fd54a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:58.068539 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99117e61-e585-4eca-a196-3867a5fd54a0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:58.068827 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99117e61-e585-4eca-a196-3867a5fd54a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:58.069301 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99117e61-e585-4eca-a196-3867a5fd54a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:58.070430 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:58.080904 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fc108-8791-4ce8-93ef-57d7f0f50669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:58.081182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99117e61-e585-4eca-a196-3867a5fd54a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:58.081537 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fc108-8791-4ce8-93ef-57d7f0f50669 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:58.081817 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fc108-8791-4ce8-93ef-57d7f0f50669 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:58.082086 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fc108-8791-4ce8-93ef-57d7f0f50669 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:58.082523 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99117e61-e585-4eca-a196-3867a5fd54a0 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:58.082787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fc108-8791-4ce8-93ef-57d7f0f50669 None admin] RBAC: Adding query filter params (interface=public, service_id=355a85cc57534c6f871300dbd2677a88, region_id=RegionOne) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:58.083093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fc108-8791-4ce8-93ef-57d7f0f50669 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:58.084439 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fc108-8791-4ce8-93ef-57d7f0f50669 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:58.089735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 527/1034] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 9 02:18:57 2022] GET /identity/v3/endpoints?service_id=355a85cc57534c6f871300dbd2677a88&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:18:58.095568 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fc108-8791-4ce8-93ef-57d7f0f50669 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:58.097580 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-99117e61-e585-4eca-a196-3867a5fd54a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:58.097580 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:58.097580 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:58.097580 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:58.097580 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:58.097580 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:58.097580 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:58.097580 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:58.097580 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:58.097580 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:58.097580 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:58.097580 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:58.097580 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:58.097580 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:58.097580 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:58.097580 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:58.098498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:58.098498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:58.098498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:58.098498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:58.098498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:58.098498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:58.098498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:58.098498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:58.098498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:58.098498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:58.098498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:58.098498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:58.098498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:58.098498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:58.098498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:58.098498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:58.098498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:58.099452 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:58.099452 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:58.099452 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:58.103441 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 508/1035] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:58.104283 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99117e61-e585-4eca-a196-3867a5fd54a0 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:58.210132 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fc108-8791-4ce8-93ef-57d7f0f50669 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:58.215825 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99117e61-e585-4eca-a196-3867a5fd54a0 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:58.246940 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e787b89-ca0c-49b4-a916-0e89005fa55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:58.247691 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e787b89-ca0c-49b4-a916-0e89005fa55f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:58.247979 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e787b89-ca0c-49b4-a916-0e89005fa55f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:58.248258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e787b89-ca0c-49b4-a916-0e89005fa55f None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:58.249413 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e787b89-ca0c-49b4-a916-0e89005fa55f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:58.250893 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e787b89-ca0c-49b4-a916-0e89005fa55f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:58.257539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 528/1036] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 9 02:18:58 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:18:58.257711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7eec3-767c-41d1-9a46-750b1494e293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:58.258346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7eec3-767c-41d1-9a46-750b1494e293 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:58.258630 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7eec3-767c-41d1-9a46-750b1494e293 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:58.258903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7eec3-767c-41d1-9a46-750b1494e293 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:58.259553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c7eec3-767c-41d1-9a46-750b1494e293 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:58.259861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c7eec3-767c-41d1-9a46-750b1494e293 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:58.261271 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c7eec3-767c-41d1-9a46-750b1494e293 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:58.277457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 509/1037] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:58.283100 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e787b89-ca0c-49b4-a916-0e89005fa55f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:58.290051 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe50e7-6474-478d-a7f4-55a0f5928b65 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:58.290357 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe50e7-6474-478d-a7f4-55a0f5928b65 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:58.290600 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe50e7-6474-478d-a7f4-55a0f5928b65 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:58.292136 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 510/1038] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:18:58.297787 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8045b-af7c-4203-99e7-ea83fb37b9a5 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:58.298124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8045b-af7c-4203-99e7-ea83fb37b9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:58.298317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8045b-af7c-4203-99e7-ea83fb37b9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:58.317910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-24c8045b-af7c-4203-99e7-ea83fb37b9a5 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:18:58.319228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-24c8045b-af7c-4203-99e7-ea83fb37b9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:18:58.345845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:58.351328 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:58.396906 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 511/1039] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:18:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 02:18:58.403827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e787b89-ca0c-49b4-a916-0e89005fa55f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:58.420153 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8045b-af7c-4203-99e7-ea83fb37b9a5 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:58.442503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f73f1-0503-4b75-87b9-cbc550a663a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:58.443228 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f73f1-0503-4b75-87b9-cbc550a663a2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:58.443514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f73f1-0503-4b75-87b9-cbc550a663a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:58.443783 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f73f1-0503-4b75-87b9-cbc550a663a2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:58.452936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f73f1-0503-4b75-87b9-cbc550a663a2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:58.454677 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f73f1-0503-4b75-87b9-cbc550a663a2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:58.468801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-a12f73f1-0503-4b75-87b9-cbc550a663a2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 02:18:58.468801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:58.468801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:58.468801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:58.468801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:58.468801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:58.468801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:58.468801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:58.468801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:58.468801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:58.468801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:58.468801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:58.468801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:18:58.468801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:18:58.468801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:18:58.468801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:18:58.470381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:58.470381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:58.470381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:18:58.470381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:58.470381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:18:58.470381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:18:58.470381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:58.470381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:58.470381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:58.470381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:58.470381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:58.470381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:58.470381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:58.470381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:58.470381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:58.470381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:58.470381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:58.470381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:58.471544 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:58.471544 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:58.471544 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:18:58.471544 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:18:58.471544 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:18:58.471544 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:18:58.471544 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:18:58.471544 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:18:58.471544 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 02:18:58.471544 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:58.471544 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 529/1040] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 9 02:18:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:18:58.476246 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f73f1-0503-4b75-87b9-cbc550a663a2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:58.532080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8045b-af7c-4203-99e7-ea83fb37b9a5 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:58.569319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab80aa6-8d06-4a7d-b2c7-88ac7a512d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:58.569958 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab80aa6-8d06-4a7d-b2c7-88ac7a512d78 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:58.570240 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab80aa6-8d06-4a7d-b2c7-88ac7a512d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:58.570633 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab80aa6-8d06-4a7d-b2c7-88ac7a512d78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:58.582323 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab80aa6-8d06-4a7d-b2c7-88ac7a512d78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:18:58.582909 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f73f1-0503-4b75-87b9-cbc550a663a2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:58.587289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-8ab80aa6-8d06-4a7d-b2c7-88ac7a512d78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:18:58.587289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:58.587289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:58.587289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:58.587289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:58.587289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:58.587289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:58.587289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:58.587289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:58.587289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:58.587289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:58.587289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:58.587289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:18:58.587289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:18:58.587289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:18:58.587289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:18:58.588235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:18:58.588235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:18:58.588235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:18:58.588235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:18:58.588235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:58.588235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:58.588235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:58.588235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:58.588235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:58.588235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:58.588235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:58.588235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:58.588235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:58.588235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:58.588235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:58.588235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:58.589114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:58.589114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:58.589114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:58.589114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:58.589114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:18:58.589114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:18:58.589114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:18:58.589114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:18:58.589114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:18:58.589114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:18:58.589114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:18:58.589114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:18:58.593336 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 512/1041] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:18:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:18:58.594710 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab80aa6-8d06-4a7d-b2c7-88ac7a512d78 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:58.597971 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:58.620994 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:58.625207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf163fb-31fc-441e-8c61-8a8305c75418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:58.625825 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf163fb-31fc-441e-8c61-8a8305c75418 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:58.626109 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf163fb-31fc-441e-8c61-8a8305c75418 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:58.626385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf163fb-31fc-441e-8c61-8a8305c75418 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:58.627125 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf163fb-31fc-441e-8c61-8a8305c75418 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:58.627438 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf163fb-31fc-441e-8c61-8a8305c75418 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:58.628868 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf163fb-31fc-441e-8c61-8a8305c75418 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:58.648172 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 530/1042] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 9 02:18:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:18:58.653737 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf163fb-31fc-441e-8c61-8a8305c75418 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:58.707965 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab80aa6-8d06-4a7d-b2c7-88ac7a512d78 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:58.747781 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cc056-ff71-400a-9331-d0f836772468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:58.748315 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cc056-ff71-400a-9331-d0f836772468 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:58.749185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cc056-ff71-400a-9331-d0f836772468 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:58.749467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cc056-ff71-400a-9331-d0f836772468 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:58.750135 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9cc056-ff71-400a-9331-d0f836772468 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:58.750441 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9cc056-ff71-400a-9331-d0f836772468 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:58.751800 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9cc056-ff71-400a-9331-d0f836772468 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:58.758340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf163fb-31fc-441e-8c61-8a8305c75418 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:58.760536 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 513/1043] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:18:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:58.766026 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cc056-ff71-400a-9331-d0f836772468 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:58.794396 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c619547-cbe3-45e9-9c9c-7acf552a832c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:58.795106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c619547-cbe3-45e9-9c9c-7acf552a832c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:58.796100 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c619547-cbe3-45e9-9c9c-7acf552a832c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:58.796213 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c619547-cbe3-45e9-9c9c-7acf552a832c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:58.843105 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:58.851573 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:58.868230 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cc056-ff71-400a-9331-d0f836772468 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:58.876859 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c619547-cbe3-45e9-9c9c-7acf552a832c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:58.878450 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c619547-cbe3-45e9-9c9c-7acf552a832c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:58.901990 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb65a6-fcf3-4fe6-b8aa-69368c84fb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:58.902624 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb65a6-fcf3-4fe6-b8aa-69368c84fb22 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:58.902907 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb65a6-fcf3-4fe6-b8aa-69368c84fb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:58.903177 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb65a6-fcf3-4fe6-b8aa-69368c84fb22 None admin] PATH_INFO: `/v3/users/326eef9ed36146b19c3d0d2a657802dc` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:58.916434 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb65a6-fcf3-4fe6-b8aa-69368c84fb22 None admin] RBAC: Authorizing `identity:get_user(user_id=326eef9ed36146b19c3d0d2a657802dc)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:58.917896 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb65a6-fcf3-4fe6-b8aa-69368c84fb22 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:58.919558 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 514/1044] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:18:58 2022] GET /identity/v3/users/326eef9ed36146b19c3d0d2a657802dc => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:18:58.925757 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb65a6-fcf3-4fe6-b8aa-69368c84fb22 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:58.996015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 531/1045] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:18:58 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 02:18:59.001747 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c619547-cbe3-45e9-9c9c-7acf552a832c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:59.035555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb65a6-fcf3-4fe6-b8aa-69368c84fb22 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:59.071215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af975d43-5396-48d3-86f1-4af5ee3630f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:59.071821 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af975d43-5396-48d3-86f1-4af5ee3630f6 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:59.072107 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af975d43-5396-48d3-86f1-4af5ee3630f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:59.072385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af975d43-5396-48d3-86f1-4af5ee3630f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:59.074231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:59.084759 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:59.105776 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c619547-cbe3-45e9-9c9c-7acf552a832c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:59.141281 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceedb7d-7b2e-4995-8a98-cc2738e489a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:59.141887 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceedb7d-7b2e-4995-8a98-cc2738e489a3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:59.142168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceedb7d-7b2e-4995-8a98-cc2738e489a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:59.142435 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceedb7d-7b2e-4995-8a98-cc2738e489a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:59.144970 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af975d43-5396-48d3-86f1-4af5ee3630f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:59.146441 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af975d43-5396-48d3-86f1-4af5ee3630f6 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:59.155217 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceedb7d-7b2e-4995-8a98-cc2738e489a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:59.157042 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceedb7d-7b2e-4995-8a98-cc2738e489a3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:59.171844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-0ceedb7d-7b2e-4995-8a98-cc2738e489a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:59.171844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:59.171844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:59.171844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:59.171844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:59.171844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:59.171844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:59.171844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:59.171844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:59.171844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:59.171844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:59.171844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:59.171844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:18:59.171844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:18:59.171844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:18:59.171844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:18:59.172841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:59.172841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:59.172841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:59.172841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:59.172841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:59.172841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:59.172841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:59.172841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:59.172841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:59.172841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:59.172841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:59.172841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:59.172841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:59.172841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:59.172841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:59.172841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:59.172841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:18:59.173768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:18:59.173768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:18:59.173768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:59.173768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 532/1046] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:18:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:18:59.178358 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceedb7d-7b2e-4995-8a98-cc2738e489a3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:59.257763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 515/1047] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:18:58 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 02:18:59.258726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af975d43-5396-48d3-86f1-4af5ee3630f6 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:59.294744 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceedb7d-7b2e-4995-8a98-cc2738e489a3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:59.303334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:59.319142 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:59.332972 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d7a8f-de0f-49e6-a270-6aaa64164638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:59.333612 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d7a8f-de0f-49e6-a270-6aaa64164638 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:59.333896 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d7a8f-de0f-49e6-a270-6aaa64164638 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:59.334171 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d7a8f-de0f-49e6-a270-6aaa64164638 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:59.334824 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d7a8f-de0f-49e6-a270-6aaa64164638 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:59.335129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d7a8f-de0f-49e6-a270-6aaa64164638 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:59.336499 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d7a8f-de0f-49e6-a270-6aaa64164638 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:59.349911 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 533/1048] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:18:59.355093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d7a8f-de0f-49e6-a270-6aaa64164638 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:59.369584 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af975d43-5396-48d3-86f1-4af5ee3630f6 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:59.407099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89e463-cd0f-45d9-8bf2-5daeaef1f880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:59.407858 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89e463-cd0f-45d9-8bf2-5daeaef1f880 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:59.408142 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89e463-cd0f-45d9-8bf2-5daeaef1f880 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:59.408535 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb89e463-cd0f-45d9-8bf2-5daeaef1f880 None admin] PATH_INFO: `/v3/projects/b74ea3e96b9a4bfa92090f64b701aedf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:59.409690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89e463-cd0f-45d9-8bf2-5daeaef1f880 None admin] RBAC: Authorizing `identity:get_project(project_id=b74ea3e96b9a4bfa92090f64b701aedf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:59.411250 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb89e463-cd0f-45d9-8bf2-5daeaef1f880 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:59.418095 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 516/1049] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:18:59 2022] GET /identity/v3/projects/b74ea3e96b9a4bfa92090f64b701aedf => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:18:59.418867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89e463-cd0f-45d9-8bf2-5daeaef1f880 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:59.469044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d7a8f-de0f-49e6-a270-6aaa64164638 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:59.502912 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467574e4-84e4-44f5-bbad-c1d0f0c4e98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:59.503547 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467574e4-84e4-44f5-bbad-c1d0f0c4e98f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:59.503829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467574e4-84e4-44f5-bbad-c1d0f0c4e98f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:59.504105 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467574e4-84e4-44f5-bbad-c1d0f0c4e98f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:59.510833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467574e4-84e4-44f5-bbad-c1d0f0c4e98f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:59.512223 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467574e4-84e4-44f5-bbad-c1d0f0c4e98f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:59.523735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-467574e4-84e4-44f5-bbad-c1d0f0c4e98f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:59.523735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:18:59.523735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:18:59.523735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:18:59.523735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:18:59.523735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:18:59.523735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:18:59.523735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:18:59.523735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:18:59.523735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:18:59.523735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:18:59.523735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:18:59.523735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:18:59.523735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:18:59.523735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:18:59.524630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:18:59.524630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:18:59.524630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:18:59.524630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:18:59.524630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:18:59.524630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:18:59.524630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:18:59.524630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:18:59.524630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:18:59.524630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:18:59.524630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:18:59.524630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:18:59.524630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:18:59.524630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:18:59.524630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:18:59.524630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:18:59.524630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:18:59.525565 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:18:59.525565 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:18:59.525565 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:18:59.525565 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:18:59.525565 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:18:59.525565 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:18:59.525565 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:18:59.525565 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:18:59.525565 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 534/1050] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:18:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:18:59.531142 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467574e4-84e4-44f5-bbad-c1d0f0c4e98f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:59.533571 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb89e463-cd0f-45d9-8bf2-5daeaef1f880 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:59.546177 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:59.571281 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3083d-cd07-439a-851f-7cee51bd250e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:59.571914 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3083d-cd07-439a-851f-7cee51bd250e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:59.572169 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3083d-cd07-439a-851f-7cee51bd250e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:59.572436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3083d-cd07-439a-851f-7cee51bd250e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:59.573182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3083d-cd07-439a-851f-7cee51bd250e None admin] RBAC: Adding query filter params (role.id=e2095c5a29d74c33b9dcb16f8e5343bf, scope.project.id=b74ea3e96b9a4bfa92090f64b701aedf, user.id=326eef9ed36146b19c3d0d2a657802dc) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:59.573493 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3083d-cd07-439a-851f-7cee51bd250e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:59.575335 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3083d-cd07-439a-851f-7cee51bd250e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:59.580513 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:18:59.582144 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 517/1051] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:18:59 2022] GET /identity/v3/role_assignments?user.id=326eef9ed36146b19c3d0d2a657802dc&scope.project.id=b74ea3e96b9a4bfa92090f64b701aedf&role.id=e2095c5a29d74c33b9dcb16f8e5343bf => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:18:59.644948 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467574e4-84e4-44f5-bbad-c1d0f0c4e98f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:59.682512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645d4fe-6693-4bb6-8394-70e8fe0076a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:59.683136 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645d4fe-6693-4bb6-8394-70e8fe0076a4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:59.683420 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645d4fe-6693-4bb6-8394-70e8fe0076a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:59.683696 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645d4fe-6693-4bb6-8394-70e8fe0076a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:59.684407 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645d4fe-6693-4bb6-8394-70e8fe0076a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:59.684718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645d4fe-6693-4bb6-8394-70e8fe0076a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:59.686784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a645d4fe-6693-4bb6-8394-70e8fe0076a4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:59.705467 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 535/1052] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:18:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:18:59.706778 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3083d-cd07-439a-851f-7cee51bd250e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:18:59.810565 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3083d-cd07-439a-851f-7cee51bd250e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:18:59.845716 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce1a03-a58a-4aef-9ea8-d9c04a051d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:18:59.846327 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce1a03-a58a-4aef-9ea8-d9c04a051d87 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:18:59.846611 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce1a03-a58a-4aef-9ea8-d9c04a051d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:18:59.846887 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce1a03-a58a-4aef-9ea8-d9c04a051d87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:18:59.847617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce1a03-a58a-4aef-9ea8-d9c04a051d87 None admin] RBAC: Adding query filter params (role.id=78bcb32d82b5450992ffa64fd7350353, scope.project.id=105476dcda7f48c28224d33c05860d6f, user.id=78fff294b9794a26aa1bbc231fa1133c) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:18:59.847934 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce1a03-a58a-4aef-9ea8-d9c04a051d87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:18:59.849398 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce1a03-a58a-4aef-9ea8-d9c04a051d87 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:18:59.861063 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 518/1053] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:18:59 2022] GET /identity/v3/role_assignments?user.id=78fff294b9794a26aa1bbc231fa1133c&scope.project.id=105476dcda7f48c28224d33c05860d6f&role.id=78bcb32d82b5450992ffa64fd7350353 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:00.264372 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76453d13-f754-42fd-9704-9d23a33c9df0 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:00.264740 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76453d13-f754-42fd-9704-9d23a33c9df0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:00.264846 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76453d13-f754-42fd-9704-9d23a33c9df0 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:00.266358 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 536/1054] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:19:00.271489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306db9bf-0ae7-4caf-acb1-029c0b035d13 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:00.271783 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306db9bf-0ae7-4caf-acb1-029c0b035d13 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:00.272062 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306db9bf-0ae7-4caf-acb1-029c0b035d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:00.290370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-306db9bf-0ae7-4caf-acb1-029c0b035d13 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:19:00.291594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-306db9bf-0ae7-4caf-acb1-029c0b035d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:19:00.323443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:00.362763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 519/1055] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:19:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:19:00.385579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76453d13-f754-42fd-9704-9d23a33c9df0 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:00.491549 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76453d13-f754-42fd-9704-9d23a33c9df0 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:00.493980 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:00.527255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a235c83-d647-4fdd-9286-883b62f247bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:00.527893 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a235c83-d647-4fdd-9286-883b62f247bd None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:00.528176 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a235c83-d647-4fdd-9286-883b62f247bd None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:00.528449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a235c83-d647-4fdd-9286-883b62f247bd None admin] PATH_INFO: `/v3/services/image` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:00.529046 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a235c83-d647-4fdd-9286-883b62f247bd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:00.530968 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a235c83-d647-4fdd-9286-883b62f247bd None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:00.539788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-7a235c83-d647-4fdd-9286-883b62f247bd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 02:19:00.539788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:19:00.539788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 02:19:00.539788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 02:19:00.539788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 02:19:00.539788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 02:19:00.539788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 02:19:00.539788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:19:00.539788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 02:19:00.539788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:19:00.539788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:19:00.539788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:19:00.539788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:19:00.539788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:19:00.539788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:19:00.539788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:19:00.539788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:19:00.540779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:19:00.540779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:19:00.540779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:19:00.540779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:19:00.540779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:19:00.540779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:19:00.540779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 02:19:00.540779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 02:19:00.540779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 02:19:00.540779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 02:19:00.540779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:19:00.540779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:19:00.540779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:19:00.540779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:19:00.540779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:19:00.540779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:19:00.542201 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:19:00.542201 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:19:00.542201 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:19:00.542201 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:19:00.542201 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:19:00.542201 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:19:00.542201 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:19:00.542201 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:19:00.542201 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:19:00.542201 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:19:00.542201 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 02:19:00.542201 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:19:00.542201 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 02:19:00.542201 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:19:00.546109 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 537/1056] 10.222.0.16 () {56 vars in 1105 bytes} [Tue Aug 9 02:19:00 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:19:00.547422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306db9bf-0ae7-4caf-acb1-029c0b035d13 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:00.647008 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306db9bf-0ae7-4caf-acb1-029c0b035d13 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:00.680802 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a3418-a2b7-43b0-944f-5d6db447888a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:00.681467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a3418-a2b7-43b0-944f-5d6db447888a None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:00.681754 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a3418-a2b7-43b0-944f-5d6db447888a None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:00.682027 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a3418-a2b7-43b0-944f-5d6db447888a None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:00.682676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a3418-a2b7-43b0-944f-5d6db447888a None admin] RBAC: Adding query filter params (name=image) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:00.682985 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a3418-a2b7-43b0-944f-5d6db447888a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:00.684395 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a3418-a2b7-43b0-944f-5d6db447888a None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:00.694589 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 520/1057] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:19:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:00.696198 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a235c83-d647-4fdd-9286-883b62f247bd None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:00.798872 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a235c83-d647-4fdd-9286-883b62f247bd None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:00.832160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5407a-7574-4642-8af8-405b9f6211c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:00.832818 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5407a-7574-4642-8af8-405b9f6211c9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:00.833126 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5407a-7574-4642-8af8-405b9f6211c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:00.833399 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5407a-7574-4642-8af8-405b9f6211c9 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:00.834017 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5407a-7574-4642-8af8-405b9f6211c9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:00.834315 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5407a-7574-4642-8af8-405b9f6211c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:00.835669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5407a-7574-4642-8af8-405b9f6211c9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:00.845933 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 538/1058] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:19:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:00.847136 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a3418-a2b7-43b0-944f-5d6db447888a None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:00.879845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:00.955262 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a3418-a2b7-43b0-944f-5d6db447888a None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:00.996847 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecadadf-5ff2-4d91-ba53-1fb9ac175943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:00.997621 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecadadf-5ff2-4d91-ba53-1fb9ac175943 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:00.998004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecadadf-5ff2-4d91-ba53-1fb9ac175943 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:00.998411 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecadadf-5ff2-4d91-ba53-1fb9ac175943 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:00.999170 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecadadf-5ff2-4d91-ba53-1fb9ac175943 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:01.000645 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecadadf-5ff2-4d91-ba53-1fb9ac175943 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:01.025209 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 521/1059] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:19:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:19:01.591915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ee3d1-d125-4ffa-a887-84b35c6ab11b None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:01.592465 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ee3d1-d125-4ffa-a887-84b35c6ab11b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:01.592542 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ee3d1-d125-4ffa-a887-84b35c6ab11b None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:01.593945 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 539/1060] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:19:01.599053 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f96b4-00a1-48f3-ab17-9577b81f6e27 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:01.599464 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f96b4-00a1-48f3-ab17-9577b81f6e27 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:01.599606 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f96b4-00a1-48f3-ab17-9577b81f6e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:01.618871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c69f96b4-00a1-48f3-ab17-9577b81f6e27 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:19:01.620075 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c69f96b4-00a1-48f3-ab17-9577b81f6e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:19:01.693506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 522/1061] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:19:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:19:01.715565 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ee3d1-d125-4ffa-a887-84b35c6ab11b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:01.749947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:01.823222 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ee3d1-d125-4ffa-a887-84b35c6ab11b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:01.833467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d8d3b-3cf3-4165-875b-d171c09ebf9f None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:01.833762 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d8d3b-3cf3-4165-875b-d171c09ebf9f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:01.834033 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d8d3b-3cf3-4165-875b-d171c09ebf9f None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:01.835505 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 523/1062] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:19:01.840109 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a4422-a0dd-4fce-afab-43e7cd838b3f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:01.840391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a4422-a0dd-4fce-afab-43e7cd838b3f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:01.840663 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a4422-a0dd-4fce-afab-43e7cd838b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:01.858221 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24802846-eab8-4e45-a367-291519d52ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:01.858786 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24802846-eab8-4e45-a367-291519d52ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:01.859066 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24802846-eab8-4e45-a367-291519d52ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:01.859341 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24802846-eab8-4e45-a367-291519d52ea0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:01.860049 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-2e5a4422-a0dd-4fce-afab-43e7cd838b3f None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:19:01.861251 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2e5a4422-a0dd-4fce-afab-43e7cd838b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:19:01.872031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:01.872481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24802846-eab8-4e45-a367-291519d52ea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:19:01.877882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-24802846-eab8-4e45-a367-291519d52ea0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:19:01.877882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:19:01.877882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:19:01.877882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:19:01.877882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:19:01.877882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:19:01.877882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:19:01.877882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:19:01.877882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:19:01.877882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:19:01.877882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:19:01.877882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:19:01.877882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:19:01.877882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:19:01.877882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:19:01.877882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:19:01.878833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:19:01.878833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:19:01.878833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:19:01.878833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:19:01.878833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:19:01.878833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:19:01.878833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:19:01.878833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:19:01.878833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:19:01.878833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:19:01.878833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:19:01.878833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:19:01.878833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:19:01.878833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:19:01.878833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:19:01.878833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:19:01.879668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:19:01.879668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:19:01.879668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:19:01.879668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:19:01.879668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:19:01.879668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:19:01.879668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:19:01.879668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:19:01.879668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:19:01.879668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:19:01.879668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:19:01.879668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:19:01.884134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 540/1063] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:19:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:19:01.884981 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24802846-eab8-4e45-a367-291519d52ea0 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:01.944174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 524/1064] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:19:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 02:19:01.965401 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a4422-a0dd-4fce-afab-43e7cd838b3f None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:01.982005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:01.992772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24802846-eab8-4e45-a367-291519d52ea0 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:02.031815 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389a0b2-8a67-4339-bb0e-a47c4766980f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:02.032738 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389a0b2-8a67-4339-bb0e-a47c4766980f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:02.033046 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389a0b2-8a67-4339-bb0e-a47c4766980f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:02.033595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389a0b2-8a67-4339-bb0e-a47c4766980f None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:02.034268 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389a0b2-8a67-4339-bb0e-a47c4766980f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:02.034579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389a0b2-8a67-4339-bb0e-a47c4766980f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:02.036123 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389a0b2-8a67-4339-bb0e-a47c4766980f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:02.046154 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 541/1065] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:19:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:02.051632 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389a0b2-8a67-4339-bb0e-a47c4766980f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:02.077467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a4422-a0dd-4fce-afab-43e7cd838b3f None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:02.114495 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1b0d8-f921-4958-97c1-3c84a69aa0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:02.115367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1b0d8-f921-4958-97c1-3c84a69aa0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:02.115654 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1b0d8-f921-4958-97c1-3c84a69aa0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:02.115932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1b0d8-f921-4958-97c1-3c84a69aa0d7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:02.126561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d1b0d8-f921-4958-97c1-3c84a69aa0d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:19:02.131269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-b4d1b0d8-f921-4958-97c1-3c84a69aa0d7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 02:19:02.131269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:19:02.131269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:19:02.131269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:19:02.131269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:19:02.131269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:19:02.131269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:19:02.131269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:19:02.131269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:19:02.131269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:19:02.131269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:19:02.131269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:19:02.131269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:19:02.131269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:19:02.131269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:19:02.131269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:19:02.132202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:19:02.132202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:19:02.132202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:19:02.132202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:19:02.132202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:19:02.132202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:19:02.132202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:19:02.132202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:19:02.132202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:19:02.132202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:19:02.132202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:19:02.132202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:19:02.132202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:19:02.132202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:19:02.132202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:19:02.132202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:19:02.133090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:19:02.133090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:19:02.133090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:19:02.133090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:19:02.133090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:19:02.133090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:19:02.133090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:19:02.133090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:19:02.133090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:19:02.133090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:19:02.133090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 02:19:02.133090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:19:02.137452 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 525/1066] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Aug 9 02:19:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:19:02.138649 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1b0d8-f921-4958-97c1-3c84a69aa0d7 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:02.144055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:02.159817 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389a0b2-8a67-4339-bb0e-a47c4766980f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:02.195663 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399fd92-7767-41b0-9ba8-7a0b0789a1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:02.196014 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399fd92-7767-41b0-9ba8-7a0b0789a1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:02.196290 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399fd92-7767-41b0-9ba8-7a0b0789a1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:02.196560 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399fd92-7767-41b0-9ba8-7a0b0789a1f9 None admin] PATH_INFO: `/v3/users/326eef9ed36146b19c3d0d2a657802dc` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:02.197725 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399fd92-7767-41b0-9ba8-7a0b0789a1f9 None admin] RBAC: Authorizing `identity:get_user(user_id=326eef9ed36146b19c3d0d2a657802dc)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:02.199127 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399fd92-7767-41b0-9ba8-7a0b0789a1f9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:02.200868 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 542/1067] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:19:02 2022] GET /identity/v3/users/326eef9ed36146b19c3d0d2a657802dc => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:19:02.206253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399fd92-7767-41b0-9ba8-7a0b0789a1f9 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:02.232265 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:02.263609 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1b0d8-f921-4958-97c1-3c84a69aa0d7 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:02.301374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96a788-6647-454e-a9e0-4d2a841d5bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:02.301979 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96a788-6647-454e-a9e0-4d2a841d5bec None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:02.302254 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96a788-6647-454e-a9e0-4d2a841d5bec None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:02.302524 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96a788-6647-454e-a9e0-4d2a841d5bec None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:02.303183 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96a788-6647-454e-a9e0-4d2a841d5bec None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:02.303483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96a788-6647-454e-a9e0-4d2a841d5bec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:02.305064 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96a788-6647-454e-a9e0-4d2a841d5bec None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:02.311844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399fd92-7767-41b0-9ba8-7a0b0789a1f9 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:02.313729 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 526/1068] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 9 02:19:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:02.319137 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96a788-6647-454e-a9e0-4d2a841d5bec None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:02.357682 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd896b1-1676-45ea-bd99-e78952ce78c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:02.358518 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd896b1-1676-45ea-bd99-e78952ce78c5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:02.359372 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd896b1-1676-45ea-bd99-e78952ce78c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:02.359802 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd896b1-1676-45ea-bd99-e78952ce78c5 None admin] PATH_INFO: `/v3/projects/b74ea3e96b9a4bfa92090f64b701aedf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:02.361466 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd896b1-1676-45ea-bd99-e78952ce78c5 None admin] RBAC: Authorizing `identity:get_project(project_id=b74ea3e96b9a4bfa92090f64b701aedf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:02.363887 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd896b1-1676-45ea-bd99-e78952ce78c5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:02.366282 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 543/1069] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:19:02 2022] GET /identity/v3/projects/b74ea3e96b9a4bfa92090f64b701aedf => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:19:02.372303 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd896b1-1676-45ea-bd99-e78952ce78c5 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:02.384889 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:02.419159 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96a788-6647-454e-a9e0-4d2a841d5bec None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:02.454041 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b55343-a6cc-4de4-b3cf-1467ae81c236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:02.454677 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b55343-a6cc-4de4-b3cf-1467ae81c236 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:02.454968 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b55343-a6cc-4de4-b3cf-1467ae81c236 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:02.455242 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b55343-a6cc-4de4-b3cf-1467ae81c236 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:02.466217 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b55343-a6cc-4de4-b3cf-1467ae81c236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:02.468264 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b55343-a6cc-4de4-b3cf-1467ae81c236 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:02.478876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:02.482374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-b9b55343-a6cc-4de4-b3cf-1467ae81c236 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:19:02.482374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:19:02.482374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:19:02.482374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:19:02.482374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:19:02.482374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:19:02.482374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:19:02.482374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:19:02.482374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:19:02.482374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:19:02.482374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:19:02.482374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:19:02.482374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:19:02.482374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:19:02.482374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:19:02.482374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:19:02.483569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:19:02.483569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:19:02.483569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:19:02.483569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:19:02.483569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:19:02.483569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:19:02.483569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:19:02.483569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:19:02.483569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:19:02.483569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:19:02.483569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:19:02.483569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:19:02.483569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:19:02.483569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:19:02.483569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:19:02.483569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:19:02.483569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:19:02.484439 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:19:02.484439 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:19:02.484439 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:19:02.490018 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 527/1070] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:19:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:19:02.490779 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b55343-a6cc-4de4-b3cf-1467ae81c236 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:02.493501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd896b1-1676-45ea-bd99-e78952ce78c5 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:02.529285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a7fc2-be1e-42ce-9c39-6d6f2a644cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:02.530545 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a7fc2-be1e-42ce-9c39-6d6f2a644cff None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:02.530826 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a7fc2-be1e-42ce-9c39-6d6f2a644cff None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:02.531095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a7fc2-be1e-42ce-9c39-6d6f2a644cff None admin] PATH_INFO: `/v3/projects/b74ea3e96b9a4bfa92090f64b701aedf/users/326eef9ed36146b19c3d0d2a657802dc/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:02.533042 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a7fc2-be1e-42ce-9c39-6d6f2a644cff None admin] RBAC: Authorizing `identity:create_grant(project_id=b74ea3e96b9a4bfa92090f64b701aedf, user_id=326eef9ed36146b19c3d0d2a657802dc, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:02.534479 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a7fc2-be1e-42ce-9c39-6d6f2a644cff None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:02.549085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 544/1071] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 9 02:19:02 2022] PUT /identity/v3/projects/b74ea3e96b9a4bfa92090f64b701aedf/users/326eef9ed36146b19c3d0d2a657802dc/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:19:02.603669 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b55343-a6cc-4de4-b3cf-1467ae81c236 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:02.623762 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:02.644308 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635c210-1baa-474b-8b8b-40c9e3e7581d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:02.644933 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635c210-1baa-474b-8b8b-40c9e3e7581d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:02.645244 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635c210-1baa-474b-8b8b-40c9e3e7581d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:02.645537 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635c210-1baa-474b-8b8b-40c9e3e7581d None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:02.646178 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635c210-1baa-474b-8b8b-40c9e3e7581d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:02.646483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635c210-1baa-474b-8b8b-40c9e3e7581d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:02.647866 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635c210-1baa-474b-8b8b-40c9e3e7581d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:02.661801 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 528/1072] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:19:02.667309 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a7fc2-be1e-42ce-9c39-6d6f2a644cff None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:02.779051 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a7fc2-be1e-42ce-9c39-6d6f2a644cff None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:02.812547 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb94edc-9b05-4daf-8b5a-3c04b2d2bedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:02.813200 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb94edc-9b05-4daf-8b5a-3c04b2d2bedc None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:02.813481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb94edc-9b05-4daf-8b5a-3c04b2d2bedc None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:02.813751 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb94edc-9b05-4daf-8b5a-3c04b2d2bedc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:02.821282 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb94edc-9b05-4daf-8b5a-3c04b2d2bedc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:02.822721 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb94edc-9b05-4daf-8b5a-3c04b2d2bedc None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:02.834261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-7bb94edc-9b05-4daf-8b5a-3c04b2d2bedc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 02:19:02.834261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:19:02.834261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:19:02.834261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:19:02.834261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:19:02.834261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:19:02.834261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:19:02.834261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:19:02.834261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:19:02.834261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:19:02.834261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:19:02.834261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:19:02.834261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:19:02.834261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:19:02.834261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:19:02.834261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:19:02.835393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:19:02.835393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:19:02.835393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:19:02.835393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:19:02.835393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:19:02.835393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:19:02.835393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:19:02.835393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:19:02.835393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:19:02.835393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:19:02.835393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:19:02.835393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:19:02.835393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:19:02.835393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:19:02.835393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:19:02.835393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:19:02.835393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:19:02.835393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:19:02.836551 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:19:02.836551 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:19:02.836551 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:19:02.836551 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:19:02.836551 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:19:02.836551 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:19:02.836551 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:19:02.836551 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:19:02.836551 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 02:19:02.836551 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:19:02.836551 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 545/1073] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 9 02:19:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:19:02.843122 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635c210-1baa-474b-8b8b-40c9e3e7581d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:02.943829 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635c210-1baa-474b-8b8b-40c9e3e7581d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:02.982612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a597b60-f246-45cd-9cb8-760bfdc56158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:02.983228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a597b60-f246-45cd-9cb8-760bfdc56158 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:02.983505 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a597b60-f246-45cd-9cb8-760bfdc56158 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:02.983775 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a597b60-f246-45cd-9cb8-760bfdc56158 None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:02.984508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a597b60-f246-45cd-9cb8-760bfdc56158 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:02.984827 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a597b60-f246-45cd-9cb8-760bfdc56158 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:02.986270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a597b60-f246-45cd-9cb8-760bfdc56158 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:03.005204 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 529/1074] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 9 02:19:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:03.010769 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb94edc-9b05-4daf-8b5a-3c04b2d2bedc None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:03.024266 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:03.073436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce041e7-bd46-440f-a4f8-1f147bcc8fdb None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:03.073719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce041e7-bd46-440f-a4f8-1f147bcc8fdb None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:03.073988 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce041e7-bd46-440f-a4f8-1f147bcc8fdb None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:03.075464 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 530/1075] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:19:03.080501 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6aa6b-9f58-49ef-934c-5c52edd6106b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:03.080878 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6aa6b-9f58-49ef-934c-5c52edd6106b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:03.081271 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6aa6b-9f58-49ef-934c-5c52edd6106b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:03.101662 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-9bc6aa6b-9f58-49ef-934c-5c52edd6106b None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:19:03.102850 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9bc6aa6b-9f58-49ef-934c-5c52edd6106b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:19:03.119071 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb94edc-9b05-4daf-8b5a-3c04b2d2bedc None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:03.133344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:03.154838 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba4a3a-7b4c-4d0e-9729-d36b1d4b1bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:03.155601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba4a3a-7b4c-4d0e-9729-d36b1d4b1bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:03.155976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba4a3a-7b4c-4d0e-9729-d36b1d4b1bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:03.156340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba4a3a-7b4c-4d0e-9729-d36b1d4b1bc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:03.169057 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba4a3a-7b4c-4d0e-9729-d36b1d4b1bc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:03.172189 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba4a3a-7b4c-4d0e-9729-d36b1d4b1bc5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:03.181077 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 531/1076] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:19:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 02:19:03.193664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-75ba4a3a-7b4c-4d0e-9729-d36b1d4b1bc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:19:03.193664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:19:03.193664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:19:03.193664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:19:03.193664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:19:03.193664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:19:03.193664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:19:03.193664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:19:03.193664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:19:03.193664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:19:03.193664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:19:03.193664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:19:03.193664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:19:03.193664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:19:03.193664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:19:03.193664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:19:03.194827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:19:03.194827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:19:03.194827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:19:03.194827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:19:03.194827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:19:03.194827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:19:03.194827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:19:03.194827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:19:03.194827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:19:03.194827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:19:03.194827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:19:03.194827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:19:03.194827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:19:03.194827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:19:03.194827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:19:03.194827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:19:03.194827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:19:03.195941 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:19:03.195941 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:19:03.195941 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:19:03.197103 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 546/1077] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:19:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:19:03.201126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6aa6b-9f58-49ef-934c-5c52edd6106b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:03.202619 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba4a3a-7b4c-4d0e-9729-d36b1d4b1bc5 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:03.265685 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:03.307976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba4a3a-7b4c-4d0e-9729-d36b1d4b1bc5 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:03.308986 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6aa6b-9f58-49ef-934c-5c52edd6106b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:03.345497 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252daef-0bcd-438f-a531-ad248d280920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:03.346108 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252daef-0bcd-438f-a531-ad248d280920 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:03.346389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252daef-0bcd-438f-a531-ad248d280920 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:03.346669 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252daef-0bcd-438f-a531-ad248d280920 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:03.346951 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ba43c-1335-42c4-b8e6-c506c41be451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:03.347838 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ba43c-1335-42c4-b8e6-c506c41be451 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:03.348311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ba43c-1335-42c4-b8e6-c506c41be451 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:03.348791 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ba43c-1335-42c4-b8e6-c506c41be451 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:03.349652 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ba43c-1335-42c4-b8e6-c506c41be451 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:03.350178 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ba43c-1335-42c4-b8e6-c506c41be451 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:03.351722 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ba43c-1335-42c4-b8e6-c506c41be451 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:03.364518 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 547/1078] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:19:03.370151 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ba43c-1335-42c4-b8e6-c506c41be451 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:03.383092 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:03.417202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252daef-0bcd-438f-a531-ad248d280920 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:03.418640 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252daef-0bcd-438f-a531-ad248d280920 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:03.476319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ba43c-1335-42c4-b8e6-c506c41be451 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:03.500304 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:03.516217 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db911b6-8a0c-4c2c-919f-504fb9fbf2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:03.516850 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db911b6-8a0c-4c2c-919f-504fb9fbf2ba None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:03.517190 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db911b6-8a0c-4c2c-919f-504fb9fbf2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:03.517460 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db911b6-8a0c-4c2c-919f-504fb9fbf2ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:03.529060 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 532/1079] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:19:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 02:19:03.530753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252daef-0bcd-438f-a531-ad248d280920 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:03.531491 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db911b6-8a0c-4c2c-919f-504fb9fbf2ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:03.533377 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db911b6-8a0c-4c2c-919f-504fb9fbf2ba None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:03.548648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-5db911b6-8a0c-4c2c-919f-504fb9fbf2ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:19:03.548648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:19:03.548648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:19:03.548648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:19:03.548648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:19:03.548648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:19:03.548648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:19:03.548648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:19:03.548648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:19:03.548648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:19:03.548648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:19:03.548648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:19:03.548648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:19:03.548648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:19:03.548648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:19:03.549599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:19:03.549599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:19:03.549599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:19:03.549599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:19:03.549599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:19:03.549599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:19:03.549599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:19:03.549599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:19:03.549599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:19:03.549599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:19:03.549599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:19:03.549599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:19:03.549599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:19:03.549599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:19:03.549599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:19:03.549599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:19:03.549599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:19:03.550491 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:19:03.550491 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:19:03.550491 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:19:03.550491 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:19:03.550491 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:19:03.550491 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:19:03.550491 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:19:03.550491 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:19:03.550919 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 548/1080] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:19:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:19:03.558039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db911b6-8a0c-4c2c-919f-504fb9fbf2ba None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:03.600947 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:03.640524 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252daef-0bcd-438f-a531-ad248d280920 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:03.669427 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db911b6-8a0c-4c2c-919f-504fb9fbf2ba None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:03.679218 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a192c9d-381b-4240-afdd-f34b68699ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:03.680216 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a192c9d-381b-4240-afdd-f34b68699ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:03.680498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a192c9d-381b-4240-afdd-f34b68699ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:03.680774 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a192c9d-381b-4240-afdd-f34b68699ce0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:03.691552 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a192c9d-381b-4240-afdd-f34b68699ce0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:03.692989 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a192c9d-381b-4240-afdd-f34b68699ce0 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:03.705127 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed245a22-0659-43a9-9697-980c92ffe76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:03.705727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed245a22-0659-43a9-9697-980c92ffe76e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:03.706006 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed245a22-0659-43a9-9697-980c92ffe76e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:03.706391 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed245a22-0659-43a9-9697-980c92ffe76e None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:03.707087 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed245a22-0659-43a9-9697-980c92ffe76e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:03.707390 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed245a22-0659-43a9-9697-980c92ffe76e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:03.708799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed245a22-0659-43a9-9697-980c92ffe76e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:03.709039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-9a192c9d-381b-4240-afdd-f34b68699ce0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:19:03.709039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:19:03.709039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:19:03.709039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:19:03.709039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:19:03.709039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:19:03.709039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:19:03.709039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:19:03.709039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:19:03.709039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:19:03.709039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:19:03.709039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:19:03.709039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:19:03.709039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:19:03.709039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:19:03.709039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:19:03.709951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:19:03.709951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:19:03.709951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:19:03.709951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:19:03.709951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:19:03.709951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:19:03.709951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:19:03.709951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:19:03.709951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:19:03.709951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:19:03.709951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:19:03.709951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:19:03.709951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:19:03.709951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:19:03.709951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:19:03.709951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:19:03.709951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:19:03.711040 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:19:03.711040 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:19:03.711040 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:19:03.711040 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 533/1081] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:19:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:19:03.715941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a192c9d-381b-4240-afdd-f34b68699ce0 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:03.729509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 549/1082] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:19:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:03.731274 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed245a22-0659-43a9-9697-980c92ffe76e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:03.774920 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:03.827587 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a192c9d-381b-4240-afdd-f34b68699ce0 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:03.834691 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed245a22-0659-43a9-9697-980c92ffe76e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:03.846830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:03.866463 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed6e49-bdea-4f92-bedb-09baf7354d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:03.867063 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed6e49-bdea-4f92-bedb-09baf7354d2f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:03.867340 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed6e49-bdea-4f92-bedb-09baf7354d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:03.867607 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed6e49-bdea-4f92-bedb-09baf7354d2f None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:03.868240 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed6e49-bdea-4f92-bedb-09baf7354d2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:03.868545 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed6e49-bdea-4f92-bedb-09baf7354d2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:03.869069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc40c0-9a84-489a-953e-cb016e32c3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:03.869723 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc40c0-9a84-489a-953e-cb016e32c3ea None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:03.869928 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed6e49-bdea-4f92-bedb-09baf7354d2f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:03.870039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc40c0-9a84-489a-953e-cb016e32c3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:03.870257 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc40c0-9a84-489a-953e-cb016e32c3ea None admin] PATH_INFO: `/v3/projects/105476dcda7f48c28224d33c05860d6f/users/78fff294b9794a26aa1bbc231fa1133c/roles/78bcb32d82b5450992ffa64fd7350353` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:03.873308 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc40c0-9a84-489a-953e-cb016e32c3ea None admin] RBAC: Authorizing `identity:create_grant(project_id=105476dcda7f48c28224d33c05860d6f, user_id=78fff294b9794a26aa1bbc231fa1133c, role_id=78bcb32d82b5450992ffa64fd7350353)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:03.874788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc40c0-9a84-489a-953e-cb016e32c3ea None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:03.893048 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 534/1083] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:19:03.899267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 550/1084] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 9 02:19:03 2022] PUT /identity/v3/projects/105476dcda7f48c28224d33c05860d6f/users/78fff294b9794a26aa1bbc231fa1133c/roles/78bcb32d82b5450992ffa64fd7350353 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:19:04.570537 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d8048-7df1-41f6-9d95-dc91c9e39483 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:04.570833 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d8048-7df1-41f6-9d95-dc91c9e39483 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:04.571103 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d8048-7df1-41f6-9d95-dc91c9e39483 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:04.572503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 535/1085] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:19:04.578126 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098c8ca-bd7f-4e62-8507-32d5e45e87bd None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:04.578491 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098c8ca-bd7f-4e62-8507-32d5e45e87bd None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:04.578835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098c8ca-bd7f-4e62-8507-32d5e45e87bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:04.596616 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5098c8ca-bd7f-4e62-8507-32d5e45e87bd None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:19:04.597826 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5098c8ca-bd7f-4e62-8507-32d5e45e87bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:19:04.663720 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 551/1086] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:19:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:19:04.687470 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d8048-7df1-41f6-9d95-dc91c9e39483 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:04.785079 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d8048-7df1-41f6-9d95-dc91c9e39483 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:04.818198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f04350-c0f9-43bb-a684-a4d74ebcd27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:04.818812 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f04350-c0f9-43bb-a684-a4d74ebcd27f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:04.819093 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f04350-c0f9-43bb-a684-a4d74ebcd27f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:04.819365 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f04350-c0f9-43bb-a684-a4d74ebcd27f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:04.829237 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f04350-c0f9-43bb-a684-a4d74ebcd27f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:19:04.833880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-d0f04350-c0f9-43bb-a684-a4d74ebcd27f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:19:04.833880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:19:04.833880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:19:04.833880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:19:04.833880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:19:04.833880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:19:04.833880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:19:04.833880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:19:04.833880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:19:04.833880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:19:04.833880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:19:04.833880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:19:04.833880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:19:04.833880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:19:04.833880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:19:04.833880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:19:04.834966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:19:04.834966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:19:04.834966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:19:04.834966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:19:04.834966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:19:04.834966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:19:04.834966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:19:04.834966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:19:04.834966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:19:04.834966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:19:04.834966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:19:04.834966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:19:04.834966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:19:04.834966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:19:04.834966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:19:04.834966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:19:04.835821 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:19:04.835821 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:19:04.835821 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:19:04.835821 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:19:04.835821 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:19:04.835821 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:19:04.835821 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:19:04.835821 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:19:04.835821 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:19:04.835821 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:19:04.835821 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:19:04.835821 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:19:04.835821 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 536/1087] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:19:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:19:04.840792 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098c8ca-bd7f-4e62-8507-32d5e45e87bd None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:04.874310 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:04.942978 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098c8ca-bd7f-4e62-8507-32d5e45e87bd None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:04.979867 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb333e3-589c-4aa4-89b0-b313b31b9832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:04.980345 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb333e3-589c-4aa4-89b0-b313b31b9832 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:04.980624 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb333e3-589c-4aa4-89b0-b313b31b9832 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:04.980897 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb333e3-589c-4aa4-89b0-b313b31b9832 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:04.981594 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb333e3-589c-4aa4-89b0-b313b31b9832 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:04.981935 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb333e3-589c-4aa4-89b0-b313b31b9832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:04.983943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb333e3-589c-4aa4-89b0-b313b31b9832 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:04.992645 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 552/1088] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:19:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:04.998179 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f04350-c0f9-43bb-a684-a4d74ebcd27f None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:05.038457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:05.096802 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f04350-c0f9-43bb-a684-a4d74ebcd27f None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:05.129819 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3fcd8-a38e-41c4-933e-c39f81facb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:05.130477 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3fcd8-a38e-41c4-933e-c39f81facb94 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:05.130762 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3fcd8-a38e-41c4-933e-c39f81facb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:05.131039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3fcd8-a38e-41c4-933e-c39f81facb94 None admin] PATH_INFO: `/v3/users/326eef9ed36146b19c3d0d2a657802dc` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:05.132178 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3fcd8-a38e-41c4-933e-c39f81facb94 None admin] RBAC: Authorizing `identity:get_user(user_id=326eef9ed36146b19c3d0d2a657802dc)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:05.133647 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3fcd8-a38e-41c4-933e-c39f81facb94 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:05.135253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 537/1089] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:19:04 2022] GET /identity/v3/users/326eef9ed36146b19c3d0d2a657802dc => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:05.141069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb333e3-589c-4aa4-89b0-b313b31b9832 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:05.236792 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:05.244085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb333e3-589c-4aa4-89b0-b313b31b9832 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:05.275857 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c18cc-42e1-4044-895d-84f4bc5d421c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:05.276451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c18cc-42e1-4044-895d-84f4bc5d421c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:05.276728 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c18cc-42e1-4044-895d-84f4bc5d421c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:05.276995 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c18cc-42e1-4044-895d-84f4bc5d421c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:05.343101 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c18cc-42e1-4044-895d-84f4bc5d421c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:05.344534 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c18cc-42e1-4044-895d-84f4bc5d421c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:05.433893 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:05.441413 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 553/1090] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:19:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 02:19:05.447202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3fcd8-a38e-41c4-933e-c39f81facb94 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:05.546846 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3fcd8-a38e-41c4-933e-c39f81facb94 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:05.554023 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:05.581222 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d69694-248d-4962-8f64-2c8e48a10246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:05.581846 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d69694-248d-4962-8f64-2c8e48a10246 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:05.582123 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d69694-248d-4962-8f64-2c8e48a10246 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:05.582390 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d69694-248d-4962-8f64-2c8e48a10246 None admin] PATH_INFO: `/v3/projects/b74ea3e96b9a4bfa92090f64b701aedf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:05.583490 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d69694-248d-4962-8f64-2c8e48a10246 None admin] RBAC: Authorizing `identity:get_project(project_id=b74ea3e96b9a4bfa92090f64b701aedf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:05.584902 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d69694-248d-4962-8f64-2c8e48a10246 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:05.586570 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 538/1091] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:19:05 2022] GET /identity/v3/projects/b74ea3e96b9a4bfa92090f64b701aedf => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:19:05.593193 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c18cc-42e1-4044-895d-84f4bc5d421c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:05.688742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c18cc-42e1-4044-895d-84f4bc5d421c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:05.722124 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7fb3d-4ddf-4f63-a237-2ff4ab4e0f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:05.722720 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7fb3d-4ddf-4f63-a237-2ff4ab4e0f3b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:05.722995 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7fb3d-4ddf-4f63-a237-2ff4ab4e0f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:05.723262 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7fb3d-4ddf-4f63-a237-2ff4ab4e0f3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:05.723971 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7fb3d-4ddf-4f63-a237-2ff4ab4e0f3b None admin] RBAC: Adding query filter params (role.id=e2095c5a29d74c33b9dcb16f8e5343bf, scope.project.id=b74ea3e96b9a4bfa92090f64b701aedf, user.id=326eef9ed36146b19c3d0d2a657802dc) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:05.724272 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7fb3d-4ddf-4f63-a237-2ff4ab4e0f3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:05.725714 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7fb3d-4ddf-4f63-a237-2ff4ab4e0f3b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:05.731260 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 554/1092] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:19:05 2022] GET /identity/v3/role_assignments?user.id=326eef9ed36146b19c3d0d2a657802dc&scope.project.id=b74ea3e96b9a4bfa92090f64b701aedf&role.id=e2095c5a29d74c33b9dcb16f8e5343bf => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:05.930064 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8130d8b-7374-474d-862d-d30f63c80bcb None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:05.930594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8130d8b-7374-474d-862d-d30f63c80bcb None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:05.930594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8130d8b-7374-474d-862d-d30f63c80bcb None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:05.931969 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 539/1093] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:19:05.937629 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a6eed-c078-4699-88e1-2f7922d65728 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:05.938015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a6eed-c078-4699-88e1-2f7922d65728 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:05.938255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a6eed-c078-4699-88e1-2f7922d65728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:05.956783 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7e2a6eed-c078-4699-88e1-2f7922d65728 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:19:05.957935 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7e2a6eed-c078-4699-88e1-2f7922d65728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:19:06.015270 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:06.028900 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 555/1094] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:19:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 02:19:06.051498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8130d8b-7374-474d-862d-d30f63c80bcb None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:06.152023 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8130d8b-7374-474d-862d-d30f63c80bcb None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:06.186437 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99ebdc-7eaa-4a9b-8ba2-480091a0de1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:06.187066 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99ebdc-7eaa-4a9b-8ba2-480091a0de1b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:06.187347 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99ebdc-7eaa-4a9b-8ba2-480091a0de1b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:06.187619 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99ebdc-7eaa-4a9b-8ba2-480091a0de1b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:06.197491 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99ebdc-7eaa-4a9b-8ba2-480091a0de1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:19:06.202215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-eb99ebdc-7eaa-4a9b-8ba2-480091a0de1b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 02:19:06.202215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:19:06.202215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:19:06.202215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:19:06.202215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:19:06.202215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:19:06.202215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:19:06.202215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:19:06.202215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:19:06.202215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:19:06.202215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:19:06.202215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:19:06.202215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:19:06.202215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:19:06.202215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:19:06.202215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:19:06.203219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:19:06.203219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:19:06.203219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:19:06.203219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:19:06.203219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:19:06.203219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:19:06.203219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:19:06.203219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:19:06.203219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:19:06.203219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:19:06.203219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:19:06.203219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:19:06.203219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:19:06.203219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:19:06.203219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:19:06.203219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:19:06.204072 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:19:06.204072 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:19:06.204072 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:19:06.204072 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:19:06.204072 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:19:06.204072 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:19:06.204072 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:19:06.204072 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:19:06.204072 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:19:06.204072 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:19:06.204072 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 02:19:06.204072 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:19:06.204072 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 540/1095] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Aug 9 02:19:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:19:06.210353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a6eed-c078-4699-88e1-2f7922d65728 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:06.306164 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a6eed-c078-4699-88e1-2f7922d65728 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:06.338790 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54464c86-a840-4e37-9cdd-3b91e69ef2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:06.339385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54464c86-a840-4e37-9cdd-3b91e69ef2d3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:06.339660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54464c86-a840-4e37-9cdd-3b91e69ef2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:06.339928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54464c86-a840-4e37-9cdd-3b91e69ef2d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:06.340585 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54464c86-a840-4e37-9cdd-3b91e69ef2d3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:06.340887 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54464c86-a840-4e37-9cdd-3b91e69ef2d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:06.342300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54464c86-a840-4e37-9cdd-3b91e69ef2d3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:06.350020 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 556/1096] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 9 02:19:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:06.355685 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99ebdc-7eaa-4a9b-8ba2-480091a0de1b None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:06.391150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:06.455924 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99ebdc-7eaa-4a9b-8ba2-480091a0de1b None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:06.488960 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1747e3-edd8-453b-a3a7-67b6f2a48300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:06.489538 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1747e3-edd8-453b-a3a7-67b6f2a48300 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:06.489815 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1747e3-edd8-453b-a3a7-67b6f2a48300 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:06.490080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1747e3-edd8-453b-a3a7-67b6f2a48300 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:06.500335 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1747e3-edd8-453b-a3a7-67b6f2a48300 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:06.501787 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1747e3-edd8-453b-a3a7-67b6f2a48300 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:06.515073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-3b1747e3-edd8-453b-a3a7-67b6f2a48300 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:19:06.515073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:19:06.515073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:19:06.515073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:19:06.515073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:19:06.515073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:19:06.515073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:19:06.515073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:19:06.515073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:19:06.515073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:19:06.515073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:19:06.515073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:19:06.515073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:19:06.515073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:19:06.515073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:19:06.515073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:19:06.516506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:19:06.516506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:19:06.516506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:19:06.516506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:19:06.516506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:19:06.516506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:19:06.516506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:19:06.516506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:19:06.516506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:19:06.516506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:19:06.516506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:19:06.516506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:19:06.516506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:19:06.516506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:19:06.516506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:19:06.516506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:19:06.516506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:19:06.517433 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:19:06.517433 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:19:06.517433 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:19:06.517433 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 541/1097] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:19:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:19:06.523000 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54464c86-a840-4e37-9cdd-3b91e69ef2d3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:06.572764 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:06.622006 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54464c86-a840-4e37-9cdd-3b91e69ef2d3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:06.653797 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91451c2a-157a-42a7-afb8-260fd7e119b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:06.654897 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91451c2a-157a-42a7-afb8-260fd7e119b1 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:06.655173 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91451c2a-157a-42a7-afb8-260fd7e119b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:06.655441 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91451c2a-157a-42a7-afb8-260fd7e119b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:06.656075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91451c2a-157a-42a7-afb8-260fd7e119b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:06.656376 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91451c2a-157a-42a7-afb8-260fd7e119b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:06.657759 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91451c2a-157a-42a7-afb8-260fd7e119b1 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:06.668949 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 557/1098] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:06.675366 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1747e3-edd8-453b-a3a7-67b6f2a48300 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:06.756795 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:06.771369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1747e3-edd8-453b-a3a7-67b6f2a48300 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:06.804320 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e761735-0828-4944-b29d-9c4ca57f994e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:06.804940 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e761735-0828-4944-b29d-9c4ca57f994e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:06.805249 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e761735-0828-4944-b29d-9c4ca57f994e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:06.805520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e761735-0828-4944-b29d-9c4ca57f994e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:06.812836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e761735-0828-4944-b29d-9c4ca57f994e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:06.814305 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e761735-0828-4944-b29d-9c4ca57f994e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:06.825056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-0e761735-0828-4944-b29d-9c4ca57f994e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 02:19:06.825056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:19:06.825056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:19:06.825056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:19:06.825056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:19:06.825056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:19:06.825056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:19:06.825056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:19:06.825056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:19:06.825056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:19:06.825056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:19:06.825056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:19:06.825056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:19:06.825056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:19:06.825056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:19:06.825056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:19:06.826679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:19:06.826679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:19:06.826679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:19:06.826679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:19:06.826679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:19:06.826679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:19:06.826679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:19:06.826679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:19:06.826679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:19:06.826679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:19:06.826679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:19:06.826679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:19:06.826679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:19:06.826679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:19:06.826679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:19:06.826679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:19:06.826679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:19:06.826679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:19:06.827946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:19:06.827946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:19:06.827946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:19:06.827946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:19:06.827946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:19:06.827946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:19:06.827946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:19:06.827946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:19:06.827946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 02:19:06.827946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:19:06.827946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 542/1099] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 9 02:19:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:19:06.832370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91451c2a-157a-42a7-afb8-260fd7e119b1 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:06.931112 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91451c2a-157a-42a7-afb8-260fd7e119b1 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:06.941783 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:06.965240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc6e24-9f8b-40b9-ae5e-6ec9c23fa3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:06.965842 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc6e24-9f8b-40b9-ae5e-6ec9c23fa3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:06.966122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc6e24-9f8b-40b9-ae5e-6ec9c23fa3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:06.966394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc6e24-9f8b-40b9-ae5e-6ec9c23fa3f2 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:06.967718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc6e24-9f8b-40b9-ae5e-6ec9c23fa3f2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:06.968024 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc6e24-9f8b-40b9-ae5e-6ec9c23fa3f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:06.969486 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc6e24-9f8b-40b9-ae5e-6ec9c23fa3f2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:06.987747 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 558/1100] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 9 02:19:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:06.993680 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e761735-0828-4944-b29d-9c4ca57f994e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:07.089417 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e761735-0828-4944-b29d-9c4ca57f994e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:07.121569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6f406-34cb-4251-88ef-cd5d10325098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:07.122156 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6f406-34cb-4251-88ef-cd5d10325098 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:07.122432 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6f406-34cb-4251-88ef-cd5d10325098 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:07.122699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6f406-34cb-4251-88ef-cd5d10325098 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:07.140000 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:07.192427 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6f406-34cb-4251-88ef-cd5d10325098 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:07.193924 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6f406-34cb-4251-88ef-cd5d10325098 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:07.289176 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 543/1101] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:19:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 02:19:07.294961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc6e24-9f8b-40b9-ae5e-6ec9c23fa3f2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:07.394207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc6e24-9f8b-40b9-ae5e-6ec9c23fa3f2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:07.426736 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b926462-656d-4c0b-96b1-e4bd9548c1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:07.427367 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b926462-656d-4c0b-96b1-e4bd9548c1ea None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:07.427649 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b926462-656d-4c0b-96b1-e4bd9548c1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:07.427924 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b926462-656d-4c0b-96b1-e4bd9548c1ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:07.440290 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b926462-656d-4c0b-96b1-e4bd9548c1ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:07.443085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b926462-656d-4c0b-96b1-e4bd9548c1ea None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:07.458498 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-3b926462-656d-4c0b-96b1-e4bd9548c1ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:19:07.458498 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:19:07.458498 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:19:07.458498 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:19:07.458498 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:19:07.458498 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:19:07.458498 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:19:07.458498 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:19:07.458498 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:19:07.458498 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:19:07.458498 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:19:07.458498 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:19:07.458498 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:19:07.458498 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:19:07.458498 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:19:07.458498 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:19:07.459550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:19:07.459550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:19:07.459550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:19:07.459550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:19:07.459550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:19:07.459550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:19:07.459550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:19:07.459550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:19:07.459550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:19:07.459550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:19:07.459550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:19:07.459550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:19:07.459550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:19:07.459550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:19:07.459550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:19:07.459550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:19:07.459550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:19:07.460456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:19:07.460456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:19:07.460456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:19:07.464333 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 559/1102] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:19:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:19:07.465262 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6f406-34cb-4251-88ef-cd5d10325098 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:07.510875 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:07.562557 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6f406-34cb-4251-88ef-cd5d10325098 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:07.595450 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32105d9e-d0ab-4695-aa1f-564d9ab00bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:07.596055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32105d9e-d0ab-4695-aa1f-564d9ab00bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:07.596336 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32105d9e-d0ab-4695-aa1f-564d9ab00bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:07.596611 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32105d9e-d0ab-4695-aa1f-564d9ab00bd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:07.597292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32105d9e-d0ab-4695-aa1f-564d9ab00bd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:07.597600 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32105d9e-d0ab-4695-aa1f-564d9ab00bd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:07.598958 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32105d9e-d0ab-4695-aa1f-564d9ab00bd1 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:07.610839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 544/1103] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:07.616672 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b926462-656d-4c0b-96b1-e4bd9548c1ea None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:07.639211 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:07.715083 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b926462-656d-4c0b-96b1-e4bd9548c1ea None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:07.736059 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64619c71-7066-4650-8d47-abd4a411bb75 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:07.736342 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64619c71-7066-4650-8d47-abd4a411bb75 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:07.736618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64619c71-7066-4650-8d47-abd4a411bb75 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:07.738010 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 545/1104] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:19:07.743233 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f95fd9-a5e5-4c72-bb77-554650968e0e None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:07.743519 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f95fd9-a5e5-4c72-bb77-554650968e0e None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:07.743795 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f95fd9-a5e5-4c72-bb77-554650968e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:07.750071 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e15c2a-4dfb-45d7-9ff8-ef93fa02fcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:07.750700 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e15c2a-4dfb-45d7-9ff8-ef93fa02fcec None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:07.750979 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e15c2a-4dfb-45d7-9ff8-ef93fa02fcec None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:07.751977 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e15c2a-4dfb-45d7-9ff8-ef93fa02fcec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:07.757900 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e15c2a-4dfb-45d7-9ff8-ef93fa02fcec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:07.759326 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e15c2a-4dfb-45d7-9ff8-ef93fa02fcec None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:07.761792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a4f95fd9-a5e5-4c72-bb77-554650968e0e None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:19:07.763002 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a4f95fd9-a5e5-4c72-bb77-554650968e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:19:07.770296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-44e15c2a-4dfb-45d7-9ff8-ef93fa02fcec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:19:07.770296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:19:07.770296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:19:07.770296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:19:07.770296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:19:07.770296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:19:07.770296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:19:07.770296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:19:07.770296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:19:07.770296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:19:07.770296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:19:07.770296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:19:07.770296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:19:07.770296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:19:07.770296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:19:07.771312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:19:07.771312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:19:07.771312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:19:07.771312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:19:07.771312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:19:07.771312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:19:07.771312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:19:07.771312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:19:07.771312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:19:07.771312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:19:07.771312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:19:07.771312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:19:07.771312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:19:07.771312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:19:07.771312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:19:07.771312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:19:07.771312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:19:07.772205 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:19:07.772205 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:19:07.772205 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:19:07.772205 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:19:07.772205 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:19:07.772205 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:19:07.772205 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:19:07.772205 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:19:07.772205 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 560/1105] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:19:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:19:07.777052 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e15c2a-4dfb-45d7-9ff8-ef93fa02fcec None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:07.829077 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 546/1106] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:19:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 02:19:07.852848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f95fd9-a5e5-4c72-bb77-554650968e0e None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:07.857059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:07.877843 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e15c2a-4dfb-45d7-9ff8-ef93fa02fcec None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:07.887237 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:07.910577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a038f92-9656-49ec-99e2-852adda4e615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:07.911172 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a038f92-9656-49ec-99e2-852adda4e615 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:07.911447 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a038f92-9656-49ec-99e2-852adda4e615 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:07.911713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a038f92-9656-49ec-99e2-852adda4e615 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:07.912395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a038f92-9656-49ec-99e2-852adda4e615 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:07.912696 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a038f92-9656-49ec-99e2-852adda4e615 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:07.914149 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a038f92-9656-49ec-99e2-852adda4e615 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:07.926285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 561/1107] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:19:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:19:07.931980 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a038f92-9656-49ec-99e2-852adda4e615 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:07.952081 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f95fd9-a5e5-4c72-bb77-554650968e0e None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:07.988789 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c4185-7c3b-4920-8ee4-17ef23b5a038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:07.989459 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c4185-7c3b-4920-8ee4-17ef23b5a038 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:07.989738 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c4185-7c3b-4920-8ee4-17ef23b5a038 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:07.990011 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c4185-7c3b-4920-8ee4-17ef23b5a038 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:07.991125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c4185-7c3b-4920-8ee4-17ef23b5a038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:07.992551 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c4185-7c3b-4920-8ee4-17ef23b5a038 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:07.994168 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 547/1108] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:19:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:08.000021 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c4185-7c3b-4920-8ee4-17ef23b5a038 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:08.030931 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a038f92-9656-49ec-99e2-852adda4e615 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:08.064641 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc30c8b-598f-4ea4-83f3-89918641b242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:08.065272 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc30c8b-598f-4ea4-83f3-89918641b242 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:08.065561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc30c8b-598f-4ea4-83f3-89918641b242 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:08.065833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc30c8b-598f-4ea4-83f3-89918641b242 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:08.066562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc30c8b-598f-4ea4-83f3-89918641b242 None admin] RBAC: Adding query filter params (role.id=78bcb32d82b5450992ffa64fd7350353, scope.project.id=105476dcda7f48c28224d33c05860d6f, user.id=78fff294b9794a26aa1bbc231fa1133c) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:08.066875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc30c8b-598f-4ea4-83f3-89918641b242 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:08.068300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc30c8b-598f-4ea4-83f3-89918641b242 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:08.073951 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 562/1109] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:19:07 2022] GET /identity/v3/role_assignments?user.id=78fff294b9794a26aa1bbc231fa1133c&scope.project.id=105476dcda7f48c28224d33c05860d6f&role.id=78bcb32d82b5450992ffa64fd7350353 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:19:08.098034 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c4185-7c3b-4920-8ee4-17ef23b5a038 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:08.100634 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:08.135391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd86d9-5f70-497b-bad8-7f4bd02a239c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:08.136010 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd86d9-5f70-497b-bad8-7f4bd02a239c None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:08.136294 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd86d9-5f70-497b-bad8-7f4bd02a239c None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:08.136567 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd86d9-5f70-497b-bad8-7f4bd02a239c None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:08.137258 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd86d9-5f70-497b-bad8-7f4bd02a239c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:08.138779 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd86d9-5f70-497b-bad8-7f4bd02a239c None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:08.173059 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 548/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 9 02:19:07 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:19:10.198790 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f042f-dd00-4059-a3c8-9713f6bb5d9b None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:10.199296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f042f-dd00-4059-a3c8-9713f6bb5d9b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:10.199387 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f042f-dd00-4059-a3c8-9713f6bb5d9b None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:10.200883 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 563/1111] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:19:10.205855 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08229d97-1958-4288-97b3-0389d2fd3dc3 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:10.206272 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08229d97-1958-4288-97b3-0389d2fd3dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:10.206406 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08229d97-1958-4288-97b3-0389d2fd3dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:10.224403 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-08229d97-1958-4288-97b3-0389d2fd3dc3 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:19:10.225614 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-08229d97-1958-4288-97b3-0389d2fd3dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:19:10.289885 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 549/1112] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:19:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:19:10.313035 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f042f-dd00-4059-a3c8-9713f6bb5d9b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:10.316779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:10.413124 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f042f-dd00-4059-a3c8-9713f6bb5d9b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:10.445536 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48e2ef-f82e-4524-a18e-90bbc3f69515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:10.446148 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48e2ef-f82e-4524-a18e-90bbc3f69515 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:10.446426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48e2ef-f82e-4524-a18e-90bbc3f69515 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:10.446696 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48e2ef-f82e-4524-a18e-90bbc3f69515 None admin] PATH_INFO: `/v3/roles/680e2c06ab714158b756dc317a3f4e2e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:10.448071 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48e2ef-f82e-4524-a18e-90bbc3f69515 None admin] RBAC: Authorizing `identity:get_role(role_id=680e2c06ab714158b756dc317a3f4e2e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:10.449459 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48e2ef-f82e-4524-a18e-90bbc3f69515 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:10.450783 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 564/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:19:10 2022] GET /identity/v3/roles/680e2c06ab714158b756dc317a3f4e2e => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:10.456497 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08229d97-1958-4288-97b3-0389d2fd3dc3 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:10.546498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:10.556680 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08229d97-1958-4288-97b3-0389d2fd3dc3 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:10.589579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c1f38-21d5-4c0b-a200-d21dd661e793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:10.590198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c1f38-21d5-4c0b-a200-d21dd661e793 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:10.590479 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c1f38-21d5-4c0b-a200-d21dd661e793 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:10.590750 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c1f38-21d5-4c0b-a200-d21dd661e793 None admin] PATH_INFO: `/v3/users/1118dc5e58334634a70ae76ae0a083b8` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:10.604298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c1f38-21d5-4c0b-a200-d21dd661e793 None admin] RBAC: Authorizing `identity:get_user(user_id=1118dc5e58334634a70ae76ae0a083b8)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:10.605759 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c1f38-21d5-4c0b-a200-d21dd661e793 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:10.607374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 550/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:19:10 2022] GET /identity/v3/users/1118dc5e58334634a70ae76ae0a083b8 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:10.613538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48e2ef-f82e-4524-a18e-90bbc3f69515 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:10.682595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:10.711316 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48e2ef-f82e-4524-a18e-90bbc3f69515 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:10.743439 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80368127-1a13-444c-a5b2-d8ebc7a3fcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:10.744026 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80368127-1a13-444c-a5b2-d8ebc7a3fcde None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:10.744301 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80368127-1a13-444c-a5b2-d8ebc7a3fcde None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:10.744566 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80368127-1a13-444c-a5b2-d8ebc7a3fcde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:10.814559 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80368127-1a13-444c-a5b2-d8ebc7a3fcde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:10.815917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80368127-1a13-444c-a5b2-d8ebc7a3fcde None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:10.881159 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:10.911071 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 565/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:19:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 02:19:10.916964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c1f38-21d5-4c0b-a200-d21dd661e793 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:11.015049 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c1f38-21d5-4c0b-a200-d21dd661e793 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:11.046845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3150ec-babf-432b-94ae-20cc09e08c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:11.047467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3150ec-babf-432b-94ae-20cc09e08c4d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:11.047746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3150ec-babf-432b-94ae-20cc09e08c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:11.048015 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3150ec-babf-432b-94ae-20cc09e08c4d None admin] PATH_INFO: `/v3/projects/b74ea3e96b9a4bfa92090f64b701aedf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:11.049134 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3150ec-babf-432b-94ae-20cc09e08c4d None admin] RBAC: Authorizing `identity:get_project(project_id=b74ea3e96b9a4bfa92090f64b701aedf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:11.050555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3150ec-babf-432b-94ae-20cc09e08c4d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:11.052172 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 551/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:19:10 2022] GET /identity/v3/projects/b74ea3e96b9a4bfa92090f64b701aedf => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:11.058191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80368127-1a13-444c-a5b2-d8ebc7a3fcde None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:11.157165 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80368127-1a13-444c-a5b2-d8ebc7a3fcde None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:11.189736 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af1bc9-a21e-493c-839d-f9b92898ad68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:11.190319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af1bc9-a21e-493c-839d-f9b92898ad68 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:11.190596 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af1bc9-a21e-493c-839d-f9b92898ad68 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:11.190866 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af1bc9-a21e-493c-839d-f9b92898ad68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:11.191574 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af1bc9-a21e-493c-839d-f9b92898ad68 None admin] RBAC: Adding query filter params (role.id=680e2c06ab714158b756dc317a3f4e2e, scope.project.id=b74ea3e96b9a4bfa92090f64b701aedf, user.id=1118dc5e58334634a70ae76ae0a083b8) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:11.191876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af1bc9-a21e-493c-839d-f9b92898ad68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:11.193306 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af1bc9-a21e-493c-839d-f9b92898ad68 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:11.198461 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 566/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:19:11 2022] GET /identity/v3/role_assignments?user.id=1118dc5e58334634a70ae76ae0a083b8&scope.project.id=b74ea3e96b9a4bfa92090f64b701aedf&role.id=680e2c06ab714158b756dc317a3f4e2e => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:13.128905 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49656656-f47c-4f57-ba0d-65cac288f9e6 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:13.129477 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49656656-f47c-4f57-ba0d-65cac288f9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:13.129477 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49656656-f47c-4f57-ba0d-65cac288f9e6 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:13.130801 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 552/1118] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:19:13.135886 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feae51-85b4-4802-b0d4-ec92628ccc5c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:13.136287 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feae51-85b4-4802-b0d4-ec92628ccc5c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:13.136483 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7feae51-85b4-4802-b0d4-ec92628ccc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:13.154215 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a7feae51-85b4-4802-b0d4-ec92628ccc5c None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:19:13.155404 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a7feae51-85b4-4802-b0d4-ec92628ccc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:19:13.183567 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:13.221799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 567/1119] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:19:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:19:13.244541 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49656656-f47c-4f57-ba0d-65cac288f9e6 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:13.262080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:13.343500 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49656656-f47c-4f57-ba0d-65cac288f9e6 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:13.376344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d9a55-7e38-4a37-91d7-fd35b0d2b704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:13.376959 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d9a55-7e38-4a37-91d7-fd35b0d2b704 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:13.377586 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d9a55-7e38-4a37-91d7-fd35b0d2b704 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:13.377586 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d9a55-7e38-4a37-91d7-fd35b0d2b704 None admin] PATH_INFO: `/v3/roles/680e2c06ab714158b756dc317a3f4e2e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:13.379147 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d9a55-7e38-4a37-91d7-fd35b0d2b704 None admin] RBAC: Authorizing `identity:get_role(role_id=680e2c06ab714158b756dc317a3f4e2e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:13.380516 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d9a55-7e38-4a37-91d7-fd35b0d2b704 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:13.381876 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 553/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:19:13 2022] GET /identity/v3/roles/680e2c06ab714158b756dc317a3f4e2e => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:13.387451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7feae51-85b4-4802-b0d4-ec92628ccc5c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:13.490154 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7feae51-85b4-4802-b0d4-ec92628ccc5c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:13.522553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f03f49-f988-47bd-9395-9fd7fa436521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:13.523117 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f03f49-f988-47bd-9395-9fd7fa436521 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:13.523392 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f03f49-f988-47bd-9395-9fd7fa436521 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:13.523658 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f03f49-f988-47bd-9395-9fd7fa436521 None admin] PATH_INFO: `/v3/users/1118dc5e58334634a70ae76ae0a083b8` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:13.524752 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f03f49-f988-47bd-9395-9fd7fa436521 None admin] RBAC: Authorizing `identity:get_user(user_id=1118dc5e58334634a70ae76ae0a083b8)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:13.526197 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f03f49-f988-47bd-9395-9fd7fa436521 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:13.527790 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 568/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:19:13 2022] GET /identity/v3/users/1118dc5e58334634a70ae76ae0a083b8 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:13.534010 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d9a55-7e38-4a37-91d7-fd35b0d2b704 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:13.614617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:13.629610 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d9a55-7e38-4a37-91d7-fd35b0d2b704 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:13.662415 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68157654-b113-4b5c-8c23-cdac03a46236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:13.663024 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68157654-b113-4b5c-8c23-cdac03a46236 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:13.663299 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68157654-b113-4b5c-8c23-cdac03a46236 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:13.663567 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68157654-b113-4b5c-8c23-cdac03a46236 None admin] PATH_INFO: `/v3/projects/b74ea3e96b9a4bfa92090f64b701aedf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:13.664652 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68157654-b113-4b5c-8c23-cdac03a46236 None admin] RBAC: Authorizing `identity:get_project(project_id=b74ea3e96b9a4bfa92090f64b701aedf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:13.666090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68157654-b113-4b5c-8c23-cdac03a46236 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:13.667677 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 554/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:19:13 2022] GET /identity/v3/projects/b74ea3e96b9a4bfa92090f64b701aedf => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:13.673602 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f03f49-f988-47bd-9395-9fd7fa436521 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:13.707134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:13.771275 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f03f49-f988-47bd-9395-9fd7fa436521 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:13.803525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa3bd5-0c47-44a8-9884-5b9f1cf0ba25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:13.804157 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa3bd5-0c47-44a8-9884-5b9f1cf0ba25 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:13.804432 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa3bd5-0c47-44a8-9884-5b9f1cf0ba25 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:13.804703 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa3bd5-0c47-44a8-9884-5b9f1cf0ba25 None admin] PATH_INFO: `/v3/projects/b74ea3e96b9a4bfa92090f64b701aedf/users/1118dc5e58334634a70ae76ae0a083b8/roles/680e2c06ab714158b756dc317a3f4e2e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:13.806798 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa3bd5-0c47-44a8-9884-5b9f1cf0ba25 None admin] RBAC: Authorizing `identity:create_grant(project_id=b74ea3e96b9a4bfa92090f64b701aedf, user_id=1118dc5e58334634a70ae76ae0a083b8, role_id=680e2c06ab714158b756dc317a3f4e2e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:13.808207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa3bd5-0c47-44a8-9884-5b9f1cf0ba25 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:13.821282 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 569/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 9 02:19:13 2022] PUT /identity/v3/projects/b74ea3e96b9a4bfa92090f64b701aedf/users/1118dc5e58334634a70ae76ae0a083b8/roles/680e2c06ab714158b756dc317a3f4e2e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:19:15.765296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968addc8-0dea-4824-86d3-3475a26e1dfc None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:15.765819 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968addc8-0dea-4824-86d3-3475a26e1dfc None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:15.765911 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968addc8-0dea-4824-86d3-3475a26e1dfc None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:15.767198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 555/1124] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:19:15.772196 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d629856-dc53-49a4-8382-f57354a04130 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:15.772627 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d629856-dc53-49a4-8382-f57354a04130 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:15.772750 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d629856-dc53-49a4-8382-f57354a04130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:15.790983 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8d629856-dc53-49a4-8382-f57354a04130 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:19:15.792172 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8d629856-dc53-49a4-8382-f57354a04130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:19:15.864742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 570/1125] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:19:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:19:15.887397 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968addc8-0dea-4824-86d3-3475a26e1dfc None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:15.986036 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968addc8-0dea-4824-86d3-3475a26e1dfc None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:16.019914 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113687dc-b923-4cab-b453-58aa87dc7059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:16.020477 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113687dc-b923-4cab-b453-58aa87dc7059 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:16.020758 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113687dc-b923-4cab-b453-58aa87dc7059 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:16.021040 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113687dc-b923-4cab-b453-58aa87dc7059 None admin] PATH_INFO: `/v3/roles/680e2c06ab714158b756dc317a3f4e2e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:16.022449 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113687dc-b923-4cab-b453-58aa87dc7059 None admin] RBAC: Authorizing `identity:get_role(role_id=680e2c06ab714158b756dc317a3f4e2e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:16.023818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113687dc-b923-4cab-b453-58aa87dc7059 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:16.025182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 556/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:19:15 2022] GET /identity/v3/roles/680e2c06ab714158b756dc317a3f4e2e => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:16.031668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d629856-dc53-49a4-8382-f57354a04130 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:16.055440 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:16.128415 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d629856-dc53-49a4-8382-f57354a04130 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:16.161764 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81156149-960b-4491-a243-2a92a99c06ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:16.162381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81156149-960b-4491-a243-2a92a99c06ac None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:16.162668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81156149-960b-4491-a243-2a92a99c06ac None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:16.162945 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81156149-960b-4491-a243-2a92a99c06ac None admin] PATH_INFO: `/v3/users/1118dc5e58334634a70ae76ae0a083b8` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:16.164054 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81156149-960b-4491-a243-2a92a99c06ac None admin] RBAC: Authorizing `identity:get_user(user_id=1118dc5e58334634a70ae76ae0a083b8)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:16.165527 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81156149-960b-4491-a243-2a92a99c06ac None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:16.167093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 571/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:19:16 2022] GET /identity/v3/users/1118dc5e58334634a70ae76ae0a083b8 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:16.172906 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113687dc-b923-4cab-b453-58aa87dc7059 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:16.193796 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:16.269416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113687dc-b923-4cab-b453-58aa87dc7059 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:16.300884 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba138e7-72ec-45da-832e-de6f767cb986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:16.301501 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba138e7-72ec-45da-832e-de6f767cb986 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:16.301777 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba138e7-72ec-45da-832e-de6f767cb986 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:16.302045 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba138e7-72ec-45da-832e-de6f767cb986 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:16.365960 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba138e7-72ec-45da-832e-de6f767cb986 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:16.367385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba138e7-72ec-45da-832e-de6f767cb986 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:16.387514 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:16.464053 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 557/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:19:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 02:19:16.469983 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81156149-960b-4491-a243-2a92a99c06ac None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:16.558233 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:16.567935 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81156149-960b-4491-a243-2a92a99c06ac None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:16.600741 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fbabbb-88dc-4c91-93ad-419d1ff1d625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:16.601390 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbabbb-88dc-4c91-93ad-419d1ff1d625 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:16.601675 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbabbb-88dc-4c91-93ad-419d1ff1d625 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:16.601951 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbabbb-88dc-4c91-93ad-419d1ff1d625 None admin] PATH_INFO: `/v3/projects/b74ea3e96b9a4bfa92090f64b701aedf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:16.603059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fbabbb-88dc-4c91-93ad-419d1ff1d625 None admin] RBAC: Authorizing `identity:get_project(project_id=b74ea3e96b9a4bfa92090f64b701aedf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:16.604488 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fbabbb-88dc-4c91-93ad-419d1ff1d625 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:16.606122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 572/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:19:16 2022] GET /identity/v3/projects/b74ea3e96b9a4bfa92090f64b701aedf => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:16.612737 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba138e7-72ec-45da-832e-de6f767cb986 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:16.708255 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba138e7-72ec-45da-832e-de6f767cb986 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:16.727535 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:16.741457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca9c98-a779-4a3a-ad83-34dd0e26e406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:16.742044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca9c98-a779-4a3a-ad83-34dd0e26e406 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:16.742320 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca9c98-a779-4a3a-ad83-34dd0e26e406 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:16.742587 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca9c98-a779-4a3a-ad83-34dd0e26e406 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:16.743294 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca9c98-a779-4a3a-ad83-34dd0e26e406 None admin] RBAC: Adding query filter params (role.id=680e2c06ab714158b756dc317a3f4e2e, scope.project.id=b74ea3e96b9a4bfa92090f64b701aedf, user.id=1118dc5e58334634a70ae76ae0a083b8) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:16.743597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca9c98-a779-4a3a-ad83-34dd0e26e406 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:16.745037 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca9c98-a779-4a3a-ad83-34dd0e26e406 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:16.750613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 558/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:19:16 2022] GET /identity/v3/role_assignments?user.id=1118dc5e58334634a70ae76ae0a083b8&scope.project.id=b74ea3e96b9a4bfa92090f64b701aedf&role.id=680e2c06ab714158b756dc317a3f4e2e => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:18.758958 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a49cb-1c0f-425a-a7fd-bc7198f468f5 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:18.759521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a49cb-1c0f-425a-a7fd-bc7198f468f5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:18.759521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a49cb-1c0f-425a-a7fd-bc7198f468f5 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:18.760846 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 573/1131] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:19:18.766689 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b0858-3da0-47ea-ae4a-51e55aa5fb23 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:18.767089 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b0858-3da0-47ea-ae4a-51e55aa5fb23 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:18.767240 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b0858-3da0-47ea-ae4a-51e55aa5fb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:18.784516 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-681b0858-3da0-47ea-ae4a-51e55aa5fb23 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:19:18.785821 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-681b0858-3da0-47ea-ae4a-51e55aa5fb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:19:18.850904 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 559/1132] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:19:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:19:18.878611 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a49cb-1c0f-425a-a7fd-bc7198f468f5 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:18.982680 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a49cb-1c0f-425a-a7fd-bc7198f468f5 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:19.016012 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f3528-2be8-4d0b-a416-f6d6c7863ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:19.016571 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f3528-2be8-4d0b-a416-f6d6c7863ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:19.016846 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f3528-2be8-4d0b-a416-f6d6c7863ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:19.017142 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f3528-2be8-4d0b-a416-f6d6c7863ac9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:19.018232 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f3528-2be8-4d0b-a416-f6d6c7863ac9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:19.019670 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f3528-2be8-4d0b-a416-f6d6c7863ac9 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:19.021246 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 574/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:19:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:19.027120 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b0858-3da0-47ea-ae4a-51e55aa5fb23 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:19.120481 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b0858-3da0-47ea-ae4a-51e55aa5fb23 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:19.134324 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:19.155639 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3dd95-9bfd-4857-9b77-060a04d776d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:19.156241 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3dd95-9bfd-4857-9b77-060a04d776d8 None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:19.156587 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3dd95-9bfd-4857-9b77-060a04d776d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:19.156924 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3dd95-9bfd-4857-9b77-060a04d776d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:19.157655 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3dd95-9bfd-4857-9b77-060a04d776d8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:19.159341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3dd95-9bfd-4857-9b77-060a04d776d8 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:19.186856 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 560/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 9 02:19:19 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:19:21.200823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4a812-a924-40fb-8b99-8fd4afa85cd8 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:21.201412 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4a812-a924-40fb-8b99-8fd4afa85cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:21.201412 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4a812-a924-40fb-8b99-8fd4afa85cd8 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:21.202714 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 575/1135] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:19:21.207991 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248fa1a-064e-4866-9a4a-68fc63204ce6 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:21.208412 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248fa1a-064e-4866-9a4a-68fc63204ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:21.208529 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248fa1a-064e-4866-9a4a-68fc63204ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:21.226836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-d248fa1a-064e-4866-9a4a-68fc63204ce6 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:19:21.228070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d248fa1a-064e-4866-9a4a-68fc63204ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:19:21.294653 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 561/1136] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:19:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:19:21.318146 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4a812-a924-40fb-8b99-8fd4afa85cd8 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:21.346508 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:21.416722 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4a812-a924-40fb-8b99-8fd4afa85cd8 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:21.450218 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e367a-f5a0-47e8-a453-b83674851185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:21.450830 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e367a-f5a0-47e8-a453-b83674851185 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:21.451103 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e367a-f5a0-47e8-a453-b83674851185 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:21.451370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e367a-f5a0-47e8-a453-b83674851185 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:21.452448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e367a-f5a0-47e8-a453-b83674851185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:21.453883 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e367a-f5a0-47e8-a453-b83674851185 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:21.455407 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 576/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:19:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:21.461177 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248fa1a-064e-4866-9a4a-68fc63204ce6 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:21.550938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:21.557531 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248fa1a-064e-4866-9a4a-68fc63204ce6 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:21.591324 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1612a21-6710-4122-b81a-5e577ebc736f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:21.591921 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1612a21-6710-4122-b81a-5e577ebc736f None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:21.592203 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1612a21-6710-4122-b81a-5e577ebc736f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:21.592474 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1612a21-6710-4122-b81a-5e577ebc736f None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:21.593143 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1612a21-6710-4122-b81a-5e577ebc736f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:21.594562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1612a21-6710-4122-b81a-5e577ebc736f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:21.615540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 562/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 9 02:19:21 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:19:23.636035 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86c5a4-f7f4-4ff3-b0f3-a38a1c759327 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:23.636557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86c5a4-f7f4-4ff3-b0f3-a38a1c759327 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:23.636557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86c5a4-f7f4-4ff3-b0f3-a38a1c759327 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:23.637974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 577/1139] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:19:23.642992 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973b1d2-4789-4937-a06f-cafc41847007 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:23.643492 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973b1d2-4789-4937-a06f-cafc41847007 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:23.643598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973b1d2-4789-4937-a06f-cafc41847007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:23.661825 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-4973b1d2-4789-4937-a06f-cafc41847007 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:19:23.663019 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4973b1d2-4789-4937-a06f-cafc41847007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:19:23.727028 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 563/1140] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:19:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:19:23.749975 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86c5a4-f7f4-4ff3-b0f3-a38a1c759327 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:23.840744 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:23.847743 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86c5a4-f7f4-4ff3-b0f3-a38a1c759327 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:23.880495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d14eef-7e3f-4299-85eb-4328f8f1a0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:23.881131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d14eef-7e3f-4299-85eb-4328f8f1a0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:23.881413 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d14eef-7e3f-4299-85eb-4328f8f1a0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:23.881686 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d14eef-7e3f-4299-85eb-4328f8f1a0f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:23.891464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d14eef-7e3f-4299-85eb-4328f8f1a0f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:19:23.896062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-a3d14eef-7e3f-4299-85eb-4328f8f1a0f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:19:23.896062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:19:23.896062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:19:23.896062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:19:23.896062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:19:23.896062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:19:23.896062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:19:23.896062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:19:23.896062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:19:23.896062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:19:23.896062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:19:23.896062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:19:23.896062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:19:23.896062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:19:23.896062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:19:23.896062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:19:23.897258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:19:23.897258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:19:23.897258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:19:23.897258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:19:23.897258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:19:23.897258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:19:23.897258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:19:23.897258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:19:23.897258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:19:23.897258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:19:23.897258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:19:23.897258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:19:23.897258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:19:23.897258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:19:23.897258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:19:23.897258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:19:23.898136 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:19:23.898136 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:19:23.898136 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:19:23.898136 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:19:23.898136 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:19:23.898136 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:19:23.898136 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:19:23.898136 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:19:23.898136 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:19:23.898136 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:19:23.898136 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:19:23.898136 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:19:23.898136 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 578/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:19:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:19:23.903410 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973b1d2-4789-4937-a06f-cafc41847007 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:23.981676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:24.000123 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973b1d2-4789-4937-a06f-cafc41847007 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:24.032569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe84686-320c-4d7b-860d-3e230b1b694b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:24.033199 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe84686-320c-4d7b-860d-3e230b1b694b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:24.033483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe84686-320c-4d7b-860d-3e230b1b694b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:24.033756 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe84686-320c-4d7b-860d-3e230b1b694b None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:24.034416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe84686-320c-4d7b-860d-3e230b1b694b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:24.034721 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe84686-320c-4d7b-860d-3e230b1b694b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:24.036110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe84686-320c-4d7b-860d-3e230b1b694b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:24.044398 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 564/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:19:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:24.050113 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d14eef-7e3f-4299-85eb-4328f8f1a0f0 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:24.147810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d14eef-7e3f-4299-85eb-4328f8f1a0f0 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:24.180532 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70731a32-629e-440e-87bf-276c988112c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:24.181174 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70731a32-629e-440e-87bf-276c988112c0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:24.181454 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70731a32-629e-440e-87bf-276c988112c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:24.181725 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70731a32-629e-440e-87bf-276c988112c0 None admin] PATH_INFO: `/v3/users/7cf10f367f8042bc85f04fd5dca0c6fa` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:24.194661 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70731a32-629e-440e-87bf-276c988112c0 None admin] RBAC: Authorizing `identity:get_user(user_id=7cf10f367f8042bc85f04fd5dca0c6fa)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:24.196089 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70731a32-629e-440e-87bf-276c988112c0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:24.197723 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 579/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:19:24 2022] GET /identity/v3/users/7cf10f367f8042bc85f04fd5dca0c6fa => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:24.204122 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe84686-320c-4d7b-860d-3e230b1b694b None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:24.298513 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe84686-320c-4d7b-860d-3e230b1b694b None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:24.330017 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f619c0d-4959-430e-82f1-c99bc093a017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:24.330602 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f619c0d-4959-430e-82f1-c99bc093a017 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:24.330876 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f619c0d-4959-430e-82f1-c99bc093a017 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:24.331141 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f619c0d-4959-430e-82f1-c99bc093a017 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:24.345025 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:24.396900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f619c0d-4959-430e-82f1-c99bc093a017 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:24.398393 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f619c0d-4959-430e-82f1-c99bc093a017 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:24.491789 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 565/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:19:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 02:19:24.497678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70731a32-629e-440e-87bf-276c988112c0 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:24.512799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:24.596878 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70731a32-629e-440e-87bf-276c988112c0 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:24.631061 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a209e3-24bf-43f6-a328-c7ec3d3eb662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:24.631679 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a209e3-24bf-43f6-a328-c7ec3d3eb662 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:24.631959 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a209e3-24bf-43f6-a328-c7ec3d3eb662 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:24.632232 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a209e3-24bf-43f6-a328-c7ec3d3eb662 None admin] PATH_INFO: `/v3/projects/e30ceb7f6f244af8881c3fef2b4230e7` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:24.633353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a209e3-24bf-43f6-a328-c7ec3d3eb662 None admin] RBAC: Authorizing `identity:get_project(project_id=e30ceb7f6f244af8881c3fef2b4230e7)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:24.634776 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a209e3-24bf-43f6-a328-c7ec3d3eb662 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:24.636385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 580/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:19:24 2022] GET /identity/v3/projects/e30ceb7f6f244af8881c3fef2b4230e7 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:24.642579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f619c0d-4959-430e-82f1-c99bc093a017 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:24.687069 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:24.740051 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f619c0d-4959-430e-82f1-c99bc093a017 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:24.772099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ac9e2-4a9a-426c-92b8-02a2b7f6c0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:24.772696 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ac9e2-4a9a-426c-92b8-02a2b7f6c0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:24.772979 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ac9e2-4a9a-426c-92b8-02a2b7f6c0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:24.773284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ac9e2-4a9a-426c-92b8-02a2b7f6c0a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:24.774003 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ac9e2-4a9a-426c-92b8-02a2b7f6c0a3 None admin] RBAC: Adding query filter params (role.id=e2095c5a29d74c33b9dcb16f8e5343bf, scope.project.id=e30ceb7f6f244af8881c3fef2b4230e7, user.id=7cf10f367f8042bc85f04fd5dca0c6fa) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:24.774316 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ac9e2-4a9a-426c-92b8-02a2b7f6c0a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:24.775733 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ac9e2-4a9a-426c-92b8-02a2b7f6c0a3 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:24.781437 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 566/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:19:24 2022] GET /identity/v3/role_assignments?user.id=7cf10f367f8042bc85f04fd5dca0c6fa&scope.project.id=e30ceb7f6f244af8881c3fef2b4230e7&role.id=e2095c5a29d74c33b9dcb16f8e5343bf => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:26.724343 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d85f9-2377-4886-bf86-88a023f2dfc3 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:26.724890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d85f9-2377-4886-bf86-88a023f2dfc3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:26.724890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d85f9-2377-4886-bf86-88a023f2dfc3 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:26.726243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 581/1147] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:19:26.731875 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bf5b5-e04a-4a7f-b981-7e540e05d50d None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:26.732287 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bf5b5-e04a-4a7f-b981-7e540e05d50d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:26.732417 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bf5b5-e04a-4a7f-b981-7e540e05d50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:26.750078 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-7c4bf5b5-e04a-4a7f-b981-7e540e05d50d None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:19:26.751253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-7c4bf5b5-e04a-4a7f-b981-7e540e05d50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:19:26.815285 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 567/1148] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:19:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:19:26.836461 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d85f9-2377-4886-bf86-88a023f2dfc3 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:26.916874 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:26.935946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d85f9-2377-4886-bf86-88a023f2dfc3 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:26.967982 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a379226-20b8-4372-95d1-3f1d44469c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:26.968591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a379226-20b8-4372-95d1-3f1d44469c17 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:26.968867 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a379226-20b8-4372-95d1-3f1d44469c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:26.969160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a379226-20b8-4372-95d1-3f1d44469c17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:26.982507 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a379226-20b8-4372-95d1-3f1d44469c17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:19:26.987098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-8a379226-20b8-4372-95d1-3f1d44469c17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:19:26.987098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:19:26.987098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:19:26.987098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:19:26.987098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:19:26.987098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:19:26.987098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:19:26.987098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:19:26.987098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:19:26.987098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:19:26.987098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:19:26.987098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:19:26.987098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:19:26.987098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:19:26.987098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:19:26.987098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:19:26.988490 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:19:26.988490 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:19:26.988490 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:19:26.988490 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:19:26.988490 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:19:26.988490 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:19:26.988490 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:19:26.988490 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:19:26.988490 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:19:26.988490 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:19:26.988490 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:19:26.988490 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:19:26.988490 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:19:26.988490 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:19:26.988490 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:19:26.988490 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:19:26.989579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:19:26.989579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:19:26.989579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:19:26.989579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:19:26.989579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:19:26.989579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:19:26.989579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:19:26.989579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:19:26.989579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:19:26.989579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:19:26.989579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:19:26.989579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:19:26.989579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 582/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:19:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:19:26.994314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bf5b5-e04a-4a7f-b981-7e540e05d50d None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:27.031891 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:27.088651 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bf5b5-e04a-4a7f-b981-7e540e05d50d None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:27.121255 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1224c8-2ef8-4ebc-8103-8e019d010ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:27.121854 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1224c8-2ef8-4ebc-8103-8e019d010ade None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:27.122136 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1224c8-2ef8-4ebc-8103-8e019d010ade None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:27.122411 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1224c8-2ef8-4ebc-8103-8e019d010ade None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:27.123073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1224c8-2ef8-4ebc-8103-8e019d010ade None admin] RBAC: Adding query filter params (name=admin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:27.123378 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1224c8-2ef8-4ebc-8103-8e019d010ade None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:27.124739 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1224c8-2ef8-4ebc-8103-8e019d010ade None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:27.132515 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 568/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:19:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:27.138695 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a379226-20b8-4372-95d1-3f1d44469c17 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:27.235237 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a379226-20b8-4372-95d1-3f1d44469c17 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:27.268137 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05867bc6-65f6-4877-8be6-6fa8e14906f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:27.268749 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05867bc6-65f6-4877-8be6-6fa8e14906f8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:27.269047 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05867bc6-65f6-4877-8be6-6fa8e14906f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:27.269325 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05867bc6-65f6-4877-8be6-6fa8e14906f8 None admin] PATH_INFO: `/v3/users/7cf10f367f8042bc85f04fd5dca0c6fa` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:27.270424 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05867bc6-65f6-4877-8be6-6fa8e14906f8 None admin] RBAC: Authorizing `identity:get_user(user_id=7cf10f367f8042bc85f04fd5dca0c6fa)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:27.271854 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05867bc6-65f6-4877-8be6-6fa8e14906f8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:27.273426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 583/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:19:27 2022] GET /identity/v3/users/7cf10f367f8042bc85f04fd5dca0c6fa => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:27.279668 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1224c8-2ef8-4ebc-8103-8e019d010ade None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:27.372920 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:27.375812 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1224c8-2ef8-4ebc-8103-8e019d010ade None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:27.409202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f646908-5139-448f-a6ab-a49c44585fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:27.409815 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f646908-5139-448f-a6ab-a49c44585fba None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:27.410093 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f646908-5139-448f-a6ab-a49c44585fba None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:27.410363 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f646908-5139-448f-a6ab-a49c44585fba None admin] PATH_INFO: `/v3/projects/e30ceb7f6f244af8881c3fef2b4230e7` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:27.411465 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f646908-5139-448f-a6ab-a49c44585fba None admin] RBAC: Authorizing `identity:get_project(project_id=e30ceb7f6f244af8881c3fef2b4230e7)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:27.412882 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f646908-5139-448f-a6ab-a49c44585fba None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:27.414514 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 569/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:19:27 2022] GET /identity/v3/projects/e30ceb7f6f244af8881c3fef2b4230e7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:27.420178 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05867bc6-65f6-4877-8be6-6fa8e14906f8 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:27.432376 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:27.522710 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05867bc6-65f6-4877-8be6-6fa8e14906f8 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:27.553952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82134c7-3e68-4988-abf3-79c804cf478d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:27.554756 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82134c7-3e68-4988-abf3-79c804cf478d None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:27.555041 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82134c7-3e68-4988-abf3-79c804cf478d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:27.555312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82134c7-3e68-4988-abf3-79c804cf478d None admin] PATH_INFO: `/v3/projects/e30ceb7f6f244af8881c3fef2b4230e7/users/7cf10f367f8042bc85f04fd5dca0c6fa/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:27.557190 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82134c7-3e68-4988-abf3-79c804cf478d None admin] RBAC: Authorizing `identity:create_grant(project_id=e30ceb7f6f244af8881c3fef2b4230e7, user_id=7cf10f367f8042bc85f04fd5dca0c6fa, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:27.559125 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82134c7-3e68-4988-abf3-79c804cf478d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:27.571575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 584/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 9 02:19:27 2022] PUT /identity/v3/projects/e30ceb7f6f244af8881c3fef2b4230e7/users/7cf10f367f8042bc85f04fd5dca0c6fa/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:19:29.526783 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c008e25-c7be-4b94-a6d6-464fda2ded35 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:29.527860 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c008e25-c7be-4b94-a6d6-464fda2ded35 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:29.527957 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c008e25-c7be-4b94-a6d6-464fda2ded35 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:29.529278 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 570/1154] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:19:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:19:29.534323 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831da011-9267-435e-9366-cbe8a1e10787 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:29.534738 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831da011-9267-435e-9366-cbe8a1e10787 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:29.534871 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831da011-9267-435e-9366-cbe8a1e10787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:29.552304 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-831da011-9267-435e-9366-cbe8a1e10787 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:19:29.553507 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-831da011-9267-435e-9366-cbe8a1e10787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:19:29.615778 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:29.620595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 585/1155] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:19:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:19:29.643750 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c008e25-c7be-4b94-a6d6-464fda2ded35 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:29.741701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c008e25-c7be-4b94-a6d6-464fda2ded35 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:29.774249 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace10463-a43e-4667-a62d-3c0f2c5cb910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:29.774863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace10463-a43e-4667-a62d-3c0f2c5cb910 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:29.775141 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace10463-a43e-4667-a62d-3c0f2c5cb910 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:29.775411 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace10463-a43e-4667-a62d-3c0f2c5cb910 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:29.785611 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace10463-a43e-4667-a62d-3c0f2c5cb910 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:19:29.790220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-ace10463-a43e-4667-a62d-3c0f2c5cb910 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:19:29.790220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:19:29.790220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:19:29.790220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:19:29.790220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:19:29.790220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:19:29.790220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:19:29.790220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:19:29.790220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:19:29.790220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:19:29.790220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:19:29.790220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:19:29.790220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:19:29.790220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:19:29.790220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:19:29.790220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:19:29.791304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:19:29.791304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:19:29.791304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:19:29.791304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:19:29.791304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:19:29.791304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:19:29.791304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:19:29.791304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:19:29.791304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:19:29.791304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:19:29.791304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:19:29.791304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:19:29.791304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:19:29.791304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:19:29.791304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:19:29.791304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:19:29.792472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:19:29.792472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:19:29.792472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:19:29.792472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:19:29.792472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:19:29.792472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:19:29.792472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:19:29.792472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:19:29.792472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:19:29.792472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:19:29.792472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:19:29.792472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:19:29.792472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 571/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:19:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:19:29.797120 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831da011-9267-435e-9366-cbe8a1e10787 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:29.891453 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831da011-9267-435e-9366-cbe8a1e10787 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:29.923063 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a501b3-0c70-4eb4-9e3a-6df303a03e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:29.923647 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a501b3-0c70-4eb4-9e3a-6df303a03e13 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:29.923922 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a501b3-0c70-4eb4-9e3a-6df303a03e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:29.924191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a501b3-0c70-4eb4-9e3a-6df303a03e13 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:29.924844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a501b3-0c70-4eb4-9e3a-6df303a03e13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:29.925174 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a501b3-0c70-4eb4-9e3a-6df303a03e13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:29.926525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a501b3-0c70-4eb4-9e3a-6df303a03e13 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:29.934740 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 586/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:19:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:29.940222 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace10463-a43e-4667-a62d-3c0f2c5cb910 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:29.968191 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:30.038645 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace10463-a43e-4667-a62d-3c0f2c5cb910 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:30.072972 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5942143-3a25-4ef0-9c87-64c23b12819b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:30.073631 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5942143-3a25-4ef0-9c87-64c23b12819b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:30.073917 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5942143-3a25-4ef0-9c87-64c23b12819b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:30.074781 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5942143-3a25-4ef0-9c87-64c23b12819b None admin] PATH_INFO: `/v3/users/7cf10f367f8042bc85f04fd5dca0c6fa` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:30.075921 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5942143-3a25-4ef0-9c87-64c23b12819b None admin] RBAC: Authorizing `identity:get_user(user_id=7cf10f367f8042bc85f04fd5dca0c6fa)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:30.077411 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5942143-3a25-4ef0-9c87-64c23b12819b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:30.079006 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 572/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:19:29 2022] GET /identity/v3/users/7cf10f367f8042bc85f04fd5dca0c6fa => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:30.085013 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a501b3-0c70-4eb4-9e3a-6df303a03e13 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:30.144854 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:30.182986 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a501b3-0c70-4eb4-9e3a-6df303a03e13 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:30.214924 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d83c4-612b-456c-a94a-88d8eb81580c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:30.215514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d83c4-612b-456c-a94a-88d8eb81580c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:30.215792 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d83c4-612b-456c-a94a-88d8eb81580c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:30.216063 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d83c4-612b-456c-a94a-88d8eb81580c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:30.280688 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d83c4-612b-456c-a94a-88d8eb81580c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:30.282177 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d83c4-612b-456c-a94a-88d8eb81580c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:30.339239 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:30.378364 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 587/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:19:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 02:19:30.384324 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5942143-3a25-4ef0-9c87-64c23b12819b None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:30.474535 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:30.481382 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5942143-3a25-4ef0-9c87-64c23b12819b None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:30.513259 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1490b0-4161-438d-97a0-e8235b29043f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:30.513867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1490b0-4161-438d-97a0-e8235b29043f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:30.514142 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1490b0-4161-438d-97a0-e8235b29043f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:30.514409 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1490b0-4161-438d-97a0-e8235b29043f None admin] PATH_INFO: `/v3/projects/e30ceb7f6f244af8881c3fef2b4230e7` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:30.515497 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1490b0-4161-438d-97a0-e8235b29043f None admin] RBAC: Authorizing `identity:get_project(project_id=e30ceb7f6f244af8881c3fef2b4230e7)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:30.516898 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1490b0-4161-438d-97a0-e8235b29043f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:30.518509 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 573/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:19:30 2022] GET /identity/v3/projects/e30ceb7f6f244af8881c3fef2b4230e7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:30.524408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d83c4-612b-456c-a94a-88d8eb81580c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:30.620421 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d83c4-612b-456c-a94a-88d8eb81580c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:30.657772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9dbfd2-00df-432e-b24f-864283e0776f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:30.658370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dbfd2-00df-432e-b24f-864283e0776f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:30.658650 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dbfd2-00df-432e-b24f-864283e0776f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:30.658922 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dbfd2-00df-432e-b24f-864283e0776f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:30.659640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9dbfd2-00df-432e-b24f-864283e0776f None admin] RBAC: Adding query filter params (role.id=e2095c5a29d74c33b9dcb16f8e5343bf, scope.project.id=e30ceb7f6f244af8881c3fef2b4230e7, user.id=7cf10f367f8042bc85f04fd5dca0c6fa) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:30.659949 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9dbfd2-00df-432e-b24f-864283e0776f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:30.661397 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9dbfd2-00df-432e-b24f-864283e0776f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:30.666938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 588/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:19:30 2022] GET /identity/v3/role_assignments?user.id=7cf10f367f8042bc85f04fd5dca0c6fa&scope.project.id=e30ceb7f6f244af8881c3fef2b4230e7&role.id=e2095c5a29d74c33b9dcb16f8e5343bf => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:32.676676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08be16-55a2-44a7-870a-7aa3dbad1955 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:32.677293 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08be16-55a2-44a7-870a-7aa3dbad1955 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:32.677403 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d08be16-55a2-44a7-870a-7aa3dbad1955 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:32.678752 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 574/1162] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:19:32.684603 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784ba56-05ab-4d02-a073-f7a020d5fe95 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:32.685004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784ba56-05ab-4d02-a073-f7a020d5fe95 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:32.685177 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784ba56-05ab-4d02-a073-f7a020d5fe95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:32.702665 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-6784ba56-05ab-4d02-a073-f7a020d5fe95 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:19:32.703857 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6784ba56-05ab-4d02-a073-f7a020d5fe95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:19:32.723686 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:32.770505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 589/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:19:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:19:32.793238 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08be16-55a2-44a7-870a-7aa3dbad1955 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:32.891102 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d08be16-55a2-44a7-870a-7aa3dbad1955 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:32.923662 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09b43a-a02d-40fd-a340-5080146abd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:32.924249 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09b43a-a02d-40fd-a340-5080146abd6d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:32.924533 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09b43a-a02d-40fd-a340-5080146abd6d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:32.924808 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09b43a-a02d-40fd-a340-5080146abd6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:32.953578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:32.990403 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09b43a-a02d-40fd-a340-5080146abd6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:32.991859 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09b43a-a02d-40fd-a340-5080146abd6d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:33.085982 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 575/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:19:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 02:19:33.092448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784ba56-05ab-4d02-a073-f7a020d5fe95 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:33.186659 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784ba56-05ab-4d02-a073-f7a020d5fe95 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:33.219813 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3b9d2-699a-411d-a4ec-8bc8861181a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:33.220367 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3b9d2-699a-411d-a4ec-8bc8861181a4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:33.220647 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3b9d2-699a-411d-a4ec-8bc8861181a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:33.220915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3b9d2-699a-411d-a4ec-8bc8861181a4 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:33.227366 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3b9d2-699a-411d-a4ec-8bc8861181a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:33.228781 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3b9d2-699a-411d-a4ec-8bc8861181a4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:33.239907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-4fd3b9d2-699a-411d-a4ec-8bc8861181a4 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 09 02:19:33.239907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:19:33.239907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 09 02:19:33.239907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 09 02:19:33.239907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:19:33.239907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:19:33.239907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:19:33.239907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:19:33.239907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 09 02:19:33.239907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:19:33.239907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:19:33.239907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:19:33.239907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:19:33.239907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:19:33.239907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:19:33.239907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:19:33.239907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:19:33.241122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:19:33.241122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:19:33.241122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:19:33.241122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:19:33.241122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:19:33.241122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:19:33.241122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:19:33.241122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:19:33.241122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:19:33.241122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:19:33.241122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:19:33.241122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:19:33.241122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:19:33.241122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:19:33.241122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:19:33.241122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:19:33.242175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:19:33.242175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:19:33.242175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:19:33.242175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:19:33.242175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:19:33.242175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:19:33.242175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:19:33.242175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:19:33.242175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:19:33.242175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:19:33.242175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 09 02:19:33.242175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:19:33.242175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 09 02:19:33.242175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:19:33.242175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 590/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 9 02:19:33 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:19:33.246832 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09b43a-a02d-40fd-a340-5080146abd6d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:33.305750 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:33.342592 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09b43a-a02d-40fd-a340-5080146abd6d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:33.374803 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249d4aa-2006-4c74-8d17-b07f79ffa391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:33.375407 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249d4aa-2006-4c74-8d17-b07f79ffa391 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:33.375686 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249d4aa-2006-4c74-8d17-b07f79ffa391 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:33.375957 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249d4aa-2006-4c74-8d17-b07f79ffa391 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:33.376595 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249d4aa-2006-4c74-8d17-b07f79ffa391 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:33.376902 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249d4aa-2006-4c74-8d17-b07f79ffa391 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:33.378280 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249d4aa-2006-4c74-8d17-b07f79ffa391 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:33.385159 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 576/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 9 02:19:33 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:35.365326 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ab095-62bc-46d7-8dc8-40126e715c9d None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:35.365841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ab095-62bc-46d7-8dc8-40126e715c9d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:35.365951 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ab095-62bc-46d7-8dc8-40126e715c9d None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:35.367219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 591/1167] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:19:35.372805 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccec922-d867-42ac-b3ba-51fb45224a18 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:35.373196 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccec922-d867-42ac-b3ba-51fb45224a18 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:35.373389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccec922-d867-42ac-b3ba-51fb45224a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:35.390830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-eccec922-d867-42ac-b3ba-51fb45224a18 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:19:35.392022 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-eccec922-d867-42ac-b3ba-51fb45224a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:19:35.455681 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 577/1168] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:19:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:19:35.478216 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ab095-62bc-46d7-8dc8-40126e715c9d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:35.497953 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:35.580586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ab095-62bc-46d7-8dc8-40126e715c9d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:35.613413 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dcfd9e-129d-450e-960e-678dd741580b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:35.614000 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcfd9e-129d-450e-960e-678dd741580b None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:35.614279 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcfd9e-129d-450e-960e-678dd741580b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:35.614551 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcfd9e-129d-450e-960e-678dd741580b None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:35.615208 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dcfd9e-129d-450e-960e-678dd741580b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:35.616616 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dcfd9e-129d-450e-960e-678dd741580b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:35.633558 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 592/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Tue Aug 9 02:19:35 2022] POST /identity/v3/domains => generated 267 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:19:37.656282 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7e23b-3937-44e5-9c8c-d4ac311f61a1 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:37.656836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7e23b-3937-44e5-9c8c-d4ac311f61a1 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:37.656836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7e23b-3937-44e5-9c8c-d4ac311f61a1 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:37.658196 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 578/1170] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:19:37.663465 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d99a9-1e8d-48c6-9cbf-cb15a5ec2f43 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:37.663841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d99a9-1e8d-48c6-9cbf-cb15a5ec2f43 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:37.664023 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d99a9-1e8d-48c6-9cbf-cb15a5ec2f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:37.681727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5a1d99a9-1e8d-48c6-9cbf-cb15a5ec2f43 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:19:37.682954 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5a1d99a9-1e8d-48c6-9cbf-cb15a5ec2f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:19:37.748965 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 593/1171] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:19:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:19:37.775532 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7e23b-3937-44e5-9c8c-d4ac311f61a1 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:37.832753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:37.873706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7e23b-3937-44e5-9c8c-d4ac311f61a1 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:37.906579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64615168-4c96-4f9d-8526-ab4dfc7763c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:37.907127 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64615168-4c96-4f9d-8526-ab4dfc7763c8 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:37.907408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64615168-4c96-4f9d-8526-ab4dfc7763c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:37.907679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64615168-4c96-4f9d-8526-ab4dfc7763c8 None admin] PATH_INFO: `/v3/domains/017a8f31d9f44bdca1b75482639aae69` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:37.917717 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64615168-4c96-4f9d-8526-ab4dfc7763c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=017a8f31d9f44bdca1b75482639aae69)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:37.919147 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64615168-4c96-4f9d-8526-ab4dfc7763c8 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:37.920720 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 579/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Tue Aug 9 02:19:37 2022] GET /identity/v3/domains/017a8f31d9f44bdca1b75482639aae69 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:37.926635 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d99a9-1e8d-48c6-9cbf-cb15a5ec2f43 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:37.934750 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:38.024562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d99a9-1e8d-48c6-9cbf-cb15a5ec2f43 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:38.060699 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c8b88-6a5c-441f-baef-700336b98249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:38.061335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c8b88-6a5c-441f-baef-700336b98249 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:38.061618 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c8b88-6a5c-441f-baef-700336b98249 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:38.061894 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c8b88-6a5c-441f-baef-700336b98249 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:38.062561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c8b88-6a5c-441f-baef-700336b98249 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:38.063992 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c8b88-6a5c-441f-baef-700336b98249 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:38.089812 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 594/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 9 02:19:37 2022] POST /identity/v3/projects => generated 361 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:19:40.088725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8d2f2-4bbb-4ef4-b41d-9c2d4b67a887 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:40.089748 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8d2f2-4bbb-4ef4-b41d-9c2d4b67a887 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:40.089992 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8d2f2-4bbb-4ef4-b41d-9c2d4b67a887 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:40.091353 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 580/1174] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:19:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:19:40.096492 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129ea19-3c4f-442b-87a3-48fc7de60d9f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:40.096920 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129ea19-3c4f-442b-87a3-48fc7de60d9f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:40.097068 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129ea19-3c4f-442b-87a3-48fc7de60d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:40.114841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2129ea19-3c4f-442b-87a3-48fc7de60d9f None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:19:40.116023 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2129ea19-3c4f-442b-87a3-48fc7de60d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:19:40.167339 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:40.181759 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 595/1175] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:19:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:19:40.205848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8d2f2-4bbb-4ef4-b41d-9c2d4b67a887 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:40.303516 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8d2f2-4bbb-4ef4-b41d-9c2d4b67a887 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:40.319817 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:40.336457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0d634-d814-4aec-b398-9a0000633b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:40.337091 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0d634-d814-4aec-b398-9a0000633b02 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:40.337373 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0d634-d814-4aec-b398-9a0000633b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:40.337641 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0d634-d814-4aec-b398-9a0000633b02 None admin] PATH_INFO: `/v3/domains/017a8f31d9f44bdca1b75482639aae69` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:40.338766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0d634-d814-4aec-b398-9a0000633b02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=017a8f31d9f44bdca1b75482639aae69)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:40.340176 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0d634-d814-4aec-b398-9a0000633b02 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:40.341747 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 581/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Tue Aug 9 02:19:40 2022] GET /identity/v3/domains/017a8f31d9f44bdca1b75482639aae69 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:40.347297 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129ea19-3c4f-442b-87a3-48fc7de60d9f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:40.442027 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129ea19-3c4f-442b-87a3-48fc7de60d9f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:40.474769 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe5da7-444c-4082-bc51-a7f6587e1f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:40.475362 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe5da7-444c-4082-bc51-a7f6587e1f43 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:40.475640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe5da7-444c-4082-bc51-a7f6587e1f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:40.475909 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe5da7-444c-4082-bc51-a7f6587e1f43 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:40.476545 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe5da7-444c-4082-bc51-a7f6587e1f43 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:40.477986 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe5da7-444c-4082-bc51-a7f6587e1f43 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:40.498614 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 596/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 9 02:19:40 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:19:42.501343 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda8612-d985-46fa-b332-300ba664da9e None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:42.501870 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda8612-d985-46fa-b332-300ba664da9e None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:42.501963 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda8612-d985-46fa-b332-300ba664da9e None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:42.503242 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 582/1178] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:19:42.508355 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460aa09-a704-4802-94ee-6dee5ad3fa5c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:42.508771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460aa09-a704-4802-94ee-6dee5ad3fa5c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:42.508902 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8460aa09-a704-4802-94ee-6dee5ad3fa5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:42.526981 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8460aa09-a704-4802-94ee-6dee5ad3fa5c None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:19:42.528147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8460aa09-a704-4802-94ee-6dee5ad3fa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:19:42.567364 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:42.594016 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 597/1179] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:19:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:19:42.616388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda8612-d985-46fa-b332-300ba664da9e None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:42.716629 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda8612-d985-46fa-b332-300ba664da9e None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:42.749285 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e22a74-483c-4ccd-b8a9-58326fd460a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:42.750310 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e22a74-483c-4ccd-b8a9-58326fd460a8 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:42.750821 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e22a74-483c-4ccd-b8a9-58326fd460a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:42.751320 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e22a74-483c-4ccd-b8a9-58326fd460a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:42.764004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e22a74-483c-4ccd-b8a9-58326fd460a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:19:42.768656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-88e22a74-483c-4ccd-b8a9-58326fd460a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:19:42.768656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:19:42.768656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:19:42.768656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:19:42.768656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:19:42.768656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:19:42.768656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:19:42.768656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:19:42.768656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:19:42.768656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:19:42.768656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:19:42.768656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:19:42.768656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:19:42.768656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:19:42.768656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:19:42.768656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:19:42.769766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:19:42.769766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:19:42.769766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:19:42.769766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:19:42.769766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:19:42.769766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:19:42.769766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:19:42.769766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:19:42.769766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:19:42.769766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:19:42.769766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:19:42.769766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:19:42.769766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:19:42.769766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:19:42.769766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:19:42.769766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:19:42.770654 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:19:42.770654 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:19:42.770654 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:19:42.770654 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:19:42.770654 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:19:42.770654 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:19:42.770654 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:19:42.770654 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:19:42.770654 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:19:42.770654 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:19:42.770654 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:19:42.770654 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:19:42.770654 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 583/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:19:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:19:42.775914 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460aa09-a704-4802-94ee-6dee5ad3fa5c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:42.871537 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8460aa09-a704-4802-94ee-6dee5ad3fa5c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:42.903579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1b4b9-7008-4999-8b3b-b8ba8b63248f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:42.904168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1b4b9-7008-4999-8b3b-b8ba8b63248f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:42.904444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1b4b9-7008-4999-8b3b-b8ba8b63248f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:42.904711 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1b4b9-7008-4999-8b3b-b8ba8b63248f None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:42.905398 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1b4b9-7008-4999-8b3b-b8ba8b63248f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:42.905697 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1b4b9-7008-4999-8b3b-b8ba8b63248f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:42.907054 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1b4b9-7008-4999-8b3b-b8ba8b63248f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:42.914782 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 598/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:19:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:42.920822 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e22a74-483c-4ccd-b8a9-58326fd460a8 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:42.965799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:43.020753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e22a74-483c-4ccd-b8a9-58326fd460a8 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:43.052523 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ace86-b08d-4bed-b1ac-9d81d4cb254d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:43.053166 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ace86-b08d-4bed-b1ac-9d81d4cb254d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:43.053448 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ace86-b08d-4bed-b1ac-9d81d4cb254d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:43.053720 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ace86-b08d-4bed-b1ac-9d81d4cb254d None admin] PATH_INFO: `/v3/users/eb5576b517fa419697f3df6e65aaa13e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:43.066645 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ace86-b08d-4bed-b1ac-9d81d4cb254d None admin] RBAC: Authorizing `identity:get_user(user_id=eb5576b517fa419697f3df6e65aaa13e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:43.068072 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ace86-b08d-4bed-b1ac-9d81d4cb254d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:43.069717 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 584/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:19:42 2022] GET /identity/v3/users/eb5576b517fa419697f3df6e65aaa13e => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:43.075648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1b4b9-7008-4999-8b3b-b8ba8b63248f None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:43.109713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:43.172246 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1b4b9-7008-4999-8b3b-b8ba8b63248f None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:43.205189 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55aa5b0-f16d-4892-8d49-30a62946a35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:43.205782 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55aa5b0-f16d-4892-8d49-30a62946a35a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:43.206060 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55aa5b0-f16d-4892-8d49-30a62946a35a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:43.206331 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55aa5b0-f16d-4892-8d49-30a62946a35a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:43.271226 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55aa5b0-f16d-4892-8d49-30a62946a35a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:43.272610 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55aa5b0-f16d-4892-8d49-30a62946a35a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:43.305483 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:43.368935 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 599/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:19:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 02:19:43.374845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ace86-b08d-4bed-b1ac-9d81d4cb254d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:43.468860 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ace86-b08d-4bed-b1ac-9d81d4cb254d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:43.471123 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:43.502956 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2ab80-f631-4327-b1bd-4cb7c566fc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:43.503571 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2ab80-f631-4327-b1bd-4cb7c566fc95 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:43.503843 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2ab80-f631-4327-b1bd-4cb7c566fc95 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:43.504115 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2ab80-f631-4327-b1bd-4cb7c566fc95 None admin] PATH_INFO: `/v3/projects/ca7aebbce2954af189c7626758ff8f08` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:43.505251 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2ab80-f631-4327-b1bd-4cb7c566fc95 None admin] RBAC: Authorizing `identity:get_project(project_id=ca7aebbce2954af189c7626758ff8f08)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:43.506681 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2ab80-f631-4327-b1bd-4cb7c566fc95 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:43.508303 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 585/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:19:43 2022] GET /identity/v3/projects/ca7aebbce2954af189c7626758ff8f08 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:43.514369 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55aa5b0-f16d-4892-8d49-30a62946a35a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:43.609915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55aa5b0-f16d-4892-8d49-30a62946a35a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:43.643094 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29b533-39f6-4581-b80f-6694133bf2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:43.643675 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29b533-39f6-4581-b80f-6694133bf2df None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:43.643955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29b533-39f6-4581-b80f-6694133bf2df None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:43.644222 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29b533-39f6-4581-b80f-6694133bf2df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:43.644933 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29b533-39f6-4581-b80f-6694133bf2df None admin] RBAC: Adding query filter params (role.id=e2095c5a29d74c33b9dcb16f8e5343bf, scope.project.id=ca7aebbce2954af189c7626758ff8f08, user.id=eb5576b517fa419697f3df6e65aaa13e) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:43.645268 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29b533-39f6-4581-b80f-6694133bf2df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:43.646714 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29b533-39f6-4581-b80f-6694133bf2df None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:43.649456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:43.653447 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 600/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:19:43 2022] GET /identity/v3/role_assignments?user.id=eb5576b517fa419697f3df6e65aaa13e&scope.project.id=ca7aebbce2954af189c7626758ff8f08&role.id=e2095c5a29d74c33b9dcb16f8e5343bf => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:45.584331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4274fe-7503-4a1b-bc96-7be4cd890d61 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:45.584882 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4274fe-7503-4a1b-bc96-7be4cd890d61 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:45.584882 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4274fe-7503-4a1b-bc96-7be4cd890d61 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:45.586253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 586/1186] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:19:45.591714 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f67f5c-b987-4972-a6d1-6e4136b8fb6f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:45.592112 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f67f5c-b987-4972-a6d1-6e4136b8fb6f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:45.592294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f67f5c-b987-4972-a6d1-6e4136b8fb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:45.610480 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e4f67f5c-b987-4972-a6d1-6e4136b8fb6f None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:19:45.611922 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e4f67f5c-b987-4972-a6d1-6e4136b8fb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:19:45.677354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 601/1187] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:19:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:19:45.698437 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4274fe-7503-4a1b-bc96-7be4cd890d61 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:45.795326 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4274fe-7503-4a1b-bc96-7be4cd890d61 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:45.828283 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df621671-abf0-4d14-bd4f-599ee275b73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:45.828894 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df621671-abf0-4d14-bd4f-599ee275b73d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:45.829204 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df621671-abf0-4d14-bd4f-599ee275b73d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:45.829480 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df621671-abf0-4d14-bd4f-599ee275b73d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:45.839198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df621671-abf0-4d14-bd4f-599ee275b73d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:19:45.843793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-df621671-abf0-4d14-bd4f-599ee275b73d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:19:45.843793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:19:45.843793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:19:45.843793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:19:45.843793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:19:45.843793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:19:45.843793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:19:45.843793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:19:45.843793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:19:45.843793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:19:45.843793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:19:45.843793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:19:45.843793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:19:45.843793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:19:45.843793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:19:45.843793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:19:45.844856 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:19:45.844856 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:19:45.844856 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:19:45.844856 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:19:45.844856 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:19:45.844856 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:19:45.844856 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:19:45.844856 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:19:45.844856 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:19:45.844856 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:19:45.844856 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:19:45.844856 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:19:45.844856 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:19:45.844856 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:19:45.844856 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:19:45.844856 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:19:45.845791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:19:45.845791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:19:45.845791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:19:45.845791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:19:45.845791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:19:45.845791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:19:45.845791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:19:45.845791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:19:45.845791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:19:45.845791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:19:45.845791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:19:45.845791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:19:45.845791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 587/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:19:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:19:45.850527 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f67f5c-b987-4972-a6d1-6e4136b8fb6f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:45.945038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f67f5c-b987-4972-a6d1-6e4136b8fb6f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:45.971824 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:45.978598 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a333ad-079e-48eb-bb44-b1e27c27fecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:45.979714 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a333ad-079e-48eb-bb44-b1e27c27fecc None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:45.979991 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a333ad-079e-48eb-bb44-b1e27c27fecc None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:45.980261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a333ad-079e-48eb-bb44-b1e27c27fecc None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:45.980920 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a333ad-079e-48eb-bb44-b1e27c27fecc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:45.981258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a333ad-079e-48eb-bb44-b1e27c27fecc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:45.982629 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a333ad-079e-48eb-bb44-b1e27c27fecc None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:45.991015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 602/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:19:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:45.997235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df621671-abf0-4d14-bd4f-599ee275b73d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:46.027463 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:46.094212 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df621671-abf0-4d14-bd4f-599ee275b73d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:46.127258 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb878537-91c4-4005-ae35-ef2fc8b193a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:46.127866 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb878537-91c4-4005-ae35-ef2fc8b193a1 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:46.128144 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb878537-91c4-4005-ae35-ef2fc8b193a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:46.128413 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb878537-91c4-4005-ae35-ef2fc8b193a1 None admin] PATH_INFO: `/v3/users/eb5576b517fa419697f3df6e65aaa13e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:46.129536 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb878537-91c4-4005-ae35-ef2fc8b193a1 None admin] RBAC: Authorizing `identity:get_user(user_id=eb5576b517fa419697f3df6e65aaa13e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:46.130962 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb878537-91c4-4005-ae35-ef2fc8b193a1 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:46.132510 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 588/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:19:45 2022] GET /identity/v3/users/eb5576b517fa419697f3df6e65aaa13e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:46.138039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a333ad-079e-48eb-bb44-b1e27c27fecc None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:46.234970 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a333ad-079e-48eb-bb44-b1e27c27fecc None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:46.267129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25665f40-c721-440e-8238-be528568e68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:46.267744 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25665f40-c721-440e-8238-be528568e68b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:46.268024 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25665f40-c721-440e-8238-be528568e68b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:46.268296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25665f40-c721-440e-8238-be528568e68b None admin] PATH_INFO: `/v3/projects/ca7aebbce2954af189c7626758ff8f08` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:46.269429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25665f40-c721-440e-8238-be528568e68b None admin] RBAC: Authorizing `identity:get_project(project_id=ca7aebbce2954af189c7626758ff8f08)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:46.270842 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25665f40-c721-440e-8238-be528568e68b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:46.272435 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 603/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:19:46 2022] GET /identity/v3/projects/ca7aebbce2954af189c7626758ff8f08 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:46.278621 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb878537-91c4-4005-ae35-ef2fc8b193a1 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:46.370814 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:46.373780 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb878537-91c4-4005-ae35-ef2fc8b193a1 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:46.406632 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb6264-8b7d-4ca4-988d-eff8a3c60411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:46.407265 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb6264-8b7d-4ca4-988d-eff8a3c60411 None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:46.407542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb6264-8b7d-4ca4-988d-eff8a3c60411 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:46.407812 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb6264-8b7d-4ca4-988d-eff8a3c60411 None admin] PATH_INFO: `/v3/projects/ca7aebbce2954af189c7626758ff8f08/users/eb5576b517fa419697f3df6e65aaa13e/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:46.409675 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb6264-8b7d-4ca4-988d-eff8a3c60411 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca7aebbce2954af189c7626758ff8f08, user_id=eb5576b517fa419697f3df6e65aaa13e, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:46.411082 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb6264-8b7d-4ca4-988d-eff8a3c60411 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:46.423568 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 589/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 9 02:19:46 2022] PUT /identity/v3/projects/ca7aebbce2954af189c7626758ff8f08/users/eb5576b517fa419697f3df6e65aaa13e/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:19:48.390348 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045e111-d4ac-4679-8ba5-ec276add7f63 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:48.390927 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045e111-d4ac-4679-8ba5-ec276add7f63 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:48.390927 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045e111-d4ac-4679-8ba5-ec276add7f63 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:48.392236 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 604/1193] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:19:48.397515 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352f3e3-4fcd-4aad-93b4-53e50c3d3a84 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:48.397961 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352f3e3-4fcd-4aad-93b4-53e50c3d3a84 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:48.398063 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352f3e3-4fcd-4aad-93b4-53e50c3d3a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:48.415483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-0352f3e3-4fcd-4aad-93b4-53e50c3d3a84 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:19:48.417245 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0352f3e3-4fcd-4aad-93b4-53e50c3d3a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:19:48.481027 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 590/1194] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:19:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 02:19:48.503497 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045e111-d4ac-4679-8ba5-ec276add7f63 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:48.563504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:48.605411 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045e111-d4ac-4679-8ba5-ec276add7f63 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:48.638696 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8636f-568e-4d52-be13-b4eb5dbce76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:48.639317 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8636f-568e-4d52-be13-b4eb5dbce76b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:48.639598 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8636f-568e-4d52-be13-b4eb5dbce76b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:48.639867 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8636f-568e-4d52-be13-b4eb5dbce76b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:48.649721 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8636f-568e-4d52-be13-b4eb5dbce76b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:19:48.654872 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-4fb8636f-568e-4d52-be13-b4eb5dbce76b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:19:48.654872 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:19:48.654872 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:19:48.654872 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:19:48.654872 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:19:48.654872 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:19:48.654872 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:19:48.654872 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:19:48.654872 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:19:48.654872 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:19:48.654872 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:19:48.654872 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:19:48.654872 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:19:48.654872 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:19:48.654872 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:19:48.654872 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:19:48.656077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:19:48.656077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:19:48.656077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:19:48.656077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:19:48.656077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:19:48.656077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:19:48.656077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:19:48.656077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:19:48.656077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:19:48.656077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:19:48.656077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:19:48.656077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:19:48.656077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:19:48.656077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:19:48.656077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:19:48.656077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:19:48.657219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:19:48.657219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:19:48.657219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:19:48.657219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:19:48.657219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:19:48.657219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:19:48.657219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:19:48.657219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:19:48.657219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:19:48.657219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:19:48.657219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:19:48.657219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:19:48.657219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 605/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:19:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:19:48.661923 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352f3e3-4fcd-4aad-93b4-53e50c3d3a84 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:48.750273 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:48.760824 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352f3e3-4fcd-4aad-93b4-53e50c3d3a84 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:48.793651 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd740b-94ca-41cb-9842-8d25ccea0834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:48.794242 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd740b-94ca-41cb-9842-8d25ccea0834 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:48.794521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd740b-94ca-41cb-9842-8d25ccea0834 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:48.794791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd740b-94ca-41cb-9842-8d25ccea0834 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:48.795443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd740b-94ca-41cb-9842-8d25ccea0834 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:48.795743 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd740b-94ca-41cb-9842-8d25ccea0834 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:48.797124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd740b-94ca-41cb-9842-8d25ccea0834 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:48.804744 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 591/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:19:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:48.810501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8636f-568e-4d52-be13-b4eb5dbce76b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:48.908453 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8636f-568e-4d52-be13-b4eb5dbce76b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:48.927474 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:48.941463 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ecf41-66c8-4958-9a3b-fcb1d4df81d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:48.942080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ecf41-66c8-4958-9a3b-fcb1d4df81d0 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:48.942357 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ecf41-66c8-4958-9a3b-fcb1d4df81d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:48.942629 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ecf41-66c8-4958-9a3b-fcb1d4df81d0 None admin] PATH_INFO: `/v3/users/eb5576b517fa419697f3df6e65aaa13e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:48.943733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ecf41-66c8-4958-9a3b-fcb1d4df81d0 None admin] RBAC: Authorizing `identity:get_user(user_id=eb5576b517fa419697f3df6e65aaa13e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:48.945205 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ecf41-66c8-4958-9a3b-fcb1d4df81d0 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:48.946741 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 606/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 9 02:19:48 2022] GET /identity/v3/users/eb5576b517fa419697f3df6e65aaa13e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:48.952844 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd740b-94ca-41cb-9842-8d25ccea0834 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:49.050327 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd740b-94ca-41cb-9842-8d25ccea0834 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:49.082183 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018065ff-e443-4636-a490-3cd038204b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:49.082773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018065ff-e443-4636-a490-3cd038204b07 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:49.083050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018065ff-e443-4636-a490-3cd038204b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:49.083317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018065ff-e443-4636-a490-3cd038204b07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:49.103768 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:49.148236 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018065ff-e443-4636-a490-3cd038204b07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:49.149811 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018065ff-e443-4636-a490-3cd038204b07 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:49.244921 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 592/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:19:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 02:19:49.250839 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ecf41-66c8-4958-9a3b-fcb1d4df81d0 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:49.347956 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ecf41-66c8-4958-9a3b-fcb1d4df81d0 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:49.381008 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff83bb-4b71-4cc6-9365-10dc615625ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:49.381905 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff83bb-4b71-4cc6-9365-10dc615625ab None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:49.382190 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff83bb-4b71-4cc6-9365-10dc615625ab None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:49.382463 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff83bb-4b71-4cc6-9365-10dc615625ab None admin] PATH_INFO: `/v3/projects/ca7aebbce2954af189c7626758ff8f08` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:49.383565 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff83bb-4b71-4cc6-9365-10dc615625ab None admin] RBAC: Authorizing `identity:get_project(project_id=ca7aebbce2954af189c7626758ff8f08)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:49.385578 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff83bb-4b71-4cc6-9365-10dc615625ab None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:49.387175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 607/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 9 02:19:49 2022] GET /identity/v3/projects/ca7aebbce2954af189c7626758ff8f08 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:49.393051 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018065ff-e443-4636-a490-3cd038204b07 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:19:49.442180 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:49.488882 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018065ff-e443-4636-a490-3cd038204b07 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:19:49.524336 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bc656-a60d-410e-a709-67f2626ac5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:19:49.524963 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bc656-a60d-410e-a709-67f2626ac5ca None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:19:49.525264 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bc656-a60d-410e-a709-67f2626ac5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:19:49.525555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bc656-a60d-410e-a709-67f2626ac5ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:19:49.526268 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bc656-a60d-410e-a709-67f2626ac5ca None admin] RBAC: Adding query filter params (role.id=e2095c5a29d74c33b9dcb16f8e5343bf, scope.project.id=ca7aebbce2954af189c7626758ff8f08, user.id=eb5576b517fa419697f3df6e65aaa13e) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:19:49.526576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bc656-a60d-410e-a709-67f2626ac5ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:19:49.528136 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bc656-a60d-410e-a709-67f2626ac5ca None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:19:49.533878 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 593/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:19:49 2022] GET /identity/v3/role_assignments?user.id=eb5576b517fa419697f3df6e65aaa13e&scope.project.id=ca7aebbce2954af189c7626758ff8f08&role.id=e2095c5a29d74c33b9dcb16f8e5343bf => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:19:59.376504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=72 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:19:59.531238 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=42 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:44.047585 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd36a11-5900-4cac-a047-d33d4e85ce54 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:44.048165 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd36a11-5900-4cac-a047-d33d4e85ce54 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:44.048165 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd36a11-5900-4cac-a047-d33d4e85ce54 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:44.049953 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 608/1201] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:20:44.057176 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378673d-799d-4dca-9350-750bab36528e None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:44.057176 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378673d-799d-4dca-9350-750bab36528e None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:44.057176 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378673d-799d-4dca-9350-750bab36528e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:44.076462 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c378673d-799d-4dca-9350-750bab36528e None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:20:44.077670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c378673d-799d-4dca-9350-750bab36528e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:20:44.165965 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 594/1202] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:20:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:20:44.190755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd36a11-5900-4cac-a047-d33d4e85ce54 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:44.315964 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd36a11-5900-4cac-a047-d33d4e85ce54 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:44.365121 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9157915-17c8-4775-b75f-e68c1eeb42bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:44.365914 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9157915-17c8-4775-b75f-e68c1eeb42bc None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:44.366146 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9157915-17c8-4775-b75f-e68c1eeb42bc None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:44.366448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9157915-17c8-4775-b75f-e68c1eeb42bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:44.378391 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9157915-17c8-4775-b75f-e68c1eeb42bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:44.379982 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9157915-17c8-4775-b75f-e68c1eeb42bc None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:44.396450 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-b9157915-17c8-4775-b75f-e68c1eeb42bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:20:44.396450 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:20:44.396450 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:20:44.396450 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:20:44.396450 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:20:44.396450 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:20:44.396450 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:20:44.396450 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:20:44.396450 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:20:44.396450 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:20:44.396450 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:20:44.396450 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:20:44.396450 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:20:44.396450 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:20:44.396450 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:20:44.396450 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:20:44.398139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:20:44.398139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:20:44.398139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:20:44.398139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:20:44.398139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:20:44.398139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:20:44.398139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:20:44.398139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:20:44.398139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:20:44.398139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:20:44.398139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:20:44.398139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:20:44.398139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:20:44.398139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:20:44.398139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:20:44.398139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:20:44.398139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:20:44.399656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:20:44.399656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:20:44.399656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:20:44.399656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 609/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:20:44.404777 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378673d-799d-4dca-9350-750bab36528e None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:44.534919 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378673d-799d-4dca-9350-750bab36528e None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:44.571257 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:44.577612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae73de-e77c-41ff-aaf4-cee1b8bb1566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:44.578318 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae73de-e77c-41ff-aaf4-cee1b8bb1566 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:44.578608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae73de-e77c-41ff-aaf4-cee1b8bb1566 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:44.578935 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae73de-e77c-41ff-aaf4-cee1b8bb1566 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:44.579705 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae73de-e77c-41ff-aaf4-cee1b8bb1566 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:20:44.580359 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae73de-e77c-41ff-aaf4-cee1b8bb1566 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:44.582043 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae73de-e77c-41ff-aaf4-cee1b8bb1566 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:44.602767 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 595/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:20:44.608559 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9157915-17c8-4775-b75f-e68c1eeb42bc None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:44.681870 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:44.744237 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9157915-17c8-4775-b75f-e68c1eeb42bc None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:44.781360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d5626e-16e4-484e-9338-2166c1d9c6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:44.781971 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5626e-16e4-484e-9338-2166c1d9c6c6 None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:44.782253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5626e-16e4-484e-9338-2166c1d9c6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:44.782523 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d5626e-16e4-484e-9338-2166c1d9c6c6 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:44.783146 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5626e-16e4-484e-9338-2166c1d9c6c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:44.784640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d5626e-16e4-484e-9338-2166c1d9c6c6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:44.807665 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 610/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 9 02:20:44 2022] POST /identity/v3/users => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:20:46.964302 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e515735-49a2-424d-8c88-dd6b1d0f06c4 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:46.965385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e515735-49a2-424d-8c88-dd6b1d0f06c4 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:46.965465 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e515735-49a2-424d-8c88-dd6b1d0f06c4 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:46.966798 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 596/1206] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:20:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:20:46.974345 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2c52a-c5aa-4d6b-a95e-08d3dd67ff5a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:46.974850 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2c52a-c5aa-4d6b-a95e-08d3dd67ff5a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:46.974942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2c52a-c5aa-4d6b-a95e-08d3dd67ff5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:46.997593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a1d2c52a-c5aa-4d6b-a95e-08d3dd67ff5a None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:20:46.999032 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a1d2c52a-c5aa-4d6b-a95e-08d3dd67ff5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:20:47.074248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 611/1207] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:20:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:20:47.097987 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e515735-49a2-424d-8c88-dd6b1d0f06c4 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:47.220043 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e515735-49a2-424d-8c88-dd6b1d0f06c4 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:47.260309 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ae06d-fce8-4a2c-aa0f-066fb377bdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:47.261030 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ae06d-fce8-4a2c-aa0f-066fb377bdda None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:47.261415 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ae06d-fce8-4a2c-aa0f-066fb377bdda None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:47.261690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ae06d-fce8-4a2c-aa0f-066fb377bdda None admin] PATH_INFO: `/v3/roles/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:47.273541 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ae06d-fce8-4a2c-aa0f-066fb377bdda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:20:47.279182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-ed9ae06d-fce8-4a2c-aa0f-066fb377bdda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:20:47.279182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:20:47.279182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:20:47.279182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:20:47.279182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:20:47.279182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:20:47.279182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:20:47.279182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:20:47.279182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:20:47.279182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:20:47.279182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:20:47.279182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:20:47.279182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:20:47.279182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:20:47.279182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:20:47.279182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:20:47.280330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:20:47.280330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:20:47.280330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:20:47.280330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:20:47.280330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:20:47.280330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:20:47.280330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:20:47.280330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:20:47.280330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:20:47.280330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:20:47.280330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:20:47.280330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:20:47.280330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:20:47.280330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:20:47.280330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:20:47.280330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:20:47.281576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:20:47.281576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:20:47.281576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:20:47.281576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:20:47.281576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:20:47.281576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:20:47.281576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:20:47.281576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:20:47.281576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:20:47.281576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:20:47.281576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:20:47.281576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:20:47.281576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 597/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 9 02:20:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:20:47.286749 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2c52a-c5aa-4d6b-a95e-08d3dd67ff5a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:47.332136 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:47.401931 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2c52a-c5aa-4d6b-a95e-08d3dd67ff5a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:47.442685 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75aa22b-e584-477c-bc16-6a4a0188b6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:47.443599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75aa22b-e584-477c-bc16-6a4a0188b6fb None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:47.443953 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75aa22b-e584-477c-bc16-6a4a0188b6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:47.444154 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75aa22b-e584-477c-bc16-6a4a0188b6fb None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:47.444806 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75aa22b-e584-477c-bc16-6a4a0188b6fb None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:20:47.445133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75aa22b-e584-477c-bc16-6a4a0188b6fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:47.446506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75aa22b-e584-477c-bc16-6a4a0188b6fb None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:47.459845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 612/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 9 02:20:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:20:47.466164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ae06d-fce8-4a2c-aa0f-066fb377bdda None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:47.522952 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:47.582338 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ae06d-fce8-4a2c-aa0f-066fb377bdda None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:47.627855 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d58af2-84d6-42bb-ac5c-3e558cd1a49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:47.628832 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d58af2-84d6-42bb-ac5c-3e558cd1a49f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:47.629360 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d58af2-84d6-42bb-ac5c-3e558cd1a49f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:47.629799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d58af2-84d6-42bb-ac5c-3e558cd1a49f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:47.648208 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d58af2-84d6-42bb-ac5c-3e558cd1a49f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:47.650602 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d58af2-84d6-42bb-ac5c-3e558cd1a49f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:47.671058 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-11d58af2-84d6-42bb-ac5c-3e558cd1a49f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:20:47.671058 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:20:47.671058 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:20:47.671058 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:20:47.671058 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:20:47.671058 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:20:47.671058 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:20:47.671058 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:20:47.671058 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:20:47.671058 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:20:47.671058 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:20:47.671058 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:20:47.671058 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:20:47.671058 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:20:47.671058 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:20:47.671058 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:20:47.672314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:20:47.672314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:20:47.672314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:20:47.672314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:20:47.672314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:20:47.672314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:20:47.672314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:20:47.672314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:20:47.672314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:20:47.672314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:20:47.672314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:20:47.672314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:20:47.672314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:20:47.672314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:20:47.672314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:20:47.672314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:20:47.672314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:20:47.673247 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:20:47.673247 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:20:47.673247 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:20:47.676982 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 598/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:20:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:20:47.677933 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75aa22b-e584-477c-bc16-6a4a0188b6fb None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:47.788750 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:47.795112 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75aa22b-e584-477c-bc16-6a4a0188b6fb None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:47.838817 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c45de-f887-4a87-8a7a-f074b3b0a53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:47.839969 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c45de-f887-4a87-8a7a-f074b3b0a53a None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:47.840258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c45de-f887-4a87-8a7a-f074b3b0a53a None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:47.840652 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c45de-f887-4a87-8a7a-f074b3b0a53a None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:47.841416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c45de-f887-4a87-8a7a-f074b3b0a53a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:20:47.841725 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c45de-f887-4a87-8a7a-f074b3b0a53a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:47.843632 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c45de-f887-4a87-8a7a-f074b3b0a53a None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:47.857346 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 613/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:20:47.862793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d58af2-84d6-42bb-ac5c-3e558cd1a49f None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:47.974219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d58af2-84d6-42bb-ac5c-3e558cd1a49f None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:47.976257 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:48.011826 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e6df1-4dfb-4915-ad27-0ff62610db79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:48.012501 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e6df1-4dfb-4915-ad27-0ff62610db79 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:48.012779 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e6df1-4dfb-4915-ad27-0ff62610db79 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:48.013055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e6df1-4dfb-4915-ad27-0ff62610db79 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:48.022863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e6df1-4dfb-4915-ad27-0ff62610db79 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:48.024576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e6df1-4dfb-4915-ad27-0ff62610db79 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:48.039892 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-b25e6df1-4dfb-4915-ad27-0ff62610db79 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 02:20:48.039892 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:20:48.039892 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:20:48.039892 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:20:48.039892 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:20:48.039892 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:20:48.039892 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:20:48.039892 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:20:48.039892 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:20:48.039892 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:20:48.039892 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:20:48.039892 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:20:48.039892 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:20:48.039892 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:20:48.039892 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:20:48.039892 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:20:48.040910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:20:48.040910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:20:48.040910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:20:48.040910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:20:48.040910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:20:48.040910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:20:48.040910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:20:48.040910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:20:48.040910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:20:48.040910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:20:48.040910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:20:48.040910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:20:48.040910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:20:48.040910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:20:48.040910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:20:48.040910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:20:48.040910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:20:48.040910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:20:48.043135 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:20:48.043135 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:20:48.043135 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:20:48.043135 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:20:48.043135 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:20:48.043135 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:20:48.043135 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:20:48.043135 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:20:48.043135 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 02:20:48.043135 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:20:48.043135 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 599/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:20:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:20:48.047618 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c45de-f887-4a87-8a7a-f074b3b0a53a None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:48.186753 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c45de-f887-4a87-8a7a-f074b3b0a53a None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:48.233170 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f30f78-8d7c-44d1-aad0-49f4843c3688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:48.234110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f30f78-8d7c-44d1-aad0-49f4843c3688 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:48.234374 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f30f78-8d7c-44d1-aad0-49f4843c3688 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:48.234634 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f30f78-8d7c-44d1-aad0-49f4843c3688 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:48.235367 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f30f78-8d7c-44d1-aad0-49f4843c3688 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:20:48.235677 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f30f78-8d7c-44d1-aad0-49f4843c3688 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:48.237189 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f30f78-8d7c-44d1-aad0-49f4843c3688 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:48.260921 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 614/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Aug 9 02:20:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:20:48.262718 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e6df1-4dfb-4915-ad27-0ff62610db79 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:48.369589 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e6df1-4dfb-4915-ad27-0ff62610db79 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:48.411047 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908e129-2fe6-42b6-905b-79b890af3ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:48.411683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908e129-2fe6-42b6-905b-79b890af3ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:48.411933 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908e129-2fe6-42b6-905b-79b890af3ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:48.412204 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908e129-2fe6-42b6-905b-79b890af3ae4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:48.445717 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:48.486690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908e129-2fe6-42b6-905b-79b890af3ae4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:48.488205 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908e129-2fe6-42b6-905b-79b890af3ae4 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:48.602740 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 600/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:20:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 02:20:48.613749 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f30f78-8d7c-44d1-aad0-49f4843c3688 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:48.640204 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:48.733035 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f30f78-8d7c-44d1-aad0-49f4843c3688 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:48.777514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f1fa7-4634-4088-9c69-03d0fbfb349b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:48.778346 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f1fa7-4634-4088-9c69-03d0fbfb349b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:48.778696 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f1fa7-4634-4088-9c69-03d0fbfb349b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:48.778999 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f1fa7-4634-4088-9c69-03d0fbfb349b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:48.791930 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f1fa7-4634-4088-9c69-03d0fbfb349b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:48.793634 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f1fa7-4634-4088-9c69-03d0fbfb349b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:48.810835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-530f1fa7-4634-4088-9c69-03d0fbfb349b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:20:48.810835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:20:48.810835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:20:48.810835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:20:48.810835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:20:48.810835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:20:48.810835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:20:48.810835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:20:48.810835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:20:48.810835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:20:48.810835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:20:48.810835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:20:48.810835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:20:48.810835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:20:48.810835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:20:48.810835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:20:48.811955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:20:48.811955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:20:48.811955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:20:48.811955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:20:48.811955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:20:48.811955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:20:48.811955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:20:48.811955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:20:48.811955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:20:48.811955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:20:48.811955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:20:48.811955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:20:48.811955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:20:48.811955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:20:48.811955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:20:48.811955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:20:48.811955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:20:48.812915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:20:48.812915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:20:48.812915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:20:48.812915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 615/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:20:48.818413 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908e129-2fe6-42b6-905b-79b890af3ae4 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:48.897138 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:48.944322 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908e129-2fe6-42b6-905b-79b890af3ae4 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:48.990449 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166708b5-b3cd-4f89-ba1a-4c3a2173abfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:48.991178 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166708b5-b3cd-4f89-ba1a-4c3a2173abfa None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:48.991337 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166708b5-b3cd-4f89-ba1a-4c3a2173abfa None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:48.991593 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166708b5-b3cd-4f89-ba1a-4c3a2173abfa None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:48.992236 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166708b5-b3cd-4f89-ba1a-4c3a2173abfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:20:48.992565 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166708b5-b3cd-4f89-ba1a-4c3a2173abfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:48.993931 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166708b5-b3cd-4f89-ba1a-4c3a2173abfa None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:49.007636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 601/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:20:49.013086 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f1fa7-4634-4088-9c69-03d0fbfb349b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:49.090441 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:49.131075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f1fa7-4634-4088-9c69-03d0fbfb349b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:49.171244 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65d0a6-4372-41d7-a68d-bed63370f513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:49.171799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65d0a6-4372-41d7-a68d-bed63370f513 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:49.172078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65d0a6-4372-41d7-a68d-bed63370f513 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:49.172347 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65d0a6-4372-41d7-a68d-bed63370f513 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:49.179741 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65d0a6-4372-41d7-a68d-bed63370f513 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:49.181445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65d0a6-4372-41d7-a68d-bed63370f513 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:49.195426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-ea65d0a6-4372-41d7-a68d-bed63370f513 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:20:49.195426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:20:49.195426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:20:49.195426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:20:49.195426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:20:49.195426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:20:49.195426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:20:49.195426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:20:49.195426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:20:49.195426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:20:49.195426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:20:49.195426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:20:49.195426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:20:49.195426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:20:49.195426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:20:49.196439 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:20:49.196439 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:20:49.196439 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:20:49.196439 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:20:49.196439 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:20:49.196439 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:20:49.196439 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:20:49.196439 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:20:49.196439 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:20:49.196439 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:20:49.196439 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:20:49.196439 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:20:49.196439 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:20:49.196439 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:20:49.196439 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:20:49.196439 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:20:49.196439 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:20:49.197948 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:20:49.197948 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:20:49.197948 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:20:49.197948 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:20:49.197948 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:20:49.197948 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:20:49.197948 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:20:49.197948 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:20:49.197948 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 616/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:20:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:20:49.202706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166708b5-b3cd-4f89-ba1a-4c3a2173abfa None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:49.317241 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166708b5-b3cd-4f89-ba1a-4c3a2173abfa None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:49.341544 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:49.354737 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fbc4a-4299-411c-8208-aba21691c643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:49.355914 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fbc4a-4299-411c-8208-aba21691c643 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:49.356190 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fbc4a-4299-411c-8208-aba21691c643 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:49.356461 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fbc4a-4299-411c-8208-aba21691c643 None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:49.357179 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fbc4a-4299-411c-8208-aba21691c643 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:20:49.357553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fbc4a-4299-411c-8208-aba21691c643 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:49.358985 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fbc4a-4299-411c-8208-aba21691c643 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:49.374079 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 602/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:20:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:20:49.380251 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65d0a6-4372-41d7-a68d-bed63370f513 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:49.495405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65d0a6-4372-41d7-a68d-bed63370f513 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:49.528072 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:49.535855 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d741f0-c903-4a64-b2f4-6d8fa4ce5507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:49.536504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d741f0-c903-4a64-b2f4-6d8fa4ce5507 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:49.536786 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d741f0-c903-4a64-b2f4-6d8fa4ce5507 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:49.537157 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d741f0-c903-4a64-b2f4-6d8fa4ce5507 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:49.537807 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d741f0-c903-4a64-b2f4-6d8fa4ce5507 None admin] RBAC: Adding query filter params (role.id=d521e5f58e7e4cd48ceed4404113cbd5, scope.project.id=105476dcda7f48c28224d33c05860d6f, user.id=5fe21d9a65a34abeae7329df924d7998) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:20:49.538111 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d741f0-c903-4a64-b2f4-6d8fa4ce5507 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:49.539549 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d741f0-c903-4a64-b2f4-6d8fa4ce5507 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:49.557049 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 617/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:20:49 2022] GET /identity/v3/role_assignments?user.id=5fe21d9a65a34abeae7329df924d7998&scope.project.id=105476dcda7f48c28224d33c05860d6f&role.id=d521e5f58e7e4cd48ceed4404113cbd5 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:20:51.555543 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea433668-2ab4-4187-955d-fb6b8b33714b None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:51.556093 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea433668-2ab4-4187-955d-fb6b8b33714b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:51.556093 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea433668-2ab4-4187-955d-fb6b8b33714b None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:51.557499 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 603/1220] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:20:51.563007 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329d4d7-f3f5-48e0-b4ee-df979aff65df None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:51.563451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329d4d7-f3f5-48e0-b4ee-df979aff65df None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:51.563551 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329d4d7-f3f5-48e0-b4ee-df979aff65df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:51.581537 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-3329d4d7-f3f5-48e0-b4ee-df979aff65df None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:20:51.582745 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3329d4d7-f3f5-48e0-b4ee-df979aff65df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:20:51.668504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 618/1221] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:20:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:20:51.690348 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea433668-2ab4-4187-955d-fb6b8b33714b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:51.798918 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea433668-2ab4-4187-955d-fb6b8b33714b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:51.835125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88f1f3-0ddf-4cc5-bb68-8f686ede74e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:51.835733 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88f1f3-0ddf-4cc5-bb68-8f686ede74e7 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:51.835969 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88f1f3-0ddf-4cc5-bb68-8f686ede74e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:51.836340 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88f1f3-0ddf-4cc5-bb68-8f686ede74e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:51.847611 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88f1f3-0ddf-4cc5-bb68-8f686ede74e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:20:51.852470 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-db88f1f3-0ddf-4cc5-bb68-8f686ede74e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:20:51.852470 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:20:51.852470 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:20:51.852470 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:20:51.852470 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:20:51.852470 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:20:51.852470 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:20:51.852470 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:20:51.852470 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:20:51.852470 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:20:51.852470 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:20:51.852470 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:20:51.852470 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:20:51.852470 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:20:51.852470 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:20:51.852470 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:20:51.853488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:20:51.853488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:20:51.853488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:20:51.853488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:20:51.853488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:20:51.853488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:20:51.853488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:20:51.853488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:20:51.853488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:20:51.853488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:20:51.853488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:20:51.853488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:20:51.853488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:20:51.853488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:20:51.853488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:20:51.853488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:20:51.854334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:20:51.854334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:20:51.854334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:20:51.854334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:20:51.854334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:20:51.854334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:20:51.854334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:20:51.854334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:20:51.854334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:20:51.854334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:20:51.854334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:20:51.854334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:20:51.854334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 604/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 9 02:20:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:20:51.859881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329d4d7-f3f5-48e0-b4ee-df979aff65df None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:51.981239 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329d4d7-f3f5-48e0-b4ee-df979aff65df None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:52.007390 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:52.020044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ff3b2-6a7b-4b94-8272-56e4765c93f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:52.020708 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ff3b2-6a7b-4b94-8272-56e4765c93f4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:52.020991 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ff3b2-6a7b-4b94-8272-56e4765c93f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:52.021302 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ff3b2-6a7b-4b94-8272-56e4765c93f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:52.021978 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ff3b2-6a7b-4b94-8272-56e4765c93f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:20:52.022287 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ff3b2-6a7b-4b94-8272-56e4765c93f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:52.023697 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ff3b2-6a7b-4b94-8272-56e4765c93f4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:52.032612 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 619/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 9 02:20:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:20:52.038401 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88f1f3-0ddf-4cc5-bb68-8f686ede74e7 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:52.085462 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:52.148814 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88f1f3-0ddf-4cc5-bb68-8f686ede74e7 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:52.189162 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87993a-97b0-4154-a364-e97903adbc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:52.189807 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87993a-97b0-4154-a364-e97903adbc88 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:52.190093 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87993a-97b0-4154-a364-e97903adbc88 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:52.190370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87993a-97b0-4154-a364-e97903adbc88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:52.200977 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87993a-97b0-4154-a364-e97903adbc88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:52.202439 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87993a-97b0-4154-a364-e97903adbc88 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:52.217346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-8c87993a-97b0-4154-a364-e97903adbc88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:20:52.217346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:20:52.217346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:20:52.217346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:20:52.217346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:20:52.217346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:20:52.217346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:20:52.217346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:20:52.217346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:20:52.217346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:20:52.217346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:20:52.217346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:20:52.217346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:20:52.217346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:20:52.217346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:20:52.217346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:20:52.218482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:20:52.218482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:20:52.218482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:20:52.218482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:20:52.218482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:20:52.218482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:20:52.218482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:20:52.218482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:20:52.218482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:20:52.218482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:20:52.218482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:20:52.218482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:20:52.218482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:20:52.218482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:20:52.218482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:20:52.218482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:20:52.218482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:20:52.219702 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:20:52.219702 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:20:52.219702 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:20:52.219702 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 605/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:20:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:20:52.224318 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ff3b2-6a7b-4b94-8272-56e4765c93f4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:52.330617 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ff3b2-6a7b-4b94-8272-56e4765c93f4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:52.370860 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a75ab8-a16e-49bd-9e84-55b8607ecd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:52.371465 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a75ab8-a16e-49bd-9e84-55b8607ecd26 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:52.371745 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a75ab8-a16e-49bd-9e84-55b8607ecd26 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:52.372137 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a75ab8-a16e-49bd-9e84-55b8607ecd26 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:52.372912 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a75ab8-a16e-49bd-9e84-55b8607ecd26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:20:52.373383 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a75ab8-a16e-49bd-9e84-55b8607ecd26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:52.374991 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a75ab8-a16e-49bd-9e84-55b8607ecd26 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:52.387824 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 620/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:20:52.393540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87993a-97b0-4154-a364-e97903adbc88 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:52.488483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:52.497347 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87993a-97b0-4154-a364-e97903adbc88 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:52.535929 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dde3cb-e617-4170-bb33-952e720827a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:52.536562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dde3cb-e617-4170-bb33-952e720827a0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:52.536844 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dde3cb-e617-4170-bb33-952e720827a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:52.537165 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dde3cb-e617-4170-bb33-952e720827a0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:52.545367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dde3cb-e617-4170-bb33-952e720827a0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:52.546808 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dde3cb-e617-4170-bb33-952e720827a0 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:52.558277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-90dde3cb-e617-4170-bb33-952e720827a0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 02:20:52.558277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:20:52.558277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:20:52.558277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:20:52.558277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:20:52.558277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:20:52.558277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:20:52.558277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:20:52.558277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:20:52.558277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:20:52.558277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:20:52.558277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:20:52.558277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:20:52.558277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:20:52.558277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:20:52.558277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:20:52.565198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:20:52.565198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:20:52.565198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:20:52.565198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:20:52.565198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:20:52.565198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:20:52.565198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:20:52.565198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:20:52.565198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:20:52.565198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:20:52.565198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:20:52.565198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:20:52.565198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:20:52.565198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:20:52.565198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:20:52.565198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:20:52.565198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:20:52.565198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:20:52.566859 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:20:52.566859 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:20:52.566859 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:20:52.566859 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:20:52.566859 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:20:52.566859 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:20:52.566859 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:20:52.566859 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:20:52.566859 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 02:20:52.566859 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:20:52.566859 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 606/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:20:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:20:52.567494 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a75ab8-a16e-49bd-9e84-55b8607ecd26 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:52.619138 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:52.686629 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a75ab8-a16e-49bd-9e84-55b8607ecd26 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:52.721587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa1be1-52e0-4c4f-99e4-721c26da8bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:52.722196 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa1be1-52e0-4c4f-99e4-721c26da8bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:52.722472 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa1be1-52e0-4c4f-99e4-721c26da8bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:52.722747 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa1be1-52e0-4c4f-99e4-721c26da8bd3 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:52.723471 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa1be1-52e0-4c4f-99e4-721c26da8bd3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:20:52.723781 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa1be1-52e0-4c4f-99e4-721c26da8bd3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:52.725250 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa1be1-52e0-4c4f-99e4-721c26da8bd3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:52.745040 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 621/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Aug 9 02:20:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:20:52.750875 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dde3cb-e617-4170-bb33-952e720827a0 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:52.866640 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dde3cb-e617-4170-bb33-952e720827a0 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:52.902837 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6704d-bec7-45be-aa13-42b40e200b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:52.903465 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6704d-bec7-45be-aa13-42b40e200b8e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:52.903742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6704d-bec7-45be-aa13-42b40e200b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:52.904010 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6704d-bec7-45be-aa13-42b40e200b8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:52.914335 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6704d-bec7-45be-aa13-42b40e200b8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:52.915793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6704d-bec7-45be-aa13-42b40e200b8e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:52.929730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-55d6704d-bec7-45be-aa13-42b40e200b8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:20:52.929730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:20:52.929730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:20:52.929730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:20:52.929730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:20:52.929730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:20:52.929730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:20:52.929730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:20:52.929730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:20:52.929730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:20:52.929730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:20:52.929730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:20:52.929730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:20:52.929730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:20:52.929730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:20:52.929730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:20:52.935683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:20:52.935683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:20:52.935683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:20:52.935683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:20:52.935683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:20:52.935683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:20:52.935683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:20:52.935683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:20:52.935683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:20:52.935683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:20:52.935683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:20:52.935683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:20:52.935683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:20:52.935683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:20:52.935683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:20:52.935683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:20:52.935683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:20:52.936813 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:20:52.936813 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:20:52.936813 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:20:52.936813 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 607/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:20:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:20:52.937104 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa1be1-52e0-4c4f-99e4-721c26da8bd3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:53.049072 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa1be1-52e0-4c4f-99e4-721c26da8bd3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:53.051854 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:53.089775 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0156680-a30a-429e-8fad-0caaba7dcb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:53.090384 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0156680-a30a-429e-8fad-0caaba7dcb60 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:53.090664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0156680-a30a-429e-8fad-0caaba7dcb60 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:53.090978 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0156680-a30a-429e-8fad-0caaba7dcb60 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:53.091574 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0156680-a30a-429e-8fad-0caaba7dcb60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:20:53.091874 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0156680-a30a-429e-8fad-0caaba7dcb60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:53.093257 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0156680-a30a-429e-8fad-0caaba7dcb60 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:53.111506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 622/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:20:53.113263 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6704d-bec7-45be-aa13-42b40e200b8e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:53.125357 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:53.225065 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6704d-bec7-45be-aa13-42b40e200b8e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:53.263520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccbea2-96e3-4844-80e8-5e5e80f7ed54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:53.264205 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccbea2-96e3-4844-80e8-5e5e80f7ed54 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:53.264488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccbea2-96e3-4844-80e8-5e5e80f7ed54 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:53.264764 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccbea2-96e3-4844-80e8-5e5e80f7ed54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:53.272022 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccbea2-96e3-4844-80e8-5e5e80f7ed54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:53.273564 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccbea2-96e3-4844-80e8-5e5e80f7ed54 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:53.285474 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-a9ccbea2-96e3-4844-80e8-5e5e80f7ed54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:20:53.285474 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:20:53.285474 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:20:53.285474 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:20:53.285474 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:20:53.285474 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:20:53.285474 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:20:53.285474 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:20:53.285474 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:20:53.285474 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:20:53.285474 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:20:53.285474 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:20:53.285474 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:20:53.285474 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:20:53.285474 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:20:53.286389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:20:53.286389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:20:53.286389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:20:53.286389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:20:53.286389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:20:53.286389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:20:53.286389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:20:53.286389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:20:53.286389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:20:53.286389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:20:53.286389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:20:53.286389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:20:53.286389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:20:53.286389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:20:53.286389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:20:53.286389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:20:53.286389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:20:53.287472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:20:53.287472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:20:53.287472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:20:53.287472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:20:53.287472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:20:53.287472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:20:53.287472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:20:53.287472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:20:53.287472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 608/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:20:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:20:53.292613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0156680-a30a-429e-8fad-0caaba7dcb60 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:53.399736 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0156680-a30a-429e-8fad-0caaba7dcb60 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:53.436472 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bd2ee-7c0b-4129-8617-504b8c71727f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:53.437079 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bd2ee-7c0b-4129-8617-504b8c71727f None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:53.437363 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bd2ee-7c0b-4129-8617-504b8c71727f None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:53.437636 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bd2ee-7c0b-4129-8617-504b8c71727f None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:53.438341 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224bd2ee-7c0b-4129-8617-504b8c71727f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:20:53.438653 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224bd2ee-7c0b-4129-8617-504b8c71727f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:53.440060 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224bd2ee-7c0b-4129-8617-504b8c71727f None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:53.452177 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 623/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:20:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:20:53.458600 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccbea2-96e3-4844-80e8-5e5e80f7ed54 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:53.528207 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:53.566477 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccbea2-96e3-4844-80e8-5e5e80f7ed54 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:53.602690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f0f02-bb66-489b-ad3e-420fe959bb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:53.603351 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f0f02-bb66-489b-ad3e-420fe959bb0d None admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:53.603633 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f0f02-bb66-489b-ad3e-420fe959bb0d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:53.603949 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f0f02-bb66-489b-ad3e-420fe959bb0d None admin] PATH_INFO: `/v3/projects/105476dcda7f48c28224d33c05860d6f/users/5fe21d9a65a34abeae7329df924d7998/roles/d521e5f58e7e4cd48ceed4404113cbd5` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:53.619598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f0f02-bb66-489b-ad3e-420fe959bb0d None admin] RBAC: Authorizing `identity:create_grant(project_id=105476dcda7f48c28224d33c05860d6f, user_id=5fe21d9a65a34abeae7329df924d7998, role_id=d521e5f58e7e4cd48ceed4404113cbd5)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:53.621746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f0f02-bb66-489b-ad3e-420fe959bb0d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:53.635400 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 609/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 9 02:20:53 2022] PUT /identity/v3/projects/105476dcda7f48c28224d33c05860d6f/users/5fe21d9a65a34abeae7329df924d7998/roles/d521e5f58e7e4cd48ceed4404113cbd5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:20:55.698550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8737f9c-123a-4ab6-8ca0-cfff1495929e None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:55.699271 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8737f9c-123a-4ab6-8ca0-cfff1495929e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:55.699271 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8737f9c-123a-4ab6-8ca0-cfff1495929e None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:55.700454 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 624/1233] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:20:55.705875 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538aef9-488f-476a-a7d0-7158926fe698 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:55.706334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538aef9-488f-476a-a7d0-7158926fe698 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:55.706546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538aef9-488f-476a-a7d0-7158926fe698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:55.725573 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-f538aef9-488f-476a-a7d0-7158926fe698 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:20:55.726863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f538aef9-488f-476a-a7d0-7158926fe698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:20:55.795343 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 610/1234] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:20:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:20:55.818338 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8737f9c-123a-4ab6-8ca0-cfff1495929e None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:55.845961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:55.926672 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8737f9c-123a-4ab6-8ca0-cfff1495929e None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:55.963178 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72297de5-5c8c-4e9f-aa39-ad20b486ebfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:55.963745 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72297de5-5c8c-4e9f-aa39-ad20b486ebfe None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:55.964056 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72297de5-5c8c-4e9f-aa39-ad20b486ebfe None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:55.964329 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72297de5-5c8c-4e9f-aa39-ad20b486ebfe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:55.977243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72297de5-5c8c-4e9f-aa39-ad20b486ebfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:20:55.982690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-72297de5-5c8c-4e9f-aa39-ad20b486ebfe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:20:55.982690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:20:55.982690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:20:55.982690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:20:55.982690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:20:55.982690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:20:55.982690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:20:55.982690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:20:55.982690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:20:55.982690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:20:55.982690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:20:55.982690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:20:55.982690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:20:55.982690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:20:55.982690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:20:55.982690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:20:55.983660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:20:55.983660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:20:55.983660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:20:55.983660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:20:55.983660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:20:55.983660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:20:55.983660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:20:55.983660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:20:55.983660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:20:55.983660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:20:55.983660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:20:55.983660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:20:55.983660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:20:55.983660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:20:55.983660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:20:55.983660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:20:55.984525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:20:55.984525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:20:55.984525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:20:55.984525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:20:55.984525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:20:55.984525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:20:55.984525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:20:55.984525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:20:55.984525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:20:55.984525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:20:55.984525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 02:20:55.984525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:20:55.984525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 625/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 9 02:20:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:20:55.990103 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538aef9-488f-476a-a7d0-7158926fe698 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:56.037059 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:56.099139 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538aef9-488f-476a-a7d0-7158926fe698 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:56.134831 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1022d7-96f5-405b-af77-46a205d82e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:56.135440 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1022d7-96f5-405b-af77-46a205d82e7e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:56.135719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1022d7-96f5-405b-af77-46a205d82e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:56.136010 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1022d7-96f5-405b-af77-46a205d82e7e None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:56.136720 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1022d7-96f5-405b-af77-46a205d82e7e None admin] RBAC: Adding query filter params (name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:20:56.137051 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1022d7-96f5-405b-af77-46a205d82e7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:56.138405 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1022d7-96f5-405b-af77-46a205d82e7e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:56.146126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 611/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 9 02:20:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:20:56.152656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72297de5-5c8c-4e9f-aa39-ad20b486ebfe None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:56.245593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:56.262218 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72297de5-5c8c-4e9f-aa39-ad20b486ebfe None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:56.297875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d217a-39af-41b4-86a6-782658e0e632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:56.298501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d217a-39af-41b4-86a6-782658e0e632 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:56.298782 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d217a-39af-41b4-86a6-782658e0e632 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:56.299131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d217a-39af-41b4-86a6-782658e0e632 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:56.309481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d217a-39af-41b4-86a6-782658e0e632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:56.310955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d217a-39af-41b4-86a6-782658e0e632 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:56.325595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-364d217a-39af-41b4-86a6-782658e0e632 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:20:56.325595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:20:56.325595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:20:56.325595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:20:56.325595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:20:56.325595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:20:56.325595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:20:56.325595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:20:56.325595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:20:56.325595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:20:56.325595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:20:56.325595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:20:56.325595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:20:56.325595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:20:56.325595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:20:56.325595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:20:56.326876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:20:56.326876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:20:56.326876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:20:56.326876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:20:56.326876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:20:56.326876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:20:56.326876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:20:56.326876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:20:56.326876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:20:56.326876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:20:56.326876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:20:56.326876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:20:56.326876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:20:56.326876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:20:56.326876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:20:56.326876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:20:56.326876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:20:56.327779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:20:56.327779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:20:56.327779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:20:56.327779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 626/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:20:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:20:56.332755 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1022d7-96f5-405b-af77-46a205d82e7e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:56.450549 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1022d7-96f5-405b-af77-46a205d82e7e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:56.461681 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:56.492085 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd480159-dda0-496a-94a5-2bbbb5043189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:56.492700 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd480159-dda0-496a-94a5-2bbbb5043189 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:56.492984 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd480159-dda0-496a-94a5-2bbbb5043189 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:56.493288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd480159-dda0-496a-94a5-2bbbb5043189 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:56.494193 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd480159-dda0-496a-94a5-2bbbb5043189 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:20:56.494548 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd480159-dda0-496a-94a5-2bbbb5043189 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:56.496679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd480159-dda0-496a-94a5-2bbbb5043189 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:56.510924 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 612/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:20:56.517535 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d217a-39af-41b4-86a6-782658e0e632 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:56.623756 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d217a-39af-41b4-86a6-782658e0e632 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:56.662091 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b0468-770c-4f62-aab6-e79b119906d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:56.662730 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b0468-770c-4f62-aab6-e79b119906d4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:56.662999 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b0468-770c-4f62-aab6-e79b119906d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:56.663267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b0468-770c-4f62-aab6-e79b119906d4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:56.666268 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:56.672519 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b0468-770c-4f62-aab6-e79b119906d4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:56.674000 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b0468-770c-4f62-aab6-e79b119906d4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:56.684988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-840b0468-770c-4f62-aab6-e79b119906d4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 02:20:56.684988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:20:56.684988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:20:56.684988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:20:56.684988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:20:56.684988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:20:56.684988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:20:56.684988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:20:56.684988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:20:56.684988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:20:56.684988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:20:56.684988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:20:56.684988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:20:56.684988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:20:56.684988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:20:56.684988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:20:56.691099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:20:56.691099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:20:56.691099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:20:56.691099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:20:56.691099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:20:56.691099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:20:56.691099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:20:56.691099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:20:56.691099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:20:56.691099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:20:56.691099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:20:56.691099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:20:56.691099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:20:56.691099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:20:56.691099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:20:56.691099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:20:56.691099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:20:56.691099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:20:56.692260 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:20:56.692260 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:20:56.692260 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:20:56.692260 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:20:56.692260 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:20:56.692260 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:20:56.692260 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:20:56.692260 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:20:56.692260 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 02:20:56.692260 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:20:56.692260 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 627/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:20:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:20:56.693122 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd480159-dda0-496a-94a5-2bbbb5043189 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:56.800476 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd480159-dda0-496a-94a5-2bbbb5043189 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:56.835211 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580281d-dcb1-451b-a809-52090ff81bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:56.835867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580281d-dcb1-451b-a809-52090ff81bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:56.836145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580281d-dcb1-451b-a809-52090ff81bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:56.836415 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580281d-dcb1-451b-a809-52090ff81bd6 None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:56.837161 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580281d-dcb1-451b-a809-52090ff81bd6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:20:56.837484 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580281d-dcb1-451b-a809-52090ff81bd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:56.839012 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580281d-dcb1-451b-a809-52090ff81bd6 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:56.857178 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 613/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Aug 9 02:20:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:20:56.862506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b0468-770c-4f62-aab6-e79b119906d4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:56.993010 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b0468-770c-4f62-aab6-e79b119906d4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:57.029649 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c03be7-d021-460b-8abf-30004e88e2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:57.030307 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c03be7-d021-460b-8abf-30004e88e2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:57.030627 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c03be7-d021-460b-8abf-30004e88e2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:57.030902 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c03be7-d021-460b-8abf-30004e88e2e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:57.097810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:57.104645 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c03be7-d021-460b-8abf-30004e88e2e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:57.106635 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c03be7-d021-460b-8abf-30004e88e2e2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:57.213902 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 628/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:20:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 02:20:57.220306 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580281d-dcb1-451b-a809-52090ff81bd6 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:57.250928 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:57.329562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580281d-dcb1-451b-a809-52090ff81bd6 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:57.367787 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced326e6-c9f8-4f30-9b3e-618d8cc29c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:57.368611 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced326e6-c9f8-4f30-9b3e-618d8cc29c03 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:57.368941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced326e6-c9f8-4f30-9b3e-618d8cc29c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:57.369365 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced326e6-c9f8-4f30-9b3e-618d8cc29c03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:57.380699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced326e6-c9f8-4f30-9b3e-618d8cc29c03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:57.382283 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced326e6-c9f8-4f30-9b3e-618d8cc29c03 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:57.399001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-ced326e6-c9f8-4f30-9b3e-618d8cc29c03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:20:57.399001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:20:57.399001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:20:57.399001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:20:57.399001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:20:57.399001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:20:57.399001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:20:57.399001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:20:57.399001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:20:57.399001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:20:57.399001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:20:57.399001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:20:57.399001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:20:57.399001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:20:57.399001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:20:57.399001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:20:57.401292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:20:57.401292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:20:57.401292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:20:57.401292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:20:57.401292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:20:57.401292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:20:57.401292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:20:57.401292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:20:57.401292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:20:57.401292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:20:57.401292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:20:57.401292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:20:57.401292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:20:57.401292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:20:57.401292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:20:57.401292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:20:57.401292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:20:57.402456 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:20:57.402456 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:20:57.402456 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:20:57.402456 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 614/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:20:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:20:57.406501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c03be7-d021-460b-8abf-30004e88e2e2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:57.517118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:57.525272 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c03be7-d021-460b-8abf-30004e88e2e2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:57.563296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ad10e-3dfd-4281-8424-5b77eb8bc3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:57.563920 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ad10e-3dfd-4281-8424-5b77eb8bc3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:57.564202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ad10e-3dfd-4281-8424-5b77eb8bc3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:57.564473 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ad10e-3dfd-4281-8424-5b77eb8bc3e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:57.565188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ad10e-3dfd-4281-8424-5b77eb8bc3e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:20:57.565469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ad10e-3dfd-4281-8424-5b77eb8bc3e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:57.566873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ad10e-3dfd-4281-8424-5b77eb8bc3e2 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:57.579292 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 629/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:20:57.585348 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced326e6-c9f8-4f30-9b3e-618d8cc29c03 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:57.672016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:20:57.695609 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced326e6-c9f8-4f30-9b3e-618d8cc29c03 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:57.729526 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b802e7-123b-4caa-9146-3739faea4a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:57.730241 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b802e7-123b-4caa-9146-3739faea4a63 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:57.731026 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b802e7-123b-4caa-9146-3739faea4a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:57.731300 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b802e7-123b-4caa-9146-3739faea4a63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:57.737819 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b802e7-123b-4caa-9146-3739faea4a63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:57.739257 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b802e7-123b-4caa-9146-3739faea4a63 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:57.750612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-60b802e7-123b-4caa-9146-3739faea4a63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:20:57.750612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:20:57.750612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:20:57.750612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:20:57.750612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:20:57.750612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:20:57.750612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:20:57.750612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:20:57.750612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:20:57.750612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:20:57.750612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:20:57.750612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:20:57.750612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:20:57.750612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:20:57.750612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:20:57.751682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:20:57.751682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:20:57.751682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:20:57.751682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:20:57.751682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:20:57.751682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:20:57.751682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:20:57.751682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:20:57.751682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:20:57.751682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:20:57.751682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:20:57.751682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:20:57.751682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:20:57.751682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:20:57.751682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:20:57.751682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:20:57.751682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:20:57.752594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:20:57.752594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:20:57.752594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:20:57.752594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:20:57.752594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:20:57.752594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:20:57.752594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:20:57.752594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:20:57.752594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 615/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:20:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:20:57.758057 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ad10e-3dfd-4281-8424-5b77eb8bc3e2 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:57.865763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ad10e-3dfd-4281-8424-5b77eb8bc3e2 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:57.905572 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c039c-a2c2-4a48-8234-601237b61d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:57.906342 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c039c-a2c2-4a48-8234-601237b61d01 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:57.906789 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c039c-a2c2-4a48-8234-601237b61d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:57.907249 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c039c-a2c2-4a48-8234-601237b61d01 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:57.908133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c039c-a2c2-4a48-8234-601237b61d01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:20:57.908440 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c039c-a2c2-4a48-8234-601237b61d01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:57.909888 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c039c-a2c2-4a48-8234-601237b61d01 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:57.925249 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 630/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:20:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:20:57.931801 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b802e7-123b-4caa-9146-3739faea4a63 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:20:58.055075 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b802e7-123b-4caa-9146-3739faea4a63 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:20:58.092357 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf89604-e2cd-4c85-80b2-771392717943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:20:58.092961 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf89604-e2cd-4c85-80b2-771392717943 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:20:58.093270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf89604-e2cd-4c85-80b2-771392717943 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:20:58.093546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf89604-e2cd-4c85-80b2-771392717943 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:20:58.094273 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf89604-e2cd-4c85-80b2-771392717943 None admin] RBAC: Adding query filter params (role.id=d521e5f58e7e4cd48ceed4404113cbd5, scope.project.id=105476dcda7f48c28224d33c05860d6f, user.id=5fe21d9a65a34abeae7329df924d7998) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:20:58.094590 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf89604-e2cd-4c85-80b2-771392717943 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:20:58.096311 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf89604-e2cd-4c85-80b2-771392717943 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:20:58.103198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 616/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:20:57 2022] GET /identity/v3/role_assignments?user.id=5fe21d9a65a34abeae7329df924d7998&scope.project.id=105476dcda7f48c28224d33c05860d6f&role.id=d521e5f58e7e4cd48ceed4404113cbd5 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:21:00.345856 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b8a33-3ede-4d5f-9493-fa574cc36874 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:00.346398 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b8a33-3ede-4d5f-9493-fa574cc36874 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:00.346553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b8a33-3ede-4d5f-9493-fa574cc36874 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:00.348178 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 631/1247] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:21:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:21:00.353240 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c4a56-9980-4c79-9656-0dbcde3e115b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:00.353678 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c4a56-9980-4c79-9656-0dbcde3e115b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:00.353803 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c4a56-9980-4c79-9656-0dbcde3e115b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:00.361234 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:00.376774 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a87c4a56-9980-4c79-9656-0dbcde3e115b None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:21:00.378023 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a87c4a56-9980-4c79-9656-0dbcde3e115b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:21:00.456007 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 617/1248] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:21:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:21:00.480856 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b8a33-3ede-4d5f-9493-fa574cc36874 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:00.504371 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:00.594250 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b8a33-3ede-4d5f-9493-fa574cc36874 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:00.634285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32386e2c-e0bc-49d0-935e-552deef32010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:00.634836 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32386e2c-e0bc-49d0-935e-552deef32010 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:00.635115 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32386e2c-e0bc-49d0-935e-552deef32010 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:00.635390 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32386e2c-e0bc-49d0-935e-552deef32010 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:00.649094 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32386e2c-e0bc-49d0-935e-552deef32010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:21:00.656593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-32386e2c-e0bc-49d0-935e-552deef32010 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:21:00.656593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:21:00.656593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:21:00.656593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:21:00.656593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:21:00.656593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:21:00.656593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:21:00.656593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:21:00.656593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:21:00.656593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:21:00.656593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:21:00.656593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:21:00.656593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:21:00.656593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:21:00.656593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:21:00.656593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:21:00.657732 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:21:00.657732 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:21:00.657732 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:21:00.657732 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:21:00.657732 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:21:00.657732 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:21:00.657732 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:21:00.657732 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:21:00.657732 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:21:00.657732 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:21:00.657732 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:21:00.657732 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:21:00.657732 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:21:00.657732 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:21:00.657732 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:21:00.657732 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:21:00.658790 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:21:00.658790 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:21:00.658790 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:21:00.658790 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:21:00.658790 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:21:00.658790 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:21:00.658790 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:21:00.658790 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:21:00.658790 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:21:00.658790 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:21:00.658790 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:21:00.658790 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:21:00.658790 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 632/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:21:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 02:21:00.665126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c4a56-9980-4c79-9656-0dbcde3e115b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:00.778145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c4a56-9980-4c79-9656-0dbcde3e115b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:00.816241 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:00.822277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c1c75-97a9-4fe1-981d-6b9a356ddde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:00.822986 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c1c75-97a9-4fe1-981d-6b9a356ddde1 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:00.823353 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c1c75-97a9-4fe1-981d-6b9a356ddde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:00.823694 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c1c75-97a9-4fe1-981d-6b9a356ddde1 None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:00.825207 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c1c75-97a9-4fe1-981d-6b9a356ddde1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:21:00.825522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c1c75-97a9-4fe1-981d-6b9a356ddde1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:00.827132 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c1c75-97a9-4fe1-981d-6b9a356ddde1 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:00.837524 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 618/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:21:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:21:00.844715 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32386e2c-e0bc-49d0-935e-552deef32010 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:00.928756 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:00.954860 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32386e2c-e0bc-49d0-935e-552deef32010 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:00.999577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d482ce8-cf2b-41ba-9933-5b7b617f11b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:01.000211 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d482ce8-cf2b-41ba-9933-5b7b617f11b4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:01.000490 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d482ce8-cf2b-41ba-9933-5b7b617f11b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:01.000761 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d482ce8-cf2b-41ba-9933-5b7b617f11b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:01.012914 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d482ce8-cf2b-41ba-9933-5b7b617f11b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:01.014603 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d482ce8-cf2b-41ba-9933-5b7b617f11b4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:01.030240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-9d482ce8-cf2b-41ba-9933-5b7b617f11b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:21:01.030240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:21:01.030240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:21:01.030240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:21:01.030240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:21:01.030240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:21:01.030240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:21:01.030240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:21:01.030240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:21:01.030240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:21:01.030240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:21:01.030240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:21:01.030240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:21:01.030240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:21:01.030240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:21:01.030240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:21:01.031285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:21:01.031285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:21:01.031285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:21:01.031285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:21:01.031285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:21:01.031285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:21:01.031285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:21:01.031285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:21:01.031285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:21:01.031285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:21:01.031285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:21:01.031285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:21:01.031285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:21:01.031285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:21:01.031285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:21:01.031285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:21:01.031285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:21:01.032164 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:21:01.032164 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:21:01.032164 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:21:01.032164 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 633/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:21:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:21:01.037529 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c1c75-97a9-4fe1-981d-6b9a356ddde1 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:01.150032 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c1c75-97a9-4fe1-981d-6b9a356ddde1 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:01.189587 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b4b69-3b57-4599-ab47-c4c9d66bdf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:01.190129 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b4b69-3b57-4599-ab47-c4c9d66bdf00 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:01.190409 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b4b69-3b57-4599-ab47-c4c9d66bdf00 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:01.190678 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b4b69-3b57-4599-ab47-c4c9d66bdf00 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:01.191324 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b4b69-3b57-4599-ab47-c4c9d66bdf00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:21:01.191627 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b4b69-3b57-4599-ab47-c4c9d66bdf00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:01.192987 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b4b69-3b57-4599-ab47-c4c9d66bdf00 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:01.205418 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 619/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:21:01.211287 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d482ce8-cf2b-41ba-9933-5b7b617f11b4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:01.322031 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d482ce8-cf2b-41ba-9933-5b7b617f11b4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:01.351969 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:01.361663 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0ead4-1abd-4023-b325-02277740d6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:01.362332 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0ead4-1abd-4023-b325-02277740d6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:01.362615 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0ead4-1abd-4023-b325-02277740d6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:01.362883 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0ead4-1abd-4023-b325-02277740d6b3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:01.372165 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0ead4-1abd-4023-b325-02277740d6b3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:01.373686 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0ead4-1abd-4023-b325-02277740d6b3 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:01.385804 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-79e0ead4-1abd-4023-b325-02277740d6b3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 02:21:01.385804 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:21:01.385804 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:21:01.385804 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:21:01.385804 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:21:01.385804 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:21:01.385804 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:21:01.385804 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:21:01.385804 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:21:01.385804 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:21:01.385804 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:21:01.385804 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:21:01.385804 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:21:01.385804 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:21:01.385804 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:21:01.385804 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:21:01.387575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:21:01.387575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:21:01.387575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:21:01.387575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:21:01.387575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:21:01.387575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:21:01.387575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:21:01.387575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:21:01.387575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:21:01.387575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:21:01.387575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:21:01.387575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:21:01.387575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:21:01.387575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:21:01.387575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:21:01.387575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:21:01.387575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:21:01.387575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:21:01.388525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:21:01.388525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:21:01.388525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:21:01.388525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:21:01.388525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:21:01.388525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:21:01.388525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:21:01.388525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:21:01.388525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 02:21:01.388525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:21:01.388525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 634/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:21:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:21:01.393760 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b4b69-3b57-4599-ab47-c4c9d66bdf00 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:01.451640 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:01.500701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b4b69-3b57-4599-ab47-c4c9d66bdf00 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:01.535566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556320b-4373-4e0d-9724-ea7498508c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:01.536319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556320b-4373-4e0d-9724-ea7498508c0f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:01.536663 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556320b-4373-4e0d-9724-ea7498508c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:01.536947 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556320b-4373-4e0d-9724-ea7498508c0f None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:01.537840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556320b-4373-4e0d-9724-ea7498508c0f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:21:01.538158 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556320b-4373-4e0d-9724-ea7498508c0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:01.539735 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556320b-4373-4e0d-9724-ea7498508c0f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:01.559406 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 620/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Aug 9 02:21:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:21:01.565654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0ead4-1abd-4023-b325-02277740d6b3 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:01.684056 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0ead4-1abd-4023-b325-02277740d6b3 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:01.723197 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcb4d7-9c0b-4931-bf1a-bb03a31d263d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:01.723841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcb4d7-9c0b-4931-bf1a-bb03a31d263d None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:01.724128 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcb4d7-9c0b-4931-bf1a-bb03a31d263d None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:01.724402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcb4d7-9c0b-4931-bf1a-bb03a31d263d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:01.787514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:01.804089 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fcb4d7-9c0b-4931-bf1a-bb03a31d263d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:01.805587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fcb4d7-9c0b-4931-bf1a-bb03a31d263d None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:01.915255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 635/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:21:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 02:21:01.921682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556320b-4373-4e0d-9724-ea7498508c0f None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:02.043467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556320b-4373-4e0d-9724-ea7498508c0f None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:02.058573 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:02.079945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877da3aa-a39a-4f8a-932a-ac83b45e5aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:02.080586 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877da3aa-a39a-4f8a-932a-ac83b45e5aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:02.080862 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877da3aa-a39a-4f8a-932a-ac83b45e5aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:02.081200 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877da3aa-a39a-4f8a-932a-ac83b45e5aa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:02.092397 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877da3aa-a39a-4f8a-932a-ac83b45e5aa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:02.093906 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877da3aa-a39a-4f8a-932a-ac83b45e5aa0 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:02.108752 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-877da3aa-a39a-4f8a-932a-ac83b45e5aa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:21:02.108752 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:21:02.108752 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:21:02.108752 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:21:02.108752 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:21:02.108752 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:21:02.108752 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:21:02.108752 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:21:02.108752 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:21:02.108752 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:21:02.108752 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:21:02.108752 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:21:02.108752 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:21:02.108752 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:21:02.108752 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:21:02.108752 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:21:02.109997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:21:02.109997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:21:02.109997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:21:02.109997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:21:02.109997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:21:02.109997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:21:02.109997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:21:02.109997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:21:02.109997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:21:02.109997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:21:02.109997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:21:02.109997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:21:02.109997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:21:02.109997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:21:02.109997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:21:02.109997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:21:02.109997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:21:02.110873 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:21:02.110873 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:21:02.110873 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:21:02.110873 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 621/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:21:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:21:02.116073 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcb4d7-9c0b-4931-bf1a-bb03a31d263d None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:02.207040 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:02.219982 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcb4d7-9c0b-4931-bf1a-bb03a31d263d None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:02.255476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5b8d6-5c1c-4886-a672-b05827787eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:02.256019 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5b8d6-5c1c-4886-a672-b05827787eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:02.256305 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5b8d6-5c1c-4886-a672-b05827787eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:02.256581 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5b8d6-5c1c-4886-a672-b05827787eb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:02.257263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5b8d6-5c1c-4886-a672-b05827787eb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:21:02.257636 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5b8d6-5c1c-4886-a672-b05827787eb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:02.259185 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5b8d6-5c1c-4886-a672-b05827787eb6 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:02.272843 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 636/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:21:02.279436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877da3aa-a39a-4f8a-932a-ac83b45e5aa0 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:02.394745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877da3aa-a39a-4f8a-932a-ac83b45e5aa0 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:02.434037 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e637d0b-94ff-4d4c-87aa-b8a5fe43b362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:02.434795 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e637d0b-94ff-4d4c-87aa-b8a5fe43b362 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:02.435095 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e637d0b-94ff-4d4c-87aa-b8a5fe43b362 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:02.435382 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e637d0b-94ff-4d4c-87aa-b8a5fe43b362 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:02.442588 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e637d0b-94ff-4d4c-87aa-b8a5fe43b362 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:02.444454 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e637d0b-94ff-4d4c-87aa-b8a5fe43b362 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:02.457126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-5e637d0b-94ff-4d4c-87aa-b8a5fe43b362 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:21:02.457126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:21:02.457126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:21:02.457126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:21:02.457126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:21:02.457126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:21:02.457126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:21:02.457126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:21:02.457126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:21:02.457126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:21:02.457126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:21:02.457126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:21:02.457126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:21:02.457126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:21:02.457126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:21:02.458215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:21:02.458215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:21:02.458215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:21:02.458215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:21:02.458215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:21:02.458215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:21:02.458215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:21:02.458215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:21:02.458215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:21:02.458215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:21:02.458215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:21:02.458215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:21:02.458215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:21:02.458215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:21:02.458215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:21:02.458215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:21:02.458215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:21:02.459211 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:21:02.459211 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:21:02.459211 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:21:02.459211 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:21:02.459211 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:21:02.459211 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:21:02.459211 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:21:02.459211 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:21:02.459211 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 622/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:21:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:21:02.464666 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5b8d6-5c1c-4886-a672-b05827787eb6 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:02.584753 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5b8d6-5c1c-4886-a672-b05827787eb6 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:02.625822 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c44cf-3c44-4ae6-9c16-f197d36b05b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:02.626653 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c44cf-3c44-4ae6-9c16-f197d36b05b5 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:02.627073 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c44cf-3c44-4ae6-9c16-f197d36b05b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:02.627449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c44cf-3c44-4ae6-9c16-f197d36b05b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:02.628332 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c44cf-3c44-4ae6-9c16-f197d36b05b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:21:02.628672 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c44cf-3c44-4ae6-9c16-f197d36b05b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:02.631117 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c44cf-3c44-4ae6-9c16-f197d36b05b5 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:02.649751 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 637/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:21:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:21:02.657063 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e637d0b-94ff-4d4c-87aa-b8a5fe43b362 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:02.686203 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:02.763764 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e637d0b-94ff-4d4c-87aa-b8a5fe43b362 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:02.805114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618240f-7c56-437c-8026-0e61f7837743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:02.805774 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618240f-7c56-437c-8026-0e61f7837743 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:02.806078 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618240f-7c56-437c-8026-0e61f7837743 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:02.806415 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618240f-7c56-437c-8026-0e61f7837743 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:02.807428 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618240f-7c56-437c-8026-0e61f7837743 None admin] RBAC: Adding query filter params (role.id=e2095c5a29d74c33b9dcb16f8e5343bf, scope.project.id=105476dcda7f48c28224d33c05860d6f, user.id=5fe21d9a65a34abeae7329df924d7998) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:21:02.807744 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618240f-7c56-437c-8026-0e61f7837743 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:02.809561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618240f-7c56-437c-8026-0e61f7837743 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:02.816257 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 623/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:21:02 2022] GET /identity/v3/role_assignments?user.id=5fe21d9a65a34abeae7329df924d7998&scope.project.id=105476dcda7f48c28224d33c05860d6f&role.id=e2095c5a29d74c33b9dcb16f8e5343bf => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:21:04.810768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecea367-2f7e-4c36-882e-f8df077edd90 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:04.811295 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecea367-2f7e-4c36-882e-f8df077edd90 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:04.811295 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecea367-2f7e-4c36-882e-f8df077edd90 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:04.812638 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 638/1261] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:21:04.817767 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ffc63-a164-4a8d-a76f-cbdc3b441c4d None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:04.818156 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ffc63-a164-4a8d-a76f-cbdc3b441c4d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:04.818313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ffc63-a164-4a8d-a76f-cbdc3b441c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:04.836262 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a55ffc63-a164-4a8d-a76f-cbdc3b441c4d None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:21:04.837471 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a55ffc63-a164-4a8d-a76f-cbdc3b441c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:21:04.901527 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 624/1262] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:21:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:21:04.923284 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecea367-2f7e-4c36-882e-f8df077edd90 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:04.933913 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:05.024347 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecea367-2f7e-4c36-882e-f8df077edd90 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:05.057272 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e8dda-90b1-429e-90ac-2025e708119c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:05.057894 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e8dda-90b1-429e-90ac-2025e708119c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:05.058176 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e8dda-90b1-429e-90ac-2025e708119c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:05.058951 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e8dda-90b1-429e-90ac-2025e708119c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:05.068913 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e8dda-90b1-429e-90ac-2025e708119c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:21:05.073622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-055e8dda-90b1-429e-90ac-2025e708119c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:21:05.073622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:21:05.073622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:21:05.073622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:21:05.073622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:21:05.073622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:21:05.073622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:21:05.073622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:21:05.073622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:21:05.073622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:21:05.073622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:21:05.073622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:21:05.073622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:21:05.073622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:21:05.073622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:21:05.073622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:21:05.075118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:21:05.075118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:21:05.075118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:21:05.075118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:21:05.075118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:21:05.075118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:21:05.075118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:21:05.075118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:21:05.075118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:21:05.075118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:21:05.075118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:21:05.075118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:21:05.075118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:21:05.075118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:21:05.075118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:21:05.075118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:21:05.076038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:21:05.076038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:21:05.076038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:21:05.076038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:21:05.076038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:21:05.076038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:21:05.076038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:21:05.076038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:21:05.076038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:21:05.076038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:21:05.076038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:21:05.076038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:21:05.076038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 639/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:21:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:21:05.081332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ffc63-a164-4a8d-a76f-cbdc3b441c4d None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:05.098961 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:05.183176 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ffc63-a164-4a8d-a76f-cbdc3b441c4d None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:05.216635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28525a-96b4-408b-a4f0-331dc2b1564d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:05.217261 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28525a-96b4-408b-a4f0-331dc2b1564d None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:05.217547 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28525a-96b4-408b-a4f0-331dc2b1564d None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:05.217820 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28525a-96b4-408b-a4f0-331dc2b1564d None admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:05.218483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28525a-96b4-408b-a4f0-331dc2b1564d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:21:05.218791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28525a-96b4-408b-a4f0-331dc2b1564d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:05.220159 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28525a-96b4-408b-a4f0-331dc2b1564d None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:05.227897 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 625/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:21:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:21:05.233600 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e8dda-90b1-429e-90ac-2025e708119c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:05.298855 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:05.331308 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e8dda-90b1-429e-90ac-2025e708119c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:05.364075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13456ddb-cb89-4aa9-a35d-bdc18236c3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:05.364682 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13456ddb-cb89-4aa9-a35d-bdc18236c3f7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:05.364961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13456ddb-cb89-4aa9-a35d-bdc18236c3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:05.365513 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13456ddb-cb89-4aa9-a35d-bdc18236c3f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:05.375110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13456ddb-cb89-4aa9-a35d-bdc18236c3f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:05.376546 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13456ddb-cb89-4aa9-a35d-bdc18236c3f7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:05.390955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-13456ddb-cb89-4aa9-a35d-bdc18236c3f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:21:05.390955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:21:05.390955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:21:05.390955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:21:05.390955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:21:05.390955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:21:05.390955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:21:05.390955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:21:05.390955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:21:05.390955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:21:05.390955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:21:05.390955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:21:05.390955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:21:05.390955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:21:05.390955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:21:05.390955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:21:05.392167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:21:05.392167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:21:05.392167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:21:05.392167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:21:05.392167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:21:05.392167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:21:05.392167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:21:05.392167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:21:05.392167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:21:05.392167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:21:05.392167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:21:05.392167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:21:05.392167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:21:05.392167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:21:05.392167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:21:05.392167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:21:05.392167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:21:05.393157 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:21:05.393157 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:21:05.393157 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:21:05.393157 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 640/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:21:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:21:05.397733 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28525a-96b4-408b-a4f0-331dc2b1564d None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:05.476517 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:05.495218 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28525a-96b4-408b-a4f0-331dc2b1564d None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:05.528087 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509255db-cc87-444d-ba4e-e7c39dcd7f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:05.528669 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509255db-cc87-444d-ba4e-e7c39dcd7f1e None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:05.528949 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509255db-cc87-444d-ba4e-e7c39dcd7f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:05.529247 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509255db-cc87-444d-ba4e-e7c39dcd7f1e None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:05.529881 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509255db-cc87-444d-ba4e-e7c39dcd7f1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:21:05.530183 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509255db-cc87-444d-ba4e-e7c39dcd7f1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:05.531538 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509255db-cc87-444d-ba4e-e7c39dcd7f1e None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:05.542797 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 626/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:21:05.548270 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13456ddb-cb89-4aa9-a35d-bdc18236c3f7 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:05.650523 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13456ddb-cb89-4aa9-a35d-bdc18236c3f7 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:05.673398 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:05.689267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca1b7d-686d-4d45-a179-079911a6be7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:05.689948 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca1b7d-686d-4d45-a179-079911a6be7e None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:05.690232 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca1b7d-686d-4d45-a179-079911a6be7e None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:05.690548 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca1b7d-686d-4d45-a179-079911a6be7e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:05.699584 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca1b7d-686d-4d45-a179-079911a6be7e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:05.701196 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca1b7d-686d-4d45-a179-079911a6be7e None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:05.712965 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-6eca1b7d-686d-4d45-a179-079911a6be7e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 02:21:05.712965 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:21:05.712965 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:21:05.712965 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:21:05.712965 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:21:05.712965 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:21:05.712965 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:21:05.712965 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:21:05.712965 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:21:05.712965 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:21:05.712965 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:21:05.712965 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:21:05.712965 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:21:05.712965 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:21:05.712965 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:21:05.712965 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:21:05.714155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:21:05.714155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:21:05.714155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:21:05.714155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:21:05.714155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:21:05.714155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:21:05.714155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:21:05.714155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:21:05.714155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:21:05.714155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:21:05.714155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:21:05.714155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:21:05.714155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:21:05.714155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:21:05.714155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:21:05.714155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:21:05.714155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:21:05.714155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:21:05.715787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:21:05.715787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:21:05.715787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:21:05.715787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:21:05.715787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:21:05.715787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:21:05.715787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:21:05.715787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:21:05.715787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 02:21:05.715787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:21:05.715787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 641/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:21:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:21:05.720422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509255db-cc87-444d-ba4e-e7c39dcd7f1e None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:05.823317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509255db-cc87-444d-ba4e-e7c39dcd7f1e None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:05.855521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71350182-1097-48c2-b1a7-6ec8e6abeeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:05.856115 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71350182-1097-48c2-b1a7-6ec8e6abeeef None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:05.856389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71350182-1097-48c2-b1a7-6ec8e6abeeef None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:05.856657 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71350182-1097-48c2-b1a7-6ec8e6abeeef None admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:05.857557 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71350182-1097-48c2-b1a7-6ec8e6abeeef None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:21:05.857860 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71350182-1097-48c2-b1a7-6ec8e6abeeef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:05.859268 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71350182-1097-48c2-b1a7-6ec8e6abeeef None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:05.867701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:05.876543 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 627/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Aug 9 02:21:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:21:05.882235 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca1b7d-686d-4d45-a179-079911a6be7e None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:05.978430 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca1b7d-686d-4d45-a179-079911a6be7e None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:06.010985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05211acc-5bf2-4d2f-89ac-56a750883454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:06.012172 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05211acc-5bf2-4d2f-89ac-56a750883454 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:06.012455 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05211acc-5bf2-4d2f-89ac-56a750883454 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:06.012720 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05211acc-5bf2-4d2f-89ac-56a750883454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:06.022657 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05211acc-5bf2-4d2f-89ac-56a750883454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:06.024078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05211acc-5bf2-4d2f-89ac-56a750883454 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:06.037354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-05211acc-5bf2-4d2f-89ac-56a750883454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:21:06.037354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:21:06.037354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:21:06.037354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:21:06.037354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:21:06.037354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:21:06.037354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:21:06.037354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:21:06.037354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:21:06.037354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:21:06.037354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:21:06.037354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:21:06.037354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:21:06.037354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:21:06.037354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:21:06.037354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:21:06.038456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:21:06.038456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:21:06.038456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:21:06.038456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:21:06.038456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:21:06.038456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:21:06.038456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:21:06.038456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:21:06.038456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:21:06.038456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:21:06.038456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:21:06.038456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:21:06.038456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:21:06.038456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:21:06.038456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:21:06.038456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:21:06.038456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:21:06.039358 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:21:06.039358 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:21:06.039358 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:21:06.039358 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 642/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:21:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:21:06.044064 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71350182-1097-48c2-b1a7-6ec8e6abeeef None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:06.147959 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71350182-1097-48c2-b1a7-6ec8e6abeeef None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:06.181492 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c6e4a-c86a-472a-88c9-ef4097bf7639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:06.182087 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c6e4a-c86a-472a-88c9-ef4097bf7639 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:06.182364 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c6e4a-c86a-472a-88c9-ef4097bf7639 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:06.182638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c6e4a-c86a-472a-88c9-ef4097bf7639 None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:06.183273 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c6e4a-c86a-472a-88c9-ef4097bf7639 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:21:06.184124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c6e4a-c86a-472a-88c9-ef4097bf7639 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:06.185505 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c6e4a-c86a-472a-88c9-ef4097bf7639 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:06.196280 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 628/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:21:06.201970 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05211acc-5bf2-4d2f-89ac-56a750883454 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:06.233175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:06.301268 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05211acc-5bf2-4d2f-89ac-56a750883454 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:06.333602 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315168da-c6f7-4483-9e66-530de5d6a04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:06.334215 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315168da-c6f7-4483-9e66-530de5d6a04b None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:06.334495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315168da-c6f7-4483-9e66-530de5d6a04b None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:06.334766 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315168da-c6f7-4483-9e66-530de5d6a04b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:06.341255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315168da-c6f7-4483-9e66-530de5d6a04b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:06.342686 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315168da-c6f7-4483-9e66-530de5d6a04b None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:06.353513 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-315168da-c6f7-4483-9e66-530de5d6a04b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:21:06.353513 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:21:06.353513 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:21:06.353513 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:21:06.353513 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:21:06.353513 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:21:06.353513 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:21:06.353513 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:21:06.353513 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:21:06.353513 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:21:06.353513 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:21:06.353513 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:21:06.353513 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:21:06.353513 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:21:06.353513 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:21:06.354557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:21:06.354557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:21:06.354557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:21:06.354557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:21:06.354557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:21:06.354557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:21:06.354557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:21:06.354557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:21:06.354557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:21:06.354557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:21:06.354557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:21:06.354557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:21:06.354557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:21:06.354557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:21:06.354557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:21:06.354557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:21:06.354557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:21:06.356015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:21:06.356015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:21:06.356015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:21:06.356015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:21:06.356015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:21:06.356015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:21:06.356015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:21:06.356015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:21:06.356015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 643/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:21:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:21:06.360728 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c6e4a-c86a-472a-88c9-ef4097bf7639 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:06.416878 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:06.458275 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c6e4a-c86a-472a-88c9-ef4097bf7639 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:06.491290 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a150a-3a7c-4965-8129-667d134691b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:06.491825 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a150a-3a7c-4965-8129-667d134691b9 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:06.492105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a150a-3a7c-4965-8129-667d134691b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:06.492378 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a150a-3a7c-4965-8129-667d134691b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:06.493084 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a150a-3a7c-4965-8129-667d134691b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:21:06.493393 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a150a-3a7c-4965-8129-667d134691b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:06.494805 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a150a-3a7c-4965-8129-667d134691b9 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:06.506303 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 629/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:21:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:21:06.512267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315168da-c6f7-4483-9e66-530de5d6a04b None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:06.600914 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:06.610218 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315168da-c6f7-4483-9e66-530de5d6a04b None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:06.646912 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce0b76-3365-4f02-b373-0964b9c38b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:06.647719 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce0b76-3365-4f02-b373-0964b9c38b18 None admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:06.648060 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce0b76-3365-4f02-b373-0964b9c38b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:06.648373 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce0b76-3365-4f02-b373-0964b9c38b18 None admin] PATH_INFO: `/v3/projects/105476dcda7f48c28224d33c05860d6f/users/5fe21d9a65a34abeae7329df924d7998/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:06.650553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce0b76-3365-4f02-b373-0964b9c38b18 None admin] RBAC: Authorizing `identity:create_grant(project_id=105476dcda7f48c28224d33c05860d6f, user_id=5fe21d9a65a34abeae7329df924d7998, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:06.652006 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce0b76-3365-4f02-b373-0964b9c38b18 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:06.665475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 644/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 9 02:21:06 2022] PUT /identity/v3/projects/105476dcda7f48c28224d33c05860d6f/users/5fe21d9a65a34abeae7329df924d7998/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:21:08.628012 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c271ce-92b7-4e40-9f89-5831b0dffd0b None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:08.628645 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c271ce-92b7-4e40-9f89-5831b0dffd0b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:08.628645 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c271ce-92b7-4e40-9f89-5831b0dffd0b None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:08.630192 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 630/1274] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:21:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:21:08.635503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964d764-1696-4cf8-9743-77b14100e855 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:08.636052 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964d764-1696-4cf8-9743-77b14100e855 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:08.636052 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964d764-1696-4cf8-9743-77b14100e855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:08.655403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2964d764-1696-4cf8-9743-77b14100e855 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:21:08.656639 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2964d764-1696-4cf8-9743-77b14100e855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:21:08.721904 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 645/1275] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:21:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 02:21:08.744847 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c271ce-92b7-4e40-9f89-5831b0dffd0b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:08.843045 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c271ce-92b7-4e40-9f89-5831b0dffd0b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:08.860351 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:08.877132 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e4080-eaf6-4af3-82be-e488b3c3c580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:08.877743 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e4080-eaf6-4af3-82be-e488b3c3c580 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:08.878074 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e4080-eaf6-4af3-82be-e488b3c3c580 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:08.878289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e4080-eaf6-4af3-82be-e488b3c3c580 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:08.888413 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e4080-eaf6-4af3-82be-e488b3c3c580 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 02:21:08.893039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-998e4080-eaf6-4af3-82be-e488b3c3c580 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:21:08.893039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:21:08.893039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:21:08.893039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:21:08.893039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:21:08.893039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:21:08.893039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:21:08.893039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:21:08.893039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:21:08.893039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:21:08.893039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:21:08.893039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:21:08.893039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 02:21:08.893039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 02:21:08.893039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 02:21:08.893039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 02:21:08.894124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 02:21:08.894124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 02:21:08.894124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 02:21:08.894124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 02:21:08.894124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:21:08.894124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:21:08.894124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:21:08.894124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:21:08.894124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:21:08.894124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:21:08.894124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:21:08.894124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:21:08.894124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:21:08.894124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:21:08.894124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:21:08.894124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:21:08.895150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:21:08.895150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:21:08.895150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:21:08.895150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:21:08.895150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 02:21:08.895150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 02:21:08.895150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 02:21:08.895150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 02:21:08.895150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 02:21:08.895150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 02:21:08.895150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 02:21:08.895150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:21:08.895150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 631/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 9 02:21:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:21:08.900123 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964d764-1696-4cf8-9743-77b14100e855 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:08.978878 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:08.998252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964d764-1696-4cf8-9743-77b14100e855 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:09.031003 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a6951-d4d3-46fa-b053-233d550fcbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:09.031586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a6951-d4d3-46fa-b053-233d550fcbe8 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:09.031914 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a6951-d4d3-46fa-b053-233d550fcbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:09.032128 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a6951-d4d3-46fa-b053-233d550fcbe8 None admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:09.033529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a6951-d4d3-46fa-b053-233d550fcbe8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:21:09.033529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a6951-d4d3-46fa-b053-233d550fcbe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:09.034449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63a6951-d4d3-46fa-b053-233d550fcbe8 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:09.042500 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 646/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 9 02:21:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:21:09.048217 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e4080-eaf6-4af3-82be-e488b3c3c580 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:09.145932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e4080-eaf6-4af3-82be-e488b3c3c580 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:09.178124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d207dd9-237f-43e3-abe0-7dfc5a94b3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:09.178736 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d207dd9-237f-43e3-abe0-7dfc5a94b3bb None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:09.179018 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d207dd9-237f-43e3-abe0-7dfc5a94b3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:09.179290 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d207dd9-237f-43e3-abe0-7dfc5a94b3bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:09.190137 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d207dd9-237f-43e3-abe0-7dfc5a94b3bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:09.191562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d207dd9-237f-43e3-abe0-7dfc5a94b3bb None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:09.205143 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-5d207dd9-237f-43e3-abe0-7dfc5a94b3bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:21:09.205143 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:21:09.205143 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:21:09.205143 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:21:09.205143 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:21:09.205143 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:21:09.205143 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:21:09.205143 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:21:09.205143 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:21:09.205143 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:21:09.205143 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:21:09.205143 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:21:09.205143 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:21:09.205143 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:21:09.205143 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:21:09.205143 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:21:09.206231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:21:09.206231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:21:09.206231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:21:09.206231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:21:09.206231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:21:09.206231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:21:09.206231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:21:09.206231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:21:09.206231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:21:09.206231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:21:09.206231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:21:09.206231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:21:09.206231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:21:09.206231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:21:09.206231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:21:09.206231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:21:09.206231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:21:09.207127 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:21:09.207127 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:21:09.207127 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:21:09.207127 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 632/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:21:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:21:09.211786 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a6951-d4d3-46fa-b053-233d550fcbe8 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:09.311777 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a6951-d4d3-46fa-b053-233d550fcbe8 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:09.343239 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c686d80-a6ab-4bdd-96f5-a4e72980e1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:09.343831 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c686d80-a6ab-4bdd-96f5-a4e72980e1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:09.344107 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c686d80-a6ab-4bdd-96f5-a4e72980e1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:09.344377 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c686d80-a6ab-4bdd-96f5-a4e72980e1b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:09.345007 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c686d80-a6ab-4bdd-96f5-a4e72980e1b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:21:09.345335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c686d80-a6ab-4bdd-96f5-a4e72980e1b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:09.346687 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c686d80-a6ab-4bdd-96f5-a4e72980e1b1 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:09.358359 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 647/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:21:09.363912 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d207dd9-237f-43e3-abe0-7dfc5a94b3bb None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:09.394368 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:09.461408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d207dd9-237f-43e3-abe0-7dfc5a94b3bb None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:09.494496 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9afd83-d999-4e52-9296-8f8332a66cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:09.495106 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9afd83-d999-4e52-9296-8f8332a66cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:09.495390 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9afd83-d999-4e52-9296-8f8332a66cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:09.495665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9afd83-d999-4e52-9296-8f8332a66cb0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:09.502847 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9afd83-d999-4e52-9296-8f8332a66cb0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:09.504275 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9afd83-d999-4e52-9296-8f8332a66cb0 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:09.515034 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-5d9afd83-d999-4e52-9296-8f8332a66cb0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 02:21:09.515034 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:21:09.515034 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:21:09.515034 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:21:09.515034 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:21:09.515034 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:21:09.515034 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:21:09.515034 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:21:09.515034 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:21:09.515034 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:21:09.515034 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:21:09.515034 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:21:09.515034 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 02:21:09.515034 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 02:21:09.515034 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 02:21:09.515034 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 02:21:09.516130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:21:09.516130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:21:09.516130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 02:21:09.516130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:21:09.516130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 02:21:09.516130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 02:21:09.516130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:21:09.516130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:21:09.516130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:21:09.516130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:21:09.516130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:21:09.516130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:21:09.516130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:21:09.516130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:21:09.516130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:21:09.516130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:21:09.516130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:21:09.516130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:21:09.517332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:21:09.517332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:21:09.517332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 02:21:09.517332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 02:21:09.517332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 02:21:09.517332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 02:21:09.517332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 02:21:09.517332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 02:21:09.517332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 02:21:09.517332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:21:09.517332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 633/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:21:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:21:09.521675 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c686d80-a6ab-4bdd-96f5-a4e72980e1b1 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:09.525322 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:09.618882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c686d80-a6ab-4bdd-96f5-a4e72980e1b1 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:09.653914 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4344d-038f-48df-84a9-a97e36e151f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:09.654532 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4344d-038f-48df-84a9-a97e36e151f7 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:09.654775 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4344d-038f-48df-84a9-a97e36e151f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:09.655044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4344d-038f-48df-84a9-a97e36e151f7 None admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:09.655762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4344d-038f-48df-84a9-a97e36e151f7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:21:09.656066 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4344d-038f-48df-84a9-a97e36e151f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:09.657528 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4344d-038f-48df-84a9-a97e36e151f7 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:09.674765 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 648/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Aug 9 02:21:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:21:09.680430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9afd83-d999-4e52-9296-8f8332a66cb0 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:09.775306 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:09.785282 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9afd83-d999-4e52-9296-8f8332a66cb0 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:09.818205 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ce886-ba2b-47a8-814c-4a14003d4e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:09.818798 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ce886-ba2b-47a8-814c-4a14003d4e56 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:09.819077 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ce886-ba2b-47a8-814c-4a14003d4e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:09.819348 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ce886-ba2b-47a8-814c-4a14003d4e56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:09.884272 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ce886-ba2b-47a8-814c-4a14003d4e56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:09.885726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ce886-ba2b-47a8-814c-4a14003d4e56 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:09.969322 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:09.981003 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 634/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 9 02:21:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 02:21:09.986851 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4344d-038f-48df-84a9-a97e36e151f7 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:10.051763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:10.088843 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4344d-038f-48df-84a9-a97e36e151f7 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:10.122041 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de962c8-851e-4a26-9ae6-d870b29f6ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:10.122653 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de962c8-851e-4a26-9ae6-d870b29f6ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:10.122930 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de962c8-851e-4a26-9ae6-d870b29f6ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:10.123201 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de962c8-851e-4a26-9ae6-d870b29f6ba4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:10.132702 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de962c8-851e-4a26-9ae6-d870b29f6ba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:10.134171 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de962c8-851e-4a26-9ae6-d870b29f6ba4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:10.147890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-0de962c8-851e-4a26-9ae6-d870b29f6ba4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:21:10.147890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:21:10.147890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:21:10.147890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:21:10.147890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:21:10.147890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:21:10.147890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:21:10.147890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:21:10.147890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:21:10.147890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:21:10.147890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:21:10.147890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:21:10.147890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 02:21:10.147890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 02:21:10.147890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 02:21:10.147890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 02:21:10.149004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:21:10.149004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:21:10.149004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:21:10.149004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:21:10.149004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:21:10.149004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:21:10.149004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:21:10.149004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:21:10.149004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:21:10.149004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:21:10.149004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:21:10.149004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:21:10.149004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:21:10.149004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:21:10.149004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:21:10.149004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:21:10.149004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 02:21:10.150405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 02:21:10.150405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 02:21:10.150405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:21:10.150405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 649/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:21:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:21:10.154821 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ce886-ba2b-47a8-814c-4a14003d4e56 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:10.250060 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ce886-ba2b-47a8-814c-4a14003d4e56 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:10.282163 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf979807-79d5-41e1-85ed-e77167292fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:10.282748 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf979807-79d5-41e1-85ed-e77167292fef None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:10.283023 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf979807-79d5-41e1-85ed-e77167292fef None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:10.283291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf979807-79d5-41e1-85ed-e77167292fef None admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:10.283918 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf979807-79d5-41e1-85ed-e77167292fef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:21:10.284216 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf979807-79d5-41e1-85ed-e77167292fef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:10.285602 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf979807-79d5-41e1-85ed-e77167292fef None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:10.296849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 635/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 9 02:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:21:10.302392 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de962c8-851e-4a26-9ae6-d870b29f6ba4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:10.399399 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de962c8-851e-4a26-9ae6-d870b29f6ba4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:10.412760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:10.432523 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1a6cf-12c7-4818-a9da-3caa99b175f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:10.433162 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1a6cf-12c7-4818-a9da-3caa99b175f4 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:10.433461 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1a6cf-12c7-4818-a9da-3caa99b175f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:10.433736 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1a6cf-12c7-4818-a9da-3caa99b175f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:10.440071 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1a6cf-12c7-4818-a9da-3caa99b175f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:10.441551 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1a6cf-12c7-4818-a9da-3caa99b175f4 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:10.452168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application [None req-fcc1a6cf-12c7-4818-a9da-3caa99b175f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:21:10.452168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:21:10.452168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:21:10.452168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:21:10.452168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:21:10.452168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:21:10.452168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:21:10.452168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:21:10.452168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:21:10.452168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:21:10.452168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:21:10.452168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:21:10.452168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 02:21:10.452168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 02:21:10.452168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 02:21:10.453245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 02:21:10.453245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:21:10.453245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:21:10.453245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:21:10.453245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:21:10.453245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:21:10.453245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:21:10.453245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:21:10.453245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application with Lock( Aug 09 02:21:10.453245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:21:10.453245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:21:10.453245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:21:10.453245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:21:10.453245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:21:10.453245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:21:10.453245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:21:10.453245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:21:10.454511 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 02:21:10.454511 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 02:21:10.454511 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 02:21:10.454511 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 02:21:10.454511 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 02:21:10.454511 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 02:21:10.454511 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 02:21:10.454511 dv-cinder-852461-1-smb devstack@keystone.service[80285]: ERROR keystone.server.flask.application Aug 09 02:21:10.454511 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 650/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 9 02:21:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:21:10.459012 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf979807-79d5-41e1-85ed-e77167292fef None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:10.508032 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:10.557481 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf979807-79d5-41e1-85ed-e77167292fef None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:10.590546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec9bce-fb0a-45cc-a2ba-21f492b4d20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:10.591144 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec9bce-fb0a-45cc-a2ba-21f492b4d20f None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:10.591425 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec9bce-fb0a-45cc-a2ba-21f492b4d20f None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:10.591696 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec9bce-fb0a-45cc-a2ba-21f492b4d20f None admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:10.592381 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec9bce-fb0a-45cc-a2ba-21f492b4d20f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:21:10.592686 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec9bce-fb0a-45cc-a2ba-21f492b4d20f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:10.594141 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec9bce-fb0a-45cc-a2ba-21f492b4d20f None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:10.605925 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 636/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 9 02:21:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:21:10.611802 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1a6cf-12c7-4818-a9da-3caa99b175f4 None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:10.712570 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1a6cf-12c7-4818-a9da-3caa99b175f4 None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:10.744857 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9e835-6e70-4529-8311-d69d872731ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:10.745474 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9e835-6e70-4529-8311-d69d872731ef None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:10.745751 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9e835-6e70-4529-8311-d69d872731ef None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:10.746044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9e835-6e70-4529-8311-d69d872731ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:10.746758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9e835-6e70-4529-8311-d69d872731ef None admin] RBAC: Adding query filter params (role.id=e2095c5a29d74c33b9dcb16f8e5343bf, scope.project.id=105476dcda7f48c28224d33c05860d6f, user.id=5fe21d9a65a34abeae7329df924d7998) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:21:10.747063 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9e835-6e70-4529-8311-d69d872731ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:10.748487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9e835-6e70-4529-8311-d69d872731ef None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:10.754049 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 651/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 9 02:21:10 2022] GET /identity/v3/role_assignments?user.id=5fe21d9a65a34abeae7329df924d7998&scope.project.id=105476dcda7f48c28224d33c05860d6f&role.id=e2095c5a29d74c33b9dcb16f8e5343bf => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:21:12.745749 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7ef09-3f8b-487e-b482-4e3494136930 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:12.746770 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7ef09-3f8b-487e-b482-4e3494136930 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:12.746770 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7ef09-3f8b-487e-b482-4e3494136930 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:12.748131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 637/1288] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:21:12.753051 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ce948-04ad-454d-ab47-7df8c9d01904 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:12.753463 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ce948-04ad-454d-ab47-7df8c9d01904 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:12.753620 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ce948-04ad-454d-ab47-7df8c9d01904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:12.771813 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-576ce948-04ad-454d-ab47-7df8c9d01904 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:21:12.772997 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-576ce948-04ad-454d-ab47-7df8c9d01904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:21:12.801678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:12.838459 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 652/1289] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:21:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:21:12.860944 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7ef09-3f8b-487e-b482-4e3494136930 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:12.957851 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7ef09-3f8b-487e-b482-4e3494136930 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:12.967861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:12.993588 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbd081-7c86-4e1e-b3cb-6ae6ee1f9860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:12.994209 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbd081-7c86-4e1e-b3cb-6ae6ee1f9860 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:12.994484 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbd081-7c86-4e1e-b3cb-6ae6ee1f9860 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:12.994748 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbd081-7c86-4e1e-b3cb-6ae6ee1f9860 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:12.995315 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbd081-7c86-4e1e-b3cb-6ae6ee1f9860 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:12.997393 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbd081-7c86-4e1e-b3cb-6ae6ee1f9860 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:13.005691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-f4fbd081-7c86-4e1e-b3cb-6ae6ee1f9860 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 02:21:13.005691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:21:13.005691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 02:21:13.005691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 02:21:13.005691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 02:21:13.005691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 02:21:13.005691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 02:21:13.005691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:21:13.005691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 02:21:13.005691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:21:13.005691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:21:13.005691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:21:13.005691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:21:13.005691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:21:13.005691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:21:13.005691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:21:13.005691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:21:13.007056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:21:13.007056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:21:13.007056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:21:13.007056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:21:13.007056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:21:13.007056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:21:13.007056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 02:21:13.007056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 02:21:13.007056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 02:21:13.007056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 02:21:13.007056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:21:13.007056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:21:13.007056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:21:13.007056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:21:13.007056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:21:13.007056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:21:13.008110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:21:13.008110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:21:13.008110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:21:13.008110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:21:13.008110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:21:13.008110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:21:13.008110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:21:13.008110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:21:13.008110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:21:13.008110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:21:13.008110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 02:21:13.008110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:21:13.008110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 02:21:13.008110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:21:13.008110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 638/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 9 02:21:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:21:13.012645 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ce948-04ad-454d-ab47-7df8c9d01904 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:13.110973 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ce948-04ad-454d-ab47-7df8c9d01904 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:13.143796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad9145-4446-41de-afd2-7d242217fe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:13.144392 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad9145-4446-41de-afd2-7d242217fe48 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:13.144671 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad9145-4446-41de-afd2-7d242217fe48 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:13.144943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad9145-4446-41de-afd2-7d242217fe48 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:13.145600 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad9145-4446-41de-afd2-7d242217fe48 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:21:13.145906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad9145-4446-41de-afd2-7d242217fe48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:13.147299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad9145-4446-41de-afd2-7d242217fe48 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:13.151930 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 653/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Tue Aug 9 02:21:13 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:21:13.157569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbd081-7c86-4e1e-b3cb-6ae6ee1f9860 None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:13.254328 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbd081-7c86-4e1e-b3cb-6ae6ee1f9860 None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:13.286396 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd22dfc-f0e1-4036-935a-a403c6baf0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:13.286981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd22dfc-f0e1-4036-935a-a403c6baf0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:13.287266 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd22dfc-f0e1-4036-935a-a403c6baf0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:13.287541 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd22dfc-f0e1-4036-935a-a403c6baf0b4 None admin] PATH_INFO: `/v3/services` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:13.288162 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd22dfc-f0e1-4036-935a-a403c6baf0b4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:21:13.288469 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd22dfc-f0e1-4036-935a-a403c6baf0b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:13.289864 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd22dfc-f0e1-4036-935a-a403c6baf0b4 None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:13.294674 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 639/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Tue Aug 9 02:21:13 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:21:15.255426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d900c-772b-458a-9b4d-479d43bdc446 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:15.255931 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d900c-772b-458a-9b4d-479d43bdc446 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:15.255931 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d900c-772b-458a-9b4d-479d43bdc446 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:15.257264 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 654/1293] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:21:15.262462 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143e808-45fd-48b5-9f0f-06570b933a8a None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:15.262846 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143e808-45fd-48b5-9f0f-06570b933a8a None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:15.263012 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143e808-45fd-48b5-9f0f-06570b933a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:15.280505 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-8143e808-45fd-48b5-9f0f-06570b933a8a None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:21:15.281699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8143e808-45fd-48b5-9f0f-06570b933a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:21:15.310508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:15.345192 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 640/1294] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:21:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:21:15.367691 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d900c-772b-458a-9b4d-479d43bdc446 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:15.398179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:15.466742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d900c-772b-458a-9b4d-479d43bdc446 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:15.499331 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd38bf0-a22e-4923-909b-eb1b5d6f632c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:15.499916 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd38bf0-a22e-4923-909b-eb1b5d6f632c None admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:15.500194 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd38bf0-a22e-4923-909b-eb1b5d6f632c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:15.500465 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd38bf0-a22e-4923-909b-eb1b5d6f632c None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:15.501136 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd38bf0-a22e-4923-909b-eb1b5d6f632c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:15.502494 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd38bf0-a22e-4923-909b-eb1b5d6f632c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:15.516488 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 655/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 9 02:21:15 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:21:17.482670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b5317-4a8b-4811-9b49-10d26b6768ab None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:17.483193 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b5317-4a8b-4811-9b49-10d26b6768ab None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:17.483193 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b5317-4a8b-4811-9b49-10d26b6768ab None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:17.484550 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 641/1296] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:21:17.489702 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a15ff8-b582-4f9a-9c79-df957f7b76d0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:17.490063 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a15ff8-b582-4f9a-9c79-df957f7b76d0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:17.490271 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a15ff8-b582-4f9a-9c79-df957f7b76d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:17.508725 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-13a15ff8-b582-4f9a-9c79-df957f7b76d0 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:21:17.509958 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-13a15ff8-b582-4f9a-9c79-df957f7b76d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:21:17.580668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 656/1297] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:21:17 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:21:17.603201 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b5317-4a8b-4811-9b49-10d26b6768ab None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:17.718233 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b5317-4a8b-4811-9b49-10d26b6768ab None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:17.751891 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae0585-bbca-4249-8dd9-6962d1f852bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:17.752451 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae0585-bbca-4249-8dd9-6962d1f852bf None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:17.752731 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae0585-bbca-4249-8dd9-6962d1f852bf None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:17.753001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae0585-bbca-4249-8dd9-6962d1f852bf None admin] PATH_INFO: `/v3/services/placement` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:17.753604 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae0585-bbca-4249-8dd9-6962d1f852bf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:17.754955 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae0585-bbca-4249-8dd9-6962d1f852bf None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:17.763344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-f6ae0585-bbca-4249-8dd9-6962d1f852bf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 02:21:17.763344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:21:17.763344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 02:21:17.763344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 02:21:17.763344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 02:21:17.763344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 02:21:17.763344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 02:21:17.763344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:21:17.763344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 02:21:17.763344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:21:17.763344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:21:17.763344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:21:17.763344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:21:17.763344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:21:17.763344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:21:17.763344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:21:17.763344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:21:17.764502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:21:17.764502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:21:17.764502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:21:17.764502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:21:17.764502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:21:17.764502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:21:17.764502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 02:21:17.764502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 02:21:17.764502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 02:21:17.764502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 02:21:17.764502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:21:17.764502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:21:17.764502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:21:17.764502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:21:17.764502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:21:17.764502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:21:17.765374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:21:17.765374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:21:17.765374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:21:17.765374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:21:17.765374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:21:17.765374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:21:17.765374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:21:17.765374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:21:17.765374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:21:17.765374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:21:17.765374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 02:21:17.765374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:21:17.765374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 02:21:17.765374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:21:17.765374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 642/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 9 02:21:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:21:17.770440 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a15ff8-b582-4f9a-9c79-df957f7b76d0 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:17.788689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:17.870575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a15ff8-b582-4f9a-9c79-df957f7b76d0 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:17.905911 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221dbe91-0b25-4c5e-a05a-fc1ca4622c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:17.906526 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221dbe91-0b25-4c5e-a05a-fc1ca4622c4c None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:17.906808 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221dbe91-0b25-4c5e-a05a-fc1ca4622c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:17.907082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221dbe91-0b25-4c5e-a05a-fc1ca4622c4c None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:17.907714 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221dbe91-0b25-4c5e-a05a-fc1ca4622c4c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:21:17.908020 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221dbe91-0b25-4c5e-a05a-fc1ca4622c4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:17.909434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221dbe91-0b25-4c5e-a05a-fc1ca4622c4c None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:17.914842 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 657/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Tue Aug 9 02:21:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:21:17.921410 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae0585-bbca-4249-8dd9-6962d1f852bf None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:17.952847 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:18.022186 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae0585-bbca-4249-8dd9-6962d1f852bf None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:18.055767 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be609e5d-ca70-45a4-af22-f76b773d290b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:18.056374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be609e5d-ca70-45a4-af22-f76b773d290b None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:18.056651 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be609e5d-ca70-45a4-af22-f76b773d290b None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:18.056921 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be609e5d-ca70-45a4-af22-f76b773d290b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:18.057659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be609e5d-ca70-45a4-af22-f76b773d290b None admin] RBAC: Adding query filter params (interface=public, service_id=f2faca5e0fbc4f0aaad0162ae3a169b0, region_id=RegionOne) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:21:18.057967 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be609e5d-ca70-45a4-af22-f76b773d290b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:18.059354 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be609e5d-ca70-45a4-af22-f76b773d290b None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:18.064277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 643/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 9 02:21:17 2022] GET /identity/v3/endpoints?service_id=f2faca5e0fbc4f0aaad0162ae3a169b0&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:21:18.070041 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221dbe91-0b25-4c5e-a05a-fc1ca4622c4c None admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:18.149968 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:18.168176 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221dbe91-0b25-4c5e-a05a-fc1ca4622c4c None admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:18.200603 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62e607-aaa6-4002-bf8f-35ee5f35a196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:18.201223 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62e607-aaa6-4002-bf8f-35ee5f35a196 None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:18.201514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62e607-aaa6-4002-bf8f-35ee5f35a196 None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:18.201785 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62e607-aaa6-4002-bf8f-35ee5f35a196 None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:18.202385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62e607-aaa6-4002-bf8f-35ee5f35a196 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:18.203744 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62e607-aaa6-4002-bf8f-35ee5f35a196 None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:18.210372 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 658/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 9 02:21:18 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:21:20.199656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d1490-dd9c-4e0e-a3bc-c00f1c554d38 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:20.200231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d1490-dd9c-4e0e-a3bc-c00f1c554d38 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:20.200231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d1490-dd9c-4e0e-a3bc-c00f1c554d38 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:20.201602 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 644/1302] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:21:20.206515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81757e-8299-4d47-8f15-64c02e0e4bf0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:20.206910 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81757e-8299-4d47-8f15-64c02e0e4bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:20.207059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81757e-8299-4d47-8f15-64c02e0e4bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:20.225094 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8b81757e-8299-4d47-8f15-64c02e0e4bf0 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:21:20.226283 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8b81757e-8299-4d47-8f15-64c02e0e4bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:21:20.290012 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 659/1303] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:21:20 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 02:21:20.312546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d1490-dd9c-4e0e-a3bc-c00f1c554d38 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:20.405849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:20.412402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d1490-dd9c-4e0e-a3bc-c00f1c554d38 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:20.443890 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42846c97-10db-4ede-8614-0ed74d7f12af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:20.444501 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42846c97-10db-4ede-8614-0ed74d7f12af None admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:20.444782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42846c97-10db-4ede-8614-0ed74d7f12af None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:20.445074 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42846c97-10db-4ede-8614-0ed74d7f12af None admin] PATH_INFO: `/v3/services/placement` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:20.445650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42846c97-10db-4ede-8614-0ed74d7f12af None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:20.447001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42846c97-10db-4ede-8614-0ed74d7f12af None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:20.455903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application [None req-42846c97-10db-4ede-8614-0ed74d7f12af None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 02:21:20.455903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:21:20.455903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 02:21:20.455903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 02:21:20.455903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 02:21:20.455903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 02:21:20.455903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 02:21:20.455903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:21:20.455903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 02:21:20.455903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:21:20.455903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 02:21:20.455903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:21:20.455903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 02:21:20.455903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 02:21:20.455903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 02:21:20.455903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 02:21:20.455903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 02:21:20.457140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 02:21:20.457140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 02:21:20.457140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 02:21:20.457140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 02:21:20.457140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 02:21:20.457140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 02:21:20.457140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 02:21:20.457140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 02:21:20.457140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 02:21:20.457140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 02:21:20.457140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 02:21:20.457140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 02:21:20.457140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 02:21:20.457140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 02:21:20.457140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 02:21:20.457140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 02:21:20.458226 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 02:21:20.458226 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application with Lock( Aug 09 02:21:20.458226 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 02:21:20.458226 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self._enter() Aug 09 02:21:20.458226 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 02:21:20.458226 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 02:21:20.458226 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 02:21:20.458226 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application return self.creator() Aug 09 02:21:20.458226 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 02:21:20.458226 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application created_value = creator( Aug 09 02:21:20.458226 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 02:21:20.458226 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 02:21:20.458226 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 02:21:20.458226 dv-cinder-852461-1-smb devstack@keystone.service[80286]: ERROR keystone.server.flask.application Aug 09 02:21:20.458226 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 645/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 9 02:21:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 02:21:20.462867 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81757e-8299-4d47-8f15-64c02e0e4bf0 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:20.535667 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:20.557947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81757e-8299-4d47-8f15-64c02e0e4bf0 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:20.590598 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c4aa0-cc40-4a51-a6b6-2f68c6488cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:20.591187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c4aa0-cc40-4a51-a6b6-2f68c6488cee None admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:20.591463 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c4aa0-cc40-4a51-a6b6-2f68c6488cee None admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:20.591732 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c4aa0-cc40-4a51-a6b6-2f68c6488cee None admin] PATH_INFO: `/v3/services` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:20.592354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c4aa0-cc40-4a51-a6b6-2f68c6488cee None admin] RBAC: Adding query filter params (name=placement) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:21:20.592656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c4aa0-cc40-4a51-a6b6-2f68c6488cee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:20.594037 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c4aa0-cc40-4a51-a6b6-2f68c6488cee None admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:20.599243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 660/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Tue Aug 9 02:21:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:21:20.604716 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42846c97-10db-4ede-8614-0ed74d7f12af None admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:21:20.712894 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42846c97-10db-4ede-8614-0ed74d7f12af None admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:21:20.746607 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2d5ed-3ea0-45af-bd11-dc60208970cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:21:20.747201 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2d5ed-3ea0-45af-bd11-dc60208970cf None admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:21:20.747478 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2d5ed-3ea0-45af-bd11-dc60208970cf None admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:21:20.747746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2d5ed-3ea0-45af-bd11-dc60208970cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:21:20.748405 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2d5ed-3ea0-45af-bd11-dc60208970cf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:21:20.749786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2d5ed-3ea0-45af-bd11-dc60208970cf None admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:21:20.768657 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 646/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:21:20 2022] POST /identity/v3/endpoints => generated 331 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:21:30.596455 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=30 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:21:30.764419 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:22:23.687607 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037d00b-5212-40fb-aa99-5cef41a576ee None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:23.687607 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037d00b-5212-40fb-aa99-5cef41a576ee None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:23.687607 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037d00b-5212-40fb-aa99-5cef41a576ee None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:23.694301 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8c870-1879-4ef3-8f60-e477fb652746 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:23.694682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8c870-1879-4ef3-8f60-e477fb652746 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:23.694863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8c870-1879-4ef3-8f60-e477fb652746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:23.697515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 661/1307] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:22:23 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:22:23.812807 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-b4f8c870-1879-4ef3-8f60-e477fb652746 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:22:23.814353 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b4f8c870-1879-4ef3-8f60-e477fb652746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:23.977236 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 647/1308] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:22:24.021159 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00955b3-0f23-43ba-be4e-4193303b52e8 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:24.021886 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00955b3-0f23-43ba-be4e-4193303b52e8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:24.022386 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00955b3-0f23-43ba-be4e-4193303b52e8 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:24.024517 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 662/1309] 10.222.0.16 () {54 vars in 965 bytes} [Tue Aug 9 02:22:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:22:24.031103 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc00f8-1e05-4c26-af8d-212c2249fe75 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:24.031398 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc00f8-1e05-4c26-af8d-212c2249fe75 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:24.031591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc00f8-1e05-4c26-af8d-212c2249fe75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:24.112273 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-9cbc00f8-1e05-4c26-af8d-212c2249fe75 None None] MFA Rules not processed for user `d608fede6f5e4b339f8de0354cc0562b`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:22:24.113563 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9cbc00f8-1e05-4c26-af8d-212c2249fe75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:24.135825 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:22:24.195674 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 648/1310] 10.222.0.16 () {58 vars in 1062 bytes} [Tue Aug 9 02:22:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:22:24.204972 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00955b3-0f23-43ba-be4e-4193303b52e8 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:22:24.206800 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b00955b3-0f23-43ba-be4e-4193303b52e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:24.317244 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00955b3-0f23-43ba-be4e-4193303b52e8 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:22:24.400413 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6723dac-27f0-4542-a62d-1b337be06e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:22:24.401342 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6723dac-27f0-4542-a62d-1b337be06e90 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:24.401796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6723dac-27f0-4542-a62d-1b337be06e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:24.402272 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6723dac-27f0-4542-a62d-1b337be06e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:24.404840 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d6723dac-27f0-4542-a62d-1b337be06e90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:24.464302 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:22:24.534419 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6723dac-27f0-4542-a62d-1b337be06e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:22:24.536162 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6723dac-27f0-4542-a62d-1b337be06e90 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:22:24.559538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 663/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:22:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:22:26.885267 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278aac9-ce11-41a8-993e-a08cef8de9f9 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:26.885835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278aac9-ce11-41a8-993e-a08cef8de9f9 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:26.885835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278aac9-ce11-41a8-993e-a08cef8de9f9 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:26.887189 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 649/1312] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:22:26.892279 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec45554-5509-4292-b586-727e872f854a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:26.892667 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec45554-5509-4292-b586-727e872f854a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:26.892824 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec45554-5509-4292-b586-727e872f854a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:26.963397 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-bec45554-5509-4292-b586-727e872f854a None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:22:26.964594 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bec45554-5509-4292-b586-727e872f854a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:27.070273 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 664/1313] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:22:27.110259 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278aac9-ce11-41a8-993e-a08cef8de9f9 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:22:27.111835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b278aac9-ce11-41a8-993e-a08cef8de9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:27.220367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278aac9-ce11-41a8-993e-a08cef8de9f9 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:22:27.292085 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:22:27.294659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0e7aa-7f4b-4816-94b3-e5b9544dc6fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:22:27.295290 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0e7aa-7f4b-4816-94b3-e5b9544dc6fe service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:27.295758 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0e7aa-7f4b-4816-94b3-e5b9544dc6fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:27.296186 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0e7aa-7f4b-4816-94b3-e5b9544dc6fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:27.298017 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c8d0e7aa-7f4b-4816-94b3-e5b9544dc6fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:27.413459 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0e7aa-7f4b-4816-94b3-e5b9544dc6fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:22:27.414994 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0e7aa-7f4b-4816-94b3-e5b9544dc6fe service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:22:27.436753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 650/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:22:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:22:29.706562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a543d-7b9f-44de-899f-3a6bc2684a5d None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:29.707078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a543d-7b9f-44de-899f-3a6bc2684a5d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:29.707078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a543d-7b9f-44de-899f-3a6bc2684a5d None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:29.708386 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 665/1315] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:22:29.713571 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794fc05-eadd-4470-b3c9-fbac0f552b90 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:29.713979 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794fc05-eadd-4470-b3c9-fbac0f552b90 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:29.714115 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794fc05-eadd-4470-b3c9-fbac0f552b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:29.781585 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-2794fc05-eadd-4470-b3c9-fbac0f552b90 None None] MFA Rules not processed for user `c03490a890814d2db0a221cf0a15aed9`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:22:29.782790 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2794fc05-eadd-4470-b3c9-fbac0f552b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:29.832830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:22:29.876889 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 651/1316] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:22:29 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:22:29.931464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aaaa6c-7cf0-48fb-b723-923db669cc49 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:29.931747 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aaaa6c-7cf0-48fb-b723-923db669cc49 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:29.932039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aaaa6c-7cf0-48fb-b723-923db669cc49 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:29.933478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 666/1317] 10.222.0.16 () {54 vars in 965 bytes} [Tue Aug 9 02:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:22:29.939100 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cfc98-04b2-423a-93f3-6e9450091798 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:29.939388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cfc98-04b2-423a-93f3-6e9450091798 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:29.939659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cfc98-04b2-423a-93f3-6e9450091798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:30.012950 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a56cfc98-04b2-423a-93f3-6e9450091798 None None] MFA Rules not processed for user `d608fede6f5e4b339f8de0354cc0562b`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:22:30.014172 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a56cfc98-04b2-423a-93f3-6e9450091798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:30.088404 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 652/1318] 10.222.0.16 () {58 vars in 1062 bytes} [Tue Aug 9 02:22:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:22:30.098546 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aaaa6c-7cf0-48fb-b723-923db669cc49 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:22:30.100197 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e4aaaa6c-7cf0-48fb-b723-923db669cc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:30.110972 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:22:30.204128 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aaaa6c-7cf0-48fb-b723-923db669cc49 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:22:30.275873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b95655-5696-48c4-8b37-c996fa63c826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:22:30.276472 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b95655-5696-48c4-8b37-c996fa63c826 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:30.276750 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b95655-5696-48c4-8b37-c996fa63c826 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:30.277045 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b95655-5696-48c4-8b37-c996fa63c826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:30.279254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-71b95655-5696-48c4-8b37-c996fa63c826 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:30.343049 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:22:30.388868 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b95655-5696-48c4-8b37-c996fa63c826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:22:30.390349 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b95655-5696-48c4-8b37-c996fa63c826 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:22:30.408862 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 667/1319] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:22:30 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:22:33.316458 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b71a7e-1eef-4972-b52a-fad8d82e8859 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:33.316977 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b71a7e-1eef-4972-b52a-fad8d82e8859 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:33.317102 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b71a7e-1eef-4972-b52a-fad8d82e8859 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:33.318435 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 653/1320] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:22:33.323483 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f1647-6247-455e-a93f-bebc251abe1d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:33.323860 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f1647-6247-455e-a93f-bebc251abe1d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:33.324570 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f1647-6247-455e-a93f-bebc251abe1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:33.393857 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-3e7f1647-6247-455e-a93f-bebc251abe1d None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:22:33.395058 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3e7f1647-6247-455e-a93f-bebc251abe1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:33.492619 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 668/1321] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:22:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:22:33.531014 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b71a7e-1eef-4972-b52a-fad8d82e8859 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:22:33.532542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-48b71a7e-1eef-4972-b52a-fad8d82e8859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:33.581584 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:22:33.635406 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b71a7e-1eef-4972-b52a-fad8d82e8859 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:22:33.709134 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c5a62f-2e83-49a0-88b6-69f2e502fd5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:22:33.709726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5a62f-2e83-49a0-88b6-69f2e502fd5b service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:33.710003 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5a62f-2e83-49a0-88b6-69f2e502fd5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:33.710268 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c5a62f-2e83-49a0-88b6-69f2e502fd5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:33.711979 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c8c5a62f-2e83-49a0-88b6-69f2e502fd5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:33.805626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:22:33.819395 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5a62f-2e83-49a0-88b6-69f2e502fd5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:22:33.820811 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c5a62f-2e83-49a0-88b6-69f2e502fd5b service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:22:33.838682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 654/1322] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:22:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:22:36.500996 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df31c6-4f4d-46f1-aa30-5953fd4f3442 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:36.501552 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df31c6-4f4d-46f1-aa30-5953fd4f3442 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:36.501552 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df31c6-4f4d-46f1-aa30-5953fd4f3442 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:36.502922 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 669/1323] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:22:36.507988 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d317c-a8a8-413f-a718-efbc3c518fbc None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:36.508399 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d317c-a8a8-413f-a718-efbc3c518fbc None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:36.508568 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d317c-a8a8-413f-a718-efbc3c518fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:36.576387 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-515d317c-a8a8-413f-a718-efbc3c518fbc None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:22:36.577622 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-515d317c-a8a8-413f-a718-efbc3c518fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:36.679646 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 655/1324] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:22:36.716288 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df31c6-4f4d-46f1-aa30-5953fd4f3442 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:22:36.717936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b3df31c6-4f4d-46f1-aa30-5953fd4f3442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:36.738846 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:22:36.829875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df31c6-4f4d-46f1-aa30-5953fd4f3442 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:22:36.904524 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a21475-59df-4ae3-b8dd-84aca65fdf5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:22:36.905150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a21475-59df-4ae3-b8dd-84aca65fdf5a service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:36.905434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a21475-59df-4ae3-b8dd-84aca65fdf5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:36.905702 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a21475-59df-4ae3-b8dd-84aca65fdf5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:36.907307 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c6a21475-59df-4ae3-b8dd-84aca65fdf5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:36.978895 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:22:37.019452 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a21475-59df-4ae3-b8dd-84aca65fdf5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:22:37.020896 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a21475-59df-4ae3-b8dd-84aca65fdf5a service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:22:37.040021 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 670/1325] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:22:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:22:39.110023 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab7395-88e2-420d-a258-973be76a979c None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:39.110521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab7395-88e2-420d-a258-973be76a979c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:39.110652 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab7395-88e2-420d-a258-973be76a979c None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:39.111933 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 656/1326] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:22:39.117222 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a727f1e-74e2-4ea2-8412-b7a809a9634f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:39.117671 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a727f1e-74e2-4ea2-8412-b7a809a9634f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:39.117925 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a727f1e-74e2-4ea2-8412-b7a809a9634f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:39.190919 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8a727f1e-74e2-4ea2-8412-b7a809a9634f None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:22:39.192138 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8a727f1e-74e2-4ea2-8412-b7a809a9634f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:39.288805 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 671/1327] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:22:39.324415 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab7395-88e2-420d-a258-973be76a979c None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:22:39.326055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-32ab7395-88e2-420d-a258-973be76a979c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:39.388732 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:22:39.431716 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab7395-88e2-420d-a258-973be76a979c None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:22:39.506256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b20f3-1bd8-4f80-bb69-8f7eb1d0e97a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:22:39.506875 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b20f3-1bd8-4f80-bb69-8f7eb1d0e97a service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:39.507158 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b20f3-1bd8-4f80-bb69-8f7eb1d0e97a service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:39.507424 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b20f3-1bd8-4f80-bb69-8f7eb1d0e97a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:39.509146 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6d6b20f3-1bd8-4f80-bb69-8f7eb1d0e97a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:39.616075 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:22:39.619091 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b20f3-1bd8-4f80-bb69-8f7eb1d0e97a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:22:39.620533 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b20f3-1bd8-4f80-bb69-8f7eb1d0e97a service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:22:39.641217 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 657/1328] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:22:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:22:41.689727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0976c5-a01f-4c8e-8d20-38fce4dd3d3a None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:41.690235 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0976c5-a01f-4c8e-8d20-38fce4dd3d3a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:41.690235 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0976c5-a01f-4c8e-8d20-38fce4dd3d3a None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:41.691528 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 672/1329] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:22:41.696790 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386e782-4aef-46f9-8609-dd12ffd43fe7 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:41.697356 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386e782-4aef-46f9-8609-dd12ffd43fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:41.697356 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386e782-4aef-46f9-8609-dd12ffd43fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:41.764885 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-1386e782-4aef-46f9-8609-dd12ffd43fe7 None None] MFA Rules not processed for user `c03490a890814d2db0a221cf0a15aed9`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:22:41.766176 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1386e782-4aef-46f9-8609-dd12ffd43fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:41.863643 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 658/1330] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:22:41 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:22:41.904917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0976c5-a01f-4c8e-8d20-38fce4dd3d3a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:22:41.906466 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ce0976c5-a01f-4c8e-8d20-38fce4dd3d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:41.939444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:22:42.023400 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0976c5-a01f-4c8e-8d20-38fce4dd3d3a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:22:42.097676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9f0d5-fde3-4792-a164-c8aac8238777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:22:42.098287 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9f0d5-fde3-4792-a164-c8aac8238777 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:42.098573 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9f0d5-fde3-4792-a164-c8aac8238777 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:42.098845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9f0d5-fde3-4792-a164-c8aac8238777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:42.100455 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-00e9f0d5-fde3-4792-a164-c8aac8238777 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:42.179314 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:22:42.213331 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9f0d5-fde3-4792-a164-c8aac8238777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:22:42.215352 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9f0d5-fde3-4792-a164-c8aac8238777 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:22:42.233505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 673/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:22:41 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:22:44.488586 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7e763-97cb-4c8b-9449-12ca1e948992 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:44.489164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7e763-97cb-4c8b-9449-12ca1e948992 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:44.489164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7e763-97cb-4c8b-9449-12ca1e948992 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:44.490571 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 659/1332] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:22:44.496426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3299232-6237-4a97-a36f-312f23823411 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:44.496801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3299232-6237-4a97-a36f-312f23823411 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:44.496978 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3299232-6237-4a97-a36f-312f23823411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:44.562156 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e3299232-6237-4a97-a36f-312f23823411 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:22:44.563365 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e3299232-6237-4a97-a36f-312f23823411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:44.656547 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 674/1333] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:22:44.693094 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7e763-97cb-4c8b-9449-12ca1e948992 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:22:44.694617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e2b7e763-97cb-4c8b-9449-12ca1e948992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:44.762380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:22:44.797279 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7e763-97cb-4c8b-9449-12ca1e948992 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:22:44.867790 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646782e6-73e6-423a-b79a-871e7d498712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:22:44.868573 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646782e6-73e6-423a-b79a-871e7d498712 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:44.868850 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646782e6-73e6-423a-b79a-871e7d498712 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:44.869148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646782e6-73e6-423a-b79a-871e7d498712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:44.870755 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-646782e6-73e6-423a-b79a-871e7d498712 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:44.975938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646782e6-73e6-423a-b79a-871e7d498712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:22:44.977402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646782e6-73e6-423a-b79a-871e7d498712 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:22:44.987841 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:22:44.996378 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 660/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:22:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:22:47.046267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65599e4f-e12b-4117-aac6-12a105f29b0a None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:47.046773 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65599e4f-e12b-4117-aac6-12a105f29b0a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:47.046866 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65599e4f-e12b-4117-aac6-12a105f29b0a None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:47.048158 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 675/1335] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:22:47.053258 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e1286-454d-445a-8563-44c52a49deb3 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:47.053701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e1286-454d-445a-8563-44c52a49deb3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:47.053799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e1286-454d-445a-8563-44c52a49deb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:47.119157 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-e29e1286-454d-445a-8563-44c52a49deb3 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:22:47.120372 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e29e1286-454d-445a-8563-44c52a49deb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:47.213085 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 661/1336] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:22:47.253982 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65599e4f-e12b-4117-aac6-12a105f29b0a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:22:47.255535 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-65599e4f-e12b-4117-aac6-12a105f29b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:47.296633 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:22:47.359694 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65599e4f-e12b-4117-aac6-12a105f29b0a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:22:47.432019 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9a859-a7c5-4cea-9e16-df8979308d8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:22:47.432618 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9a859-a7c5-4cea-9e16-df8979308d8f service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:47.432895 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9a859-a7c5-4cea-9e16-df8979308d8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:47.433200 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9a859-a7c5-4cea-9e16-df8979308d8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:47.434774 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-46c9a859-a7c5-4cea-9e16-df8979308d8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:47.515809 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:22:47.541605 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9a859-a7c5-4cea-9e16-df8979308d8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:22:47.543045 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9a859-a7c5-4cea-9e16-df8979308d8f service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:22:47.561990 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 676/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:22:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:22:50.018931 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465198dd-c5d8-46f1-9d8a-c09b3e78c17e None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:50.019436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465198dd-c5d8-46f1-9d8a-c09b3e78c17e None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:50.019533 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465198dd-c5d8-46f1-9d8a-c09b3e78c17e None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:50.020863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 662/1338] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:22:50.025883 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e9dc0-9ab4-4958-adee-db3aea515191 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:50.026281 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e9dc0-9ab4-4958-adee-db3aea515191 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:50.026429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e9dc0-9ab4-4958-adee-db3aea515191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:50.091829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-451e9dc0-9ab4-4958-adee-db3aea515191 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:22:50.093071 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-451e9dc0-9ab4-4958-adee-db3aea515191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:50.189103 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 677/1339] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:22:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:22:50.225375 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465198dd-c5d8-46f1-9d8a-c09b3e78c17e None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:22:50.226900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-465198dd-c5d8-46f1-9d8a-c09b3e78c17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:50.301465 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:22:50.329704 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465198dd-c5d8-46f1-9d8a-c09b3e78c17e None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:22:50.402922 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e314800-c99c-4434-9b9a-14ae7e82907b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:22:50.403473 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e314800-c99c-4434-9b9a-14ae7e82907b service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:50.403752 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e314800-c99c-4434-9b9a-14ae7e82907b service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:50.404024 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e314800-c99c-4434-9b9a-14ae7e82907b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:50.405994 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1e314800-c99c-4434-9b9a-14ae7e82907b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:50.510825 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e314800-c99c-4434-9b9a-14ae7e82907b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:22:50.512791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e314800-c99c-4434-9b9a-14ae7e82907b service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:22:50.530890 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 663/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:22:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:22:54.549319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a158d43-68a9-4071-81a4-517903437716 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:54.549914 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a158d43-68a9-4071-81a4-517903437716 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:54.549914 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a158d43-68a9-4071-81a4-517903437716 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:54.551251 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 678/1341] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:22:54.556386 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4750ab8-93cb-4c96-8909-f62d4fb8c312 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:54.556810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4750ab8-93cb-4c96-8909-f62d4fb8c312 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:54.556945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4750ab8-93cb-4c96-8909-f62d4fb8c312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:54.562966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:22:54.624177 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-b4750ab8-93cb-4c96-8909-f62d4fb8c312 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:22:54.625352 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b4750ab8-93cb-4c96-8909-f62d4fb8c312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:54.725155 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 664/1342] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:22:54.764550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a158d43-68a9-4071-81a4-517903437716 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:22:54.766119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0a158d43-68a9-4071-81a4-517903437716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:54.813935 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:22:54.869764 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a158d43-68a9-4071-81a4-517903437716 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:22:54.943208 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900ae5a-31b1-47b3-9ef4-395b4c2e5492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:22:54.943740 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900ae5a-31b1-47b3-9ef4-395b4c2e5492 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:54.944023 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900ae5a-31b1-47b3-9ef4-395b4c2e5492 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:54.944295 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900ae5a-31b1-47b3-9ef4-395b4c2e5492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:54.945937 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1900ae5a-31b1-47b3-9ef4-395b4c2e5492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:55.041402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:22:55.058732 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900ae5a-31b1-47b3-9ef4-395b4c2e5492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:22:55.060179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1900ae5a-31b1-47b3-9ef4-395b4c2e5492 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:22:55.078517 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 679/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:22:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:22:57.712370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53254c02-8aa9-4b7d-9535-cb6227ed1ae1 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:57.712901 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53254c02-8aa9-4b7d-9535-cb6227ed1ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:57.712901 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53254c02-8aa9-4b7d-9535-cb6227ed1ae1 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:57.714807 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 665/1344] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:22:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:22:57.720690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2f040-a65b-41e0-a4ec-b02608005e15 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:57.721226 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2f040-a65b-41e0-a4ec-b02608005e15 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:57.721337 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2f040-a65b-41e0-a4ec-b02608005e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:57.791066 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2db2f040-a65b-41e0-a4ec-b02608005e15 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:22:57.792296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2db2f040-a65b-41e0-a4ec-b02608005e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:57.887960 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 680/1345] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:22:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:22:57.924911 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53254c02-8aa9-4b7d-9535-cb6227ed1ae1 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:22:57.926455 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-53254c02-8aa9-4b7d-9535-cb6227ed1ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:58.015945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:22:58.034586 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53254c02-8aa9-4b7d-9535-cb6227ed1ae1 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:22:58.106419 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a70b69-9591-4bf9-92ca-6b805516f5b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:22:58.107021 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a70b69-9591-4bf9-92ca-6b805516f5b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:22:58.107301 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a70b69-9591-4bf9-92ca-6b805516f5b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:22:58.107571 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a70b69-9591-4bf9-92ca-6b805516f5b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:22:58.109187 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a4a70b69-9591-4bf9-92ca-6b805516f5b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:22:58.216487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a70b69-9591-4bf9-92ca-6b805516f5b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:22:58.217950 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a70b69-9591-4bf9-92ca-6b805516f5b8 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:22:58.235909 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 666/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:22:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:23:02.144566 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1a3b6-22d0-4cd3-bcb1-6404787bb454 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:02.145119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1a3b6-22d0-4cd3-bcb1-6404787bb454 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:02.145231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1a3b6-22d0-4cd3-bcb1-6404787bb454 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:02.146514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 681/1347] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:23:02.151752 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024136d-a60d-4d8f-80f0-3b0d02e006ca None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:02.152183 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024136d-a60d-4d8f-80f0-3b0d02e006ca None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:02.152294 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024136d-a60d-4d8f-80f0-3b0d02e006ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:02.167374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:02.217778 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-8024136d-a60d-4d8f-80f0-3b0d02e006ca None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:23:02.218987 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8024136d-a60d-4d8f-80f0-3b0d02e006ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:02.315383 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 667/1348] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:23:02.353108 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1a3b6-22d0-4cd3-bcb1-6404787bb454 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:23:02.354623 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a4a1a3b6-22d0-4cd3-bcb1-6404787bb454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:02.416600 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:02.476330 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1a3b6-22d0-4cd3-bcb1-6404787bb454 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:23:02.559495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df527420-d064-4645-a035-ecd1ba3395c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:23:02.560108 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df527420-d064-4645-a035-ecd1ba3395c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:02.560386 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df527420-d064-4645-a035-ecd1ba3395c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:02.560648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df527420-d064-4645-a035-ecd1ba3395c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:02.562345 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-df527420-d064-4645-a035-ecd1ba3395c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:02.673977 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:02.677947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df527420-d064-4645-a035-ecd1ba3395c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:23:02.679765 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df527420-d064-4645-a035-ecd1ba3395c4 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:23:02.700021 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 682/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:23:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:23:07.600221 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83003817-028c-460c-bda1-e8c3ada387f2 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:07.600705 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83003817-028c-460c-bda1-e8c3ada387f2 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:07.600832 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83003817-028c-460c-bda1-e8c3ada387f2 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:07.602136 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 668/1350] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 9 02:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:23:07.607598 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ff533-2940-438a-b88e-98c17dbf77c0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:07.608014 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ff533-2940-438a-b88e-98c17dbf77c0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:07.608230 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ff533-2940-438a-b88e-98c17dbf77c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:07.740504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5c1ff533-2940-438a-b88e-98c17dbf77c0 None None] MFA Rules not processed for user `5fe21d9a65a34abeae7329df924d7998`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:23:07.741821 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5c1ff533-2940-438a-b88e-98c17dbf77c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:07.879334 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 683/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 9 02:23:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:23:11.990130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad5c02-5bb9-4025-b58b-629002d172c8 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:11.990604 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad5c02-5bb9-4025-b58b-629002d172c8 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:11.990908 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad5c02-5bb9-4025-b58b-629002d172c8 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:11.992426 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 669/1352] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 9 02:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:23:11.998396 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca5d20-df45-42ca-baf3-91532ae13bca None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:11.998807 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca5d20-df45-42ca-baf3-91532ae13bca None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:11.999083 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca5d20-df45-42ca-baf3-91532ae13bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:12.062257 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:12.088792 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-47ca5d20-df45-42ca-baf3-91532ae13bca None None] MFA Rules not processed for user `5fe21d9a65a34abeae7329df924d7998`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:23:12.090925 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-47ca5d20-df45-42ca-baf3-91532ae13bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:12.204344 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 684/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 9 02:23:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:23:12.313634 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=59 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:13.612182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31aef42-35c2-4878-b0be-3817085cc92b None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:13.612798 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31aef42-35c2-4878-b0be-3817085cc92b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:13.612798 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31aef42-35c2-4878-b0be-3817085cc92b None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:13.614122 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 670/1354] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 9 02:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:23:13.619414 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390691fb-a6f8-4488-a1e2-3ff102df707e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:13.619823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390691fb-a6f8-4488-a1e2-3ff102df707e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:13.620090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390691fb-a6f8-4488-a1e2-3ff102df707e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:13.698151 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-390691fb-a6f8-4488-a1e2-3ff102df707e None None] MFA Rules not processed for user `5fe21d9a65a34abeae7329df924d7998`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:23:13.700168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-390691fb-a6f8-4488-a1e2-3ff102df707e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:13.742764 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:13.808775 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 685/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 9 02:23:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:23:17.113687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7beec71-afc8-483a-8387-86cdbffcf3fa None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:17.114519 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7beec71-afc8-483a-8387-86cdbffcf3fa None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:17.115035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7beec71-afc8-483a-8387-86cdbffcf3fa None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:17.116671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 671/1356] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:23:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:23:17.122786 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b9c8d-8504-4cd3-b731-abdcb0e2f9f2 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:17.123248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b9c8d-8504-4cd3-b731-abdcb0e2f9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:17.123327 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b9c8d-8504-4cd3-b731-abdcb0e2f9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:17.209771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-796b9c8d-8504-4cd3-b731-abdcb0e2f9f2 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:23:17.211106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-796b9c8d-8504-4cd3-b731-abdcb0e2f9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:17.315479 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 686/1357] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:23:17.369477 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789193b-df89-4f8b-996d-a62bece565c7 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:17.370725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789193b-df89-4f8b-996d-a62bece565c7 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:17.371484 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789193b-df89-4f8b-996d-a62bece565c7 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:17.373749 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 672/1358] 10.222.0.16 () {54 vars in 962 bytes} [Tue Aug 9 02:23:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:23:17.383674 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e36d8e-7a1e-461c-947c-6a9fc6818d65 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:17.384367 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e36d8e-7a1e-461c-947c-6a9fc6818d65 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:17.384875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e36d8e-7a1e-461c-947c-6a9fc6818d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:17.406283 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:17.473083 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b9e36d8e-7a1e-461c-947c-6a9fc6818d65 None None] MFA Rules not processed for user `78fff294b9794a26aa1bbc231fa1133c`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:23:17.474564 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b9e36d8e-7a1e-461c-947c-6a9fc6818d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:17.596223 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 687/1359] 10.222.0.16 () {58 vars in 1059 bytes} [Tue Aug 9 02:23:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:23:17.603888 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789193b-df89-4f8b-996d-a62bece565c7 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:23:17.606145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6789193b-df89-4f8b-996d-a62bece565c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:17.769458 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789193b-df89-4f8b-996d-a62bece565c7 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:23:17.847669 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:17.893976 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe9312-738c-4b57-b3cd-d9fc19f1af1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:23:17.894594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe9312-738c-4b57-b3cd-d9fc19f1af1d service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:17.894876 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe9312-738c-4b57-b3cd-d9fc19f1af1d service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:17.895148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe9312-738c-4b57-b3cd-d9fc19f1af1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:17.896782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-61fe9312-738c-4b57-b3cd-d9fc19f1af1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:18.000722 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe9312-738c-4b57-b3cd-d9fc19f1af1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:23:18.002650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fe9312-738c-4b57-b3cd-d9fc19f1af1d service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:23:18.029505 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 673/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:23:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:23:20.242589 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6762b-c649-4c01-b1dd-8540a0748e69 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:20.243203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6762b-c649-4c01-b1dd-8540a0748e69 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:20.243203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6762b-c649-4c01-b1dd-8540a0748e69 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:20.244886 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 688/1361] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:23:20.250873 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db0b83-4440-49a2-a3b5-1771ecb17efc None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:20.251382 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db0b83-4440-49a2-a3b5-1771ecb17efc None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:20.251489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db0b83-4440-49a2-a3b5-1771ecb17efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:20.319564 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c1db0b83-4440-49a2-a3b5-1771ecb17efc None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:23:20.320765 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c1db0b83-4440-49a2-a3b5-1771ecb17efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:20.360492 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:20.449110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 674/1362] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:23:20.493217 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6762b-c649-4c01-b1dd-8540a0748e69 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:23:20.494997 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a7b6762b-c649-4c01-b1dd-8540a0748e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:20.572097 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:20.663338 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6762b-c649-4c01-b1dd-8540a0748e69 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:23:20.812054 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9780b8-b84e-479a-a550-bb7544ff72df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:23:20.812757 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9780b8-b84e-479a-a550-bb7544ff72df service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:20.813194 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9780b8-b84e-479a-a550-bb7544ff72df service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:20.813560 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9780b8-b84e-479a-a550-bb7544ff72df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:20.815253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4c9780b8-b84e-479a-a550-bb7544ff72df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:20.842485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:20.916431 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9780b8-b84e-479a-a550-bb7544ff72df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:23:20.918768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9780b8-b84e-479a-a550-bb7544ff72df service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:23:20.938671 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 689/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:23:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:23:23.297915 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c2d29-cc77-43fd-a4d8-1b1bf082f187 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:23.298858 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c2d29-cc77-43fd-a4d8-1b1bf082f187 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:23.299145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c2d29-cc77-43fd-a4d8-1b1bf082f187 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:23.300672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 675/1364] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:23:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:23:23.305819 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a17fc6-ccf5-499d-bc6c-8d94c8d0ec05 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:23.306281 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a17fc6-ccf5-499d-bc6c-8d94c8d0ec05 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:23.306374 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a17fc6-ccf5-499d-bc6c-8d94c8d0ec05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:23.396242 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-37a17fc6-ccf5-499d-bc6c-8d94c8d0ec05 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:23:23.397512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-37a17fc6-ccf5-499d-bc6c-8d94c8d0ec05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:23.504607 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:23.517343 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 690/1365] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:23:23.556460 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f4156-e3c1-472d-94a2-a803d66f30de None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:23.556711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f4156-e3c1-472d-94a2-a803d66f30de None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:23.557150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f4156-e3c1-472d-94a2-a803d66f30de None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:23.558799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 676/1366] 10.222.0.16 () {54 vars in 962 bytes} [Tue Aug 9 02:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:23:23.564372 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00789192-0106-489a-8ab0-a8b206ab461f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:23.564666 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00789192-0106-489a-8ab0-a8b206ab461f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:23.564944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00789192-0106-489a-8ab0-a8b206ab461f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:23.650961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-00789192-0106-489a-8ab0-a8b206ab461f None None] MFA Rules not processed for user `78fff294b9794a26aa1bbc231fa1133c`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:23:23.652750 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-00789192-0106-489a-8ab0-a8b206ab461f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:23.776776 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 691/1367] 10.222.0.16 () {58 vars in 1059 bytes} [Tue Aug 9 02:23:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:23:23.784921 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f4156-e3c1-472d-94a2-a803d66f30de None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:23:23.786757 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b68f4156-e3c1-472d-94a2-a803d66f30de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:23.954909 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f4156-e3c1-472d-94a2-a803d66f30de None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:23:23.983997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:24.085963 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495f15f-ab3d-46e6-a13e-17f9b6c77110 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:23:24.086736 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495f15f-ab3d-46e6-a13e-17f9b6c77110 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:24.087122 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495f15f-ab3d-46e6-a13e-17f9b6c77110 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:24.087516 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495f15f-ab3d-46e6-a13e-17f9b6c77110 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:24.089299 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e495f15f-ab3d-46e6-a13e-17f9b6c77110 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:24.185270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495f15f-ab3d-46e6-a13e-17f9b6c77110 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:23:24.186943 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495f15f-ab3d-46e6-a13e-17f9b6c77110 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:23:24.206563 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 677/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:23:25.225562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff85f0f-dc1b-40fd-b0e8-7e9538c2b8c0 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:25.226119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff85f0f-dc1b-40fd-b0e8-7e9538c2b8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:25.226119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff85f0f-dc1b-40fd-b0e8-7e9538c2b8c0 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:25.228686 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 692/1369] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:23:25.233054 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2633e-2470-4980-a384-faf6c6a26fe4 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:25.233487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2633e-2470-4980-a384-faf6c6a26fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:25.233584 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2633e-2470-4980-a384-faf6c6a26fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:25.267676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:25.305439 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-73a2633e-2470-4980-a384-faf6c6a26fe4 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:23:25.306667 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-73a2633e-2470-4980-a384-faf6c6a26fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:25.412056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 678/1370] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:23:25.759369 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18bd71-3a15-4699-88d6-254bb6cc9dd8 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:25.759369 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18bd71-3a15-4699-88d6-254bb6cc9dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:25.759369 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18bd71-3a15-4699-88d6-254bb6cc9dd8 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:25.762869 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 693/1371] 10.222.0.16 () {54 vars in 964 bytes} [Tue Aug 9 02:23:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:23:25.766610 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4b41a-9588-4a68-afa6-263b400311cb None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:25.766905 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4b41a-9588-4a68-afa6-263b400311cb None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:25.767186 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4b41a-9588-4a68-afa6-263b400311cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:25.859718 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-01a4b41a-9588-4a68-afa6-263b400311cb None None] MFA Rules not processed for user `9500a1b1de2344f78580bed52cc302a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:23:25.861146 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-01a4b41a-9588-4a68-afa6-263b400311cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:25.912669 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:25.944781 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 679/1372] 10.222.0.16 () {58 vars in 1061 bytes} [Tue Aug 9 02:23:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:23:25.953463 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18bd71-3a15-4699-88d6-254bb6cc9dd8 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:23:25.955080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5e18bd71-3a15-4699-88d6-254bb6cc9dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:26.016537 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:26.080874 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18bd71-3a15-4699-88d6-254bb6cc9dd8 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:23:26.159196 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464209ea-78a6-475d-8e60-f113628166f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:23:26.160025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464209ea-78a6-475d-8e60-f113628166f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:26.160407 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464209ea-78a6-475d-8e60-f113628166f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:26.160780 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464209ea-78a6-475d-8e60-f113628166f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:26.162803 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-464209ea-78a6-475d-8e60-f113628166f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:26.268463 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:26.284270 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464209ea-78a6-475d-8e60-f113628166f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:23:26.286136 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464209ea-78a6-475d-8e60-f113628166f9 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:23:26.294478 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c66103-97b0-40f6-ae87-610d73d36e52 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:26.294961 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c66103-97b0-40f6-ae87-610d73d36e52 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:26.295064 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c66103-97b0-40f6-ae87-610d73d36e52 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:26.296348 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 680/1373] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:23:26.301520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf0da6-8254-43f4-8c02-46d6c01a7702 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:26.301809 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf0da6-8254-43f4-8c02-46d6c01a7702 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:26.302083 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf0da6-8254-43f4-8c02-46d6c01a7702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:26.307864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 694/1374] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:23:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:23:26.369616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-56cf0da6-8254-43f4-8c02-46d6c01a7702 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:23:26.370840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-56cf0da6-8254-43f4-8c02-46d6c01a7702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:26.479916 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 681/1375] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:23:26.533920 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464209ea-78a6-475d-8e60-f113628166f9 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:23:26.535131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-464209ea-78a6-475d-8e60-f113628166f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:26.674948 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464209ea-78a6-475d-8e60-f113628166f9 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:23:26.796376 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:26.809873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb831d1-2e1a-43b3-bd70-7c2b91f98c91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:23:26.810487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb831d1-2e1a-43b3-bd70-7c2b91f98c91 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:26.810797 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb831d1-2e1a-43b3-bd70-7c2b91f98c91 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:26.811072 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb831d1-2e1a-43b3-bd70-7c2b91f98c91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:26.812968 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5cb831d1-2e1a-43b3-bd70-7c2b91f98c91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:26.903555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb831d1-2e1a-43b3-bd70-7c2b91f98c91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:23:26.905102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb831d1-2e1a-43b3-bd70-7c2b91f98c91 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:23:26.923361 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 695/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:23:28.961849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6862d3-5012-44ed-8f2f-a38dbaeb0f73 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:28.962339 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6862d3-5012-44ed-8f2f-a38dbaeb0f73 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:28.962339 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6862d3-5012-44ed-8f2f-a38dbaeb0f73 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:28.964367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 682/1377] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:23:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:23:28.969623 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf87c24-0947-43ef-94d9-73b7c927ca32 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:28.970057 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf87c24-0947-43ef-94d9-73b7c927ca32 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:28.970156 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf87c24-0947-43ef-94d9-73b7c927ca32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:29.035283 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-3bf87c24-0947-43ef-94d9-73b7c927ca32 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:23:29.036468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3bf87c24-0947-43ef-94d9-73b7c927ca32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:29.094235 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:29.139782 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 696/1378] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:23:29.185971 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6862d3-5012-44ed-8f2f-a38dbaeb0f73 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:23:29.187491 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0c6862d3-5012-44ed-8f2f-a38dbaeb0f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:29.247770 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:29.358938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6862d3-5012-44ed-8f2f-a38dbaeb0f73 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:23:29.477943 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813abc6-087d-47ba-9a59-b74d6178b1a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:23:29.478557 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813abc6-087d-47ba-9a59-b74d6178b1a3 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:29.478841 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813abc6-087d-47ba-9a59-b74d6178b1a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:29.479113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813abc6-087d-47ba-9a59-b74d6178b1a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:29.481283 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1813abc6-087d-47ba-9a59-b74d6178b1a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:29.492787 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:29.578647 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813abc6-087d-47ba-9a59-b74d6178b1a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:23:29.580289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813abc6-087d-47ba-9a59-b74d6178b1a3 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:23:29.598772 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 683/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:23:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:23:31.653065 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8588a2d-9ddf-4f9f-921b-c41801b996f5 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:31.653625 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8588a2d-9ddf-4f9f-921b-c41801b996f5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:31.653625 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8588a2d-9ddf-4f9f-921b-c41801b996f5 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:31.655102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 697/1380] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:23:31.660241 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03027d48-a776-477a-9cf0-fda718054f67 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:31.660671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03027d48-a776-477a-9cf0-fda718054f67 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:31.660774 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03027d48-a776-477a-9cf0-fda718054f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:31.728972 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-03027d48-a776-477a-9cf0-fda718054f67 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:23:31.730228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-03027d48-a776-477a-9cf0-fda718054f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:31.826727 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:31.842778 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 684/1381] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:23:31.887562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8588a2d-9ddf-4f9f-921b-c41801b996f5 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:23:31.889116 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a8588a2d-9ddf-4f9f-921b-c41801b996f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:32.053670 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8588a2d-9ddf-4f9f-921b-c41801b996f5 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:23:32.107816 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:32.186852 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2f99c-6576-4b13-b9de-06c95065a7b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:23:32.187614 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2f99c-6576-4b13-b9de-06c95065a7b4 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:32.188014 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2f99c-6576-4b13-b9de-06c95065a7b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:32.188398 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2f99c-6576-4b13-b9de-06c95065a7b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:32.190147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c2a2f99c-6576-4b13-b9de-06c95065a7b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:32.411565 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2f99c-6576-4b13-b9de-06c95065a7b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:23:32.413399 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2f99c-6576-4b13-b9de-06c95065a7b4 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:23:32.433547 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 698/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:23:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:23:34.508381 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ac859-1496-4e9d-9173-e55072c923ef None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:34.508969 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ac859-1496-4e9d-9173-e55072c923ef None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:34.509111 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ac859-1496-4e9d-9173-e55072c923ef None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:34.510423 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 685/1383] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:23:34.515700 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def10fe-cac5-45f1-8a5b-e2cb035bf190 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:34.516121 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def10fe-cac5-45f1-8a5b-e2cb035bf190 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:34.516275 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def10fe-cac5-45f1-8a5b-e2cb035bf190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:34.600434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-4def10fe-cac5-45f1-8a5b-e2cb035bf190 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:23:34.601711 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4def10fe-cac5-45f1-8a5b-e2cb035bf190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:34.603811 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:34.702866 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 699/1384] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:23:34.747893 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ac859-1496-4e9d-9173-e55072c923ef None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:23:34.750006 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c40ac859-1496-4e9d-9173-e55072c923ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:34.919780 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ac859-1496-4e9d-9173-e55072c923ef None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:23:34.984591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:35.046126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9217a-994a-4a72-9d1c-7e2c5dbc193c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:23:35.047046 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9217a-994a-4a72-9d1c-7e2c5dbc193c service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:35.047508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9217a-994a-4a72-9d1c-7e2c5dbc193c service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:35.047885 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9217a-994a-4a72-9d1c-7e2c5dbc193c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:35.050627 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-dba9217a-994a-4a72-9d1c-7e2c5dbc193c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:35.152703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9217a-994a-4a72-9d1c-7e2c5dbc193c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:23:35.154946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba9217a-994a-4a72-9d1c-7e2c5dbc193c service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:23:35.179017 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 686/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:23:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:23:37.258858 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd43ab-602b-4562-a5b8-0681bf34c2dd None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:37.259412 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd43ab-602b-4562-a5b8-0681bf34c2dd None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:37.259543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd43ab-602b-4562-a5b8-0681bf34c2dd None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:37.261333 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 700/1386] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:23:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:23:37.266645 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a92950-72d6-4c07-9fbe-3cc0e92ed6ec None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:37.267059 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a92950-72d6-4c07-9fbe-3cc0e92ed6ec None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:37.267219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a92950-72d6-4c07-9fbe-3cc0e92ed6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:37.470832 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-09a92950-72d6-4c07-9fbe-3cc0e92ed6ec None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:23:37.472096 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-09a92950-72d6-4c07-9fbe-3cc0e92ed6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:37.499623 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:37.574328 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 687/1387] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:23:37.631003 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd43ab-602b-4562-a5b8-0681bf34c2dd None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:23:37.633181 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b6bd43ab-602b-4562-a5b8-0681bf34c2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:37.788768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:37.807093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd43ab-602b-4562-a5b8-0681bf34c2dd None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:23:37.923745 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308a946-b235-47f9-906e-c4d881500d02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:23:37.924353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308a946-b235-47f9-906e-c4d881500d02 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:37.924643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308a946-b235-47f9-906e-c4d881500d02 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:37.924949 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308a946-b235-47f9-906e-c4d881500d02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:37.926595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5308a946-b235-47f9-906e-c4d881500d02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:38.029363 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308a946-b235-47f9-906e-c4d881500d02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:23:38.031523 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308a946-b235-47f9-906e-c4d881500d02 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:23:38.038200 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:38.053547 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 701/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:23:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:23:40.091784 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b213287-32fd-467b-9885-8cec35b10190 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:40.092344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b213287-32fd-467b-9885-8cec35b10190 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:40.092344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b213287-32fd-467b-9885-8cec35b10190 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:40.093775 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 688/1389] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:23:40.099227 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d789d7-e545-41f9-9a7e-f22e327268c3 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:40.099653 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d789d7-e545-41f9-9a7e-f22e327268c3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:40.099777 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d789d7-e545-41f9-9a7e-f22e327268c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:40.169203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-02d789d7-e545-41f9-9a7e-f22e327268c3 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:23:40.170295 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-02d789d7-e545-41f9-9a7e-f22e327268c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:40.269747 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 702/1390] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:23:40.313367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b213287-32fd-467b-9885-8cec35b10190 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:23:40.315050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2b213287-32fd-467b-9885-8cec35b10190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:40.461753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b213287-32fd-467b-9885-8cec35b10190 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:23:40.475844 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:40.590477 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c57584-0adb-4e05-9af4-d3e43c65cb14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:23:40.591090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c57584-0adb-4e05-9af4-d3e43c65cb14 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:40.591371 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c57584-0adb-4e05-9af4-d3e43c65cb14 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:40.591642 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c57584-0adb-4e05-9af4-d3e43c65cb14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:40.593298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-81c57584-0adb-4e05-9af4-d3e43c65cb14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:40.681523 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c57584-0adb-4e05-9af4-d3e43c65cb14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:23:40.683120 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c57584-0adb-4e05-9af4-d3e43c65cb14 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:23:40.701092 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 689/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:23:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:23:41.317331 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eff2d7-7fa4-4b47-ad02-d67a22a2808c None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:41.317890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eff2d7-7fa4-4b47-ad02-d67a22a2808c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:41.317890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eff2d7-7fa4-4b47-ad02-d67a22a2808c None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:41.319336 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 703/1392] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:23:41.325118 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42739cf0-2be4-4c62-bc8b-cda0a9ebe930 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:41.325561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42739cf0-2be4-4c62-bc8b-cda0a9ebe930 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:41.325659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42739cf0-2be4-4c62-bc8b-cda0a9ebe930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:41.340873 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:41.391393 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-42739cf0-2be4-4c62-bc8b-cda0a9ebe930 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:23:41.392629 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-42739cf0-2be4-4c62-bc8b-cda0a9ebe930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:41.490868 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 690/1393] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:23:41.547848 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a79b6a-6bfb-46e0-a758-381f6bdac916 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:41.548194 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a79b6a-6bfb-46e0-a758-381f6bdac916 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:41.548531 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a79b6a-6bfb-46e0-a758-381f6bdac916 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:41.549951 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 704/1394] 10.222.0.16 () {54 vars in 967 bytes} [Tue Aug 9 02:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:23:41.554905 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57040e-467e-49f0-90e4-3e6a357307b4 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:41.555194 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57040e-467e-49f0-90e4-3e6a357307b4 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:41.555465 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57040e-467e-49f0-90e4-3e6a357307b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:41.630235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-ec57040e-467e-49f0-90e4-3e6a357307b4 None None] MFA Rules not processed for user `63645a88f5924a57b5b828aacd856902`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:23:41.631352 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ec57040e-467e-49f0-90e4-3e6a357307b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:41.667609 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:41.709083 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 691/1395] 10.222.0.16 () {58 vars in 1064 bytes} [Tue Aug 9 02:23:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:23:41.717088 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a79b6a-6bfb-46e0-a758-381f6bdac916 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:23:41.718599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e3a79b6a-6bfb-46e0-a758-381f6bdac916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:41.791130 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:41.827165 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a79b6a-6bfb-46e0-a758-381f6bdac916 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:23:41.902230 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12679d57-c6b5-4af0-b599-029ee6be9aac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63645a88f5924a57b5b828aacd856902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:23:41.902734 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12679d57-c6b5-4af0-b599-029ee6be9aac service glance] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:41.903013 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12679d57-c6b5-4af0-b599-029ee6be9aac service glance] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:41.903282 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12679d57-c6b5-4af0-b599-029ee6be9aac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:41.904885 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-12679d57-c6b5-4af0-b599-029ee6be9aac service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:42.019525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12679d57-c6b5-4af0-b599-029ee6be9aac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:23:42.020963 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12679d57-c6b5-4af0-b599-029ee6be9aac service glance] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:23:42.036499 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:42.039466 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 705/1396] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:23:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:23:42.797718 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39677c2-e6c8-4c81-a565-2e48a49722a2 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:42.798281 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39677c2-e6c8-4c81-a565-2e48a49722a2 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:42.798281 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39677c2-e6c8-4c81-a565-2e48a49722a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:42.801213 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff86ca-5920-41de-ad0b-6a3dd395a72b None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:42.801624 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff86ca-5920-41de-ad0b-6a3dd395a72b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:42.801759 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff86ca-5920-41de-ad0b-6a3dd395a72b None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:42.803140 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 706/1397] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:23:42.812970 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd1b59-454d-4fdf-b3e2-1b2fb0a1f882 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:42.812970 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd1b59-454d-4fdf-b3e2-1b2fb0a1f882 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:42.812970 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd1b59-454d-4fdf-b3e2-1b2fb0a1f882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:42.874375 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a39677c2-e6c8-4c81-a565-2e48a49722a2 None None] MFA Rules not processed for user `07041df2276d4dd58fb0e49417a26e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:23:42.875599 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a39677c2-e6c8-4c81-a565-2e48a49722a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:42.878249 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c6dd1b59-454d-4fdf-b3e2-1b2fb0a1f882 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:23:42.879458 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c6dd1b59-454d-4fdf-b3e2-1b2fb0a1f882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:42.967530 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 692/1398] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 9 02:23:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:23:42.978767 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 707/1399] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:23:43.017834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618430d-2fe9-411a-99e0-4105e58a520c None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:43.018122 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618430d-2fe9-411a-99e0-4105e58a520c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:43.018396 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618430d-2fe9-411a-99e0-4105e58a520c None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:43.019999 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 693/1400] 10.222.0.16 () {54 vars in 943 bytes} [Tue Aug 9 02:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:23:43.026939 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f71df-c5be-4370-ba07-c63b3dcc42d9 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:43.027132 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f71df-c5be-4370-ba07-c63b3dcc42d9 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:43.027270 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f71df-c5be-4370-ba07-c63b3dcc42d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:43.033348 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618430d-2fe9-411a-99e0-4105e58a520c None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:23:43.034860 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0618430d-2fe9-411a-99e0-4105e58a520c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:43.092333 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:43.107628 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-962f71df-c5be-4370-ba07-c63b3dcc42d9 None None] MFA Rules not processed for user `9151f210d29542dcb41ea3bc03390350`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:23:43.108851 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-962f71df-c5be-4370-ba07-c63b3dcc42d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:43.130047 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:43.188742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618430d-2fe9-411a-99e0-4105e58a520c None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:23:43.219441 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 708/1401] 10.222.0.16 () {58 vars in 1040 bytes} [Tue Aug 9 02:23:43 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:23:43.229523 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f71df-c5be-4370-ba07-c63b3dcc42d9 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:23:43.238934 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f71df-c5be-4370-ba07-c63b3dcc42d9 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:23:43.303021 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59399227-46a8-4a6d-97b1-07afbba2dc0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:23:43.303623 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59399227-46a8-4a6d-97b1-07afbba2dc0f service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:43.303901 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59399227-46a8-4a6d-97b1-07afbba2dc0f service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:43.304178 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59399227-46a8-4a6d-97b1-07afbba2dc0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:43.305811 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-59399227-46a8-4a6d-97b1-07afbba2dc0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:43.317623 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:43.344468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338d38f-9b06-4b2b-b3ec-ba37f09b977f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9151f210d29542dcb41ea3bc03390350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:23:43.345002 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338d38f-9b06-4b2b-b3ec-ba37f09b977f service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:43.345304 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338d38f-9b06-4b2b-b3ec-ba37f09b977f service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:43.345581 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338d38f-9b06-4b2b-b3ec-ba37f09b977f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:43.347227 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6338d38f-9b06-4b2b-b3ec-ba37f09b977f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:43.373529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:43.396946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59399227-46a8-4a6d-97b1-07afbba2dc0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:23:43.398604 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59399227-46a8-4a6d-97b1-07afbba2dc0f service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:23:43.421446 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 694/1402] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:23:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:23:43.434027 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338d38f-9b06-4b2b-b3ec-ba37f09b977f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:23:43.435620 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6338d38f-9b06-4b2b-b3ec-ba37f09b977f service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:23:43.444041 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 709/1403] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 9 02:23:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 09 02:23:45.488372 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f870fef-5ce6-45ee-a82f-9557ae992671 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:45.488869 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f870fef-5ce6-45ee-a82f-9557ae992671 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:45.488988 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f870fef-5ce6-45ee-a82f-9557ae992671 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:45.493200 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 695/1404] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:23:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:23:45.496306 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd40ccd-4ccd-45c0-996c-c968a46b9a70 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:45.496756 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd40ccd-4ccd-45c0-996c-c968a46b9a70 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:45.496847 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd40ccd-4ccd-45c0-996c-c968a46b9a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:45.565353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-cbd40ccd-4ccd-45c0-996c-c968a46b9a70 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:23:45.566576 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cbd40ccd-4ccd-45c0-996c-c968a46b9a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:45.671070 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 710/1405] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:23:45.716557 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f870fef-5ce6-45ee-a82f-9557ae992671 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:23:45.718154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4f870fef-5ce6-45ee-a82f-9557ae992671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:45.875720 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:45.887717 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f870fef-5ce6-45ee-a82f-9557ae992671 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:23:46.022665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e6276-1356-4546-a567-55306a903362 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:23:46.023282 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e6276-1356-4546-a567-55306a903362 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:46.023562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e6276-1356-4546-a567-55306a903362 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:46.023860 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e6276-1356-4546-a567-55306a903362 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:46.025517 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e28e6276-1356-4546-a567-55306a903362 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:46.122126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e6276-1356-4546-a567-55306a903362 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:23:46.124010 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e6276-1356-4546-a567-55306a903362 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:23:46.139280 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:46.148879 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 696/1406] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:23:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:23:48.265240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c20b83-0ada-45fe-85cd-c8100ddaf4d2 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:48.265240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c20b83-0ada-45fe-85cd-c8100ddaf4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:48.265240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c20b83-0ada-45fe-85cd-c8100ddaf4d2 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:48.269273 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 711/1407] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:23:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:23:48.270647 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15194b-ef18-4886-8bb8-101db8293ad1 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:48.271046 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15194b-ef18-4886-8bb8-101db8293ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:48.271209 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15194b-ef18-4886-8bb8-101db8293ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:48.342136 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-2b15194b-ef18-4886-8bb8-101db8293ad1 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:23:48.343686 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2b15194b-ef18-4886-8bb8-101db8293ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:48.449618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 697/1408] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:23:48.495543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c20b83-0ada-45fe-85cd-c8100ddaf4d2 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:23:48.497155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b5c20b83-0ada-45fe-85cd-c8100ddaf4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:48.517988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:48.659917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c20b83-0ada-45fe-85cd-c8100ddaf4d2 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:23:48.773715 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:48.798692 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def2568-e0a1-4aed-9d9f-f538f0449e71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:23:48.799694 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def2568-e0a1-4aed-9d9f-f538f0449e71 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:23:48.800216 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def2568-e0a1-4aed-9d9f-f538f0449e71 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:23:48.800677 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def2568-e0a1-4aed-9d9f-f538f0449e71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:23:48.802517 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5def2568-e0a1-4aed-9d9f-f538f0449e71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:23:48.905714 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def2568-e0a1-4aed-9d9f-f538f0449e71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:23:48.907324 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def2568-e0a1-4aed-9d9f-f538f0449e71 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:23:48.928626 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 712/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:23:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:23:58.447061 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=67 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:23:58.925974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=54 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:05.408449 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9c48a-a34c-4976-bd40-737cd5764e56 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:05.409043 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9c48a-a34c-4976-bd40-737cd5764e56 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:05.409043 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9c48a-a34c-4976-bd40-737cd5764e56 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:05.410422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 698/1410] 10.222.0.16 () {54 vars in 918 bytes} [Tue Aug 9 02:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:24:05.415452 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629a064-0d70-4789-afa8-260d94e50a2b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:05.415861 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629a064-0d70-4789-afa8-260d94e50a2b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:05.415997 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629a064-0d70-4789-afa8-260d94e50a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:05.495644 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2629a064-0d70-4789-afa8-260d94e50a2b None None] MFA Rules not processed for user `5fe21d9a65a34abeae7329df924d7998`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:24:05.496866 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2629a064-0d70-4789-afa8-260d94e50a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:05.601629 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 713/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Tue Aug 9 02:24:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:24:05.616182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119697fd-11c3-447d-a878-247344ba6233 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:05.616462 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119697fd-11c3-447d-a878-247344ba6233 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:05.616731 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119697fd-11c3-447d-a878-247344ba6233 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:05.618135 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 699/1412] 10.222.0.16 () {54 vars in 918 bytes} [Tue Aug 9 02:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:24:05.622851 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4204c69-e58a-4e21-b1d0-f3597f5278c7 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:05.623136 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4204c69-e58a-4e21-b1d0-f3597f5278c7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:05.623416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4204c69-e58a-4e21-b1d0-f3597f5278c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:05.694814 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:05.698145 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e4204c69-e58a-4e21-b1d0-f3597f5278c7 None None] MFA Rules not processed for user `78fff294b9794a26aa1bbc231fa1133c`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:24:05.700741 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e4204c69-e58a-4e21-b1d0-f3597f5278c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:05.820029 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 714/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Tue Aug 9 02:24:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:24:08.270568 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d09113-1b88-4e13-baac-77004d250376 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:08.271090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d09113-1b88-4e13-baac-77004d250376 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:08.271090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d09113-1b88-4e13-baac-77004d250376 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:08.272359 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 700/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 02:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:24:08.277613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c046b-ad15-455e-b791-dcf1cde79fd8 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:08.278025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c046b-ad15-455e-b791-dcf1cde79fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:08.278153 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c046b-ad15-455e-b791-dcf1cde79fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:08.342887 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ab0c046b-ad15-455e-b791-dcf1cde79fd8 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:24:08.344077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ab0c046b-ad15-455e-b791-dcf1cde79fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:08.397972 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:08.439586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 715/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 02:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:24:08.481225 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d09113-1b88-4e13-baac-77004d250376 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:24:08.482762 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-02d09113-1b88-4e13-baac-77004d250376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:08.625780 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d09113-1b88-4e13-baac-77004d250376 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:24:08.696020 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:08.737004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f7774-8afc-49d5-94b4-8c458063ef5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:24:08.737631 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f7774-8afc-49d5-94b4-8c458063ef5c service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:08.737909 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f7774-8afc-49d5-94b4-8c458063ef5c service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:08.738177 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f7774-8afc-49d5-94b4-8c458063ef5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:08.739759 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-092f7774-8afc-49d5-94b4-8c458063ef5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:08.825554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f7774-8afc-49d5-94b4-8c458063ef5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:24:08.827132 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f7774-8afc-49d5-94b4-8c458063ef5c service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:24:08.845098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 701/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:24:09.734405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f067111-def8-410b-bb0c-615a123d73d8 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:09.734929 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f067111-def8-410b-bb0c-615a123d73d8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:09.734929 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f067111-def8-410b-bb0c-615a123d73d8 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:09.736216 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 716/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 02:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:24:09.741165 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49909c66-a887-4f37-be3d-b71db1730968 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:09.741572 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49909c66-a887-4f37-be3d-b71db1730968 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:09.741713 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49909c66-a887-4f37-be3d-b71db1730968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:09.816226 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-49909c66-a887-4f37-be3d-b71db1730968 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:24:09.817487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-49909c66-a887-4f37-be3d-b71db1730968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:09.844668 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:09.913602 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 702/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 02:24:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:24:10.063085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f067111-def8-410b-bb0c-615a123d73d8 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:24:10.064596 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8f067111-def8-410b-bb0c-615a123d73d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:10.207529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f067111-def8-410b-bb0c-615a123d73d8 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:24:10.247356 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:10.318013 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a5a75-0fe4-48a5-8adf-f63d8ca43540 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:24:10.318537 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a5a75-0fe4-48a5-8adf-f63d8ca43540 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:10.318839 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a5a75-0fe4-48a5-8adf-f63d8ca43540 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:10.319108 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a5a75-0fe4-48a5-8adf-f63d8ca43540 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:10.320684 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-516a5a75-0fe4-48a5-8adf-f63d8ca43540 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:10.408732 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a5a75-0fe4-48a5-8adf-f63d8ca43540 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:24:10.410344 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a5a75-0fe4-48a5-8adf-f63d8ca43540 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:24:10.428323 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 717/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:24:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:24:11.333950 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff775d01-91b7-48e6-ade7-b47d0d23b14c None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:11.334501 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff775d01-91b7-48e6-ade7-b47d0d23b14c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:11.334501 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff775d01-91b7-48e6-ade7-b47d0d23b14c None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:11.335839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 703/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 02:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:24:11.340637 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b3c05-b831-4780-aed9-2a3d7ef49c3a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:11.341058 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b3c05-b831-4780-aed9-2a3d7ef49c3a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:11.341239 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b3c05-b831-4780-aed9-2a3d7ef49c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:11.396316 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:11.418075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-452b3c05-b831-4780-aed9-2a3d7ef49c3a None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:24:11.419292 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-452b3c05-b831-4780-aed9-2a3d7ef49c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:11.514622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 718/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 02:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:24:11.667929 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff775d01-91b7-48e6-ade7-b47d0d23b14c None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:24:11.669386 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ff775d01-91b7-48e6-ade7-b47d0d23b14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:11.812639 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff775d01-91b7-48e6-ade7-b47d0d23b14c None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:24:11.824566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:11.925204 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d546e-9456-4b33-ad0c-3d62191e913e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:24:11.925726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d546e-9456-4b33-ad0c-3d62191e913e service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:11.926000 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d546e-9456-4b33-ad0c-3d62191e913e service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:11.926265 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d546e-9456-4b33-ad0c-3d62191e913e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:11.927833 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-765d546e-9456-4b33-ad0c-3d62191e913e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:12.014953 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d546e-9456-4b33-ad0c-3d62191e913e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:24:12.016538 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d546e-9456-4b33-ad0c-3d62191e913e service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:24:12.034679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 704/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:24:12.898488 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02631ff2-74c0-4a01-9903-37447a97a6d4 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:12.899054 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02631ff2-74c0-4a01-9903-37447a97a6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:12.899054 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02631ff2-74c0-4a01-9903-37447a97a6d4 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:12.901151 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 719/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 02:24:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:24:12.906060 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06349941-d2db-462f-9ab3-03430431a9e2 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:12.906444 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06349941-d2db-462f-9ab3-03430431a9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:12.906612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06349941-d2db-462f-9ab3-03430431a9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:12.926095 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:12.984288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-06349941-d2db-462f-9ab3-03430431a9e2 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:24:12.985538 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-06349941-d2db-462f-9ab3-03430431a9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:13.079167 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 705/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 02:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:24:13.232174 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02631ff2-74c0-4a01-9903-37447a97a6d4 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:24:13.233640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-02631ff2-74c0-4a01-9903-37447a97a6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:13.342286 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:13.378676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02631ff2-74c0-4a01-9903-37447a97a6d4 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:24:13.492754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460dc3ce-d080-4ee2-a572-fb236e394d7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:24:13.493393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dc3ce-d080-4ee2-a572-fb236e394d7d service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:13.493942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dc3ce-d080-4ee2-a572-fb236e394d7d service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:13.494216 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dc3ce-d080-4ee2-a572-fb236e394d7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:13.495812 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-460dc3ce-d080-4ee2-a572-fb236e394d7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:13.569692 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:13.583908 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460dc3ce-d080-4ee2-a572-fb236e394d7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:24:13.585554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460dc3ce-d080-4ee2-a572-fb236e394d7d service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:24:13.603526 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 720/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:24:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:24:14.456611 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da4cbf-8034-44a0-ba59-68ca78e25472 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:14.457183 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da4cbf-8034-44a0-ba59-68ca78e25472 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:14.457183 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da4cbf-8034-44a0-ba59-68ca78e25472 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:14.458542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 706/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 02:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:24:14.463390 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fde9e-f048-4f0f-9350-8396f1fec860 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:14.463801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fde9e-f048-4f0f-9350-8396f1fec860 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:14.463936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fde9e-f048-4f0f-9350-8396f1fec860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:14.538954 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c69fde9e-f048-4f0f-9350-8396f1fec860 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:24:14.540195 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c69fde9e-f048-4f0f-9350-8396f1fec860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:14.636348 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 721/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 02:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:24:14.785438 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da4cbf-8034-44a0-ba59-68ca78e25472 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:24:14.786972 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-88da4cbf-8034-44a0-ba59-68ca78e25472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:14.870682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:14.931148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da4cbf-8034-44a0-ba59-68ca78e25472 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:24:15.044118 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414546e7-6280-4966-9898-bcae1dd9c0c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:24:15.044658 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414546e7-6280-4966-9898-bcae1dd9c0c4 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:15.044969 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414546e7-6280-4966-9898-bcae1dd9c0c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:15.045266 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414546e7-6280-4966-9898-bcae1dd9c0c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:15.047215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-414546e7-6280-4966-9898-bcae1dd9c0c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:15.095281 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:15.136129 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414546e7-6280-4966-9898-bcae1dd9c0c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:24:15.137755 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414546e7-6280-4966-9898-bcae1dd9c0c4 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:24:15.155906 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 707/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:24:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:24:15.987172 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead53d1e-497b-447b-8008-9a739ca7b064 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:15.987663 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead53d1e-497b-447b-8008-9a739ca7b064 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:15.987774 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead53d1e-497b-447b-8008-9a739ca7b064 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:15.989145 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 722/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 02:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:24:15.994531 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e4c95-770c-420b-812b-08b1ec1287e6 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:15.994969 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e4c95-770c-420b-812b-08b1ec1287e6 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:15.995068 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e4c95-770c-420b-812b-08b1ec1287e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:16.068707 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-fa0e4c95-770c-420b-812b-08b1ec1287e6 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:24:16.069964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-fa0e4c95-770c-420b-812b-08b1ec1287e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:16.169351 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 708/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 02:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:24:16.318269 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead53d1e-497b-447b-8008-9a739ca7b064 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:24:16.319794 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ead53d1e-497b-447b-8008-9a739ca7b064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:16.367954 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:16.464457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead53d1e-497b-447b-8008-9a739ca7b064 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:24:16.575964 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3c92b-3a61-40bf-8822-58fd4d6f9e15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:24:16.576486 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3c92b-3a61-40bf-8822-58fd4d6f9e15 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:16.576761 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3c92b-3a61-40bf-8822-58fd4d6f9e15 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:16.577056 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3c92b-3a61-40bf-8822-58fd4d6f9e15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:16.578637 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-65a3c92b-3a61-40bf-8822-58fd4d6f9e15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:16.585323 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:16.668077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3c92b-3a61-40bf-8822-58fd4d6f9e15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:24:16.669734 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3c92b-3a61-40bf-8822-58fd4d6f9e15 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:24:16.688131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 723/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:24:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:24:17.486885 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6864e-2552-4e3d-9f73-ab9edef9b7f2 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:17.487449 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6864e-2552-4e3d-9f73-ab9edef9b7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:17.487449 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6864e-2552-4e3d-9f73-ab9edef9b7f2 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:17.488997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 709/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 02:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:24:17.494407 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac340444-73aa-41b6-ad98-1b315db3c180 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:17.494814 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac340444-73aa-41b6-ad98-1b315db3c180 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:17.494946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac340444-73aa-41b6-ad98-1b315db3c180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:17.571713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ac340444-73aa-41b6-ad98-1b315db3c180 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:24:17.572913 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ac340444-73aa-41b6-ad98-1b315db3c180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:17.639515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:17.668753 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 724/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 02:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:24:17.825705 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6864e-2552-4e3d-9f73-ab9edef9b7f2 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:24:17.827205 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-51c6864e-2552-4e3d-9f73-ab9edef9b7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:17.844864 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:17.971809 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6864e-2552-4e3d-9f73-ab9edef9b7f2 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:24:18.058051 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:18.083852 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fe0ed-194c-4cd3-b27b-56c7f9fbe5cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:24:18.084389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fe0ed-194c-4cd3-b27b-56c7f9fbe5cd service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:18.084667 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fe0ed-194c-4cd3-b27b-56c7f9fbe5cd service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:18.084937 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fe0ed-194c-4cd3-b27b-56c7f9fbe5cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:18.086556 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5a0fe0ed-194c-4cd3-b27b-56c7f9fbe5cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:18.173306 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0fe0ed-194c-4cd3-b27b-56c7f9fbe5cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:24:18.174872 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0fe0ed-194c-4cd3-b27b-56c7f9fbe5cd service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:24:18.192185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 710/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:24:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:24:18.981578 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9aee2-3fb1-40b0-ab33-e4f47de52b3e None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:18.981999 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9aee2-3fb1-40b0-ab33-e4f47de52b3e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:18.982107 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9aee2-3fb1-40b0-ab33-e4f47de52b3e None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:18.983463 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 725/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 02:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:24:18.988293 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbedb4d-e58e-42a2-9769-d3b070aee898 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:18.988750 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbedb4d-e58e-42a2-9769-d3b070aee898 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:18.988865 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbedb4d-e58e-42a2-9769-d3b070aee898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:19.068224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-efbedb4d-e58e-42a2-9769-d3b070aee898 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:24:19.069489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-efbedb4d-e58e-42a2-9769-d3b070aee898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:19.115539 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:19.174884 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 711/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 02:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:24:19.326991 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9aee2-3fb1-40b0-ab33-e4f47de52b3e None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:24:19.328494 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1fb9aee2-3fb1-40b0-ab33-e4f47de52b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:19.471786 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9aee2-3fb1-40b0-ab33-e4f47de52b3e None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:24:19.526306 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:19.584799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be27af-e435-46dc-b352-eaeab3278928 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:24:19.585356 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be27af-e435-46dc-b352-eaeab3278928 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:19.585635 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be27af-e435-46dc-b352-eaeab3278928 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:19.585904 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be27af-e435-46dc-b352-eaeab3278928 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:19.587554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-70be27af-e435-46dc-b352-eaeab3278928 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:19.676492 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be27af-e435-46dc-b352-eaeab3278928 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:24:19.678110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be27af-e435-46dc-b352-eaeab3278928 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:24:19.696131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 726/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:24:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:24:20.495581 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af166f-7666-44f7-a009-919d6e9667a9 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:20.496105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af166f-7666-44f7-a009-919d6e9667a9 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:20.496105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af166f-7666-44f7-a009-919d6e9667a9 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:20.497547 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 712/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 02:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:24:20.502460 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f8b38-5a57-44e2-8aef-a04ff5fd3624 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:20.502901 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f8b38-5a57-44e2-8aef-a04ff5fd3624 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:20.503001 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f8b38-5a57-44e2-8aef-a04ff5fd3624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:20.577263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-0b4f8b38-5a57-44e2-8aef-a04ff5fd3624 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:24:20.578469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0b4f8b38-5a57-44e2-8aef-a04ff5fd3624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:20.580427 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:20.674109 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 727/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 02:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:24:20.831857 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af166f-7666-44f7-a009-919d6e9667a9 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:24:20.833413 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-71af166f-7666-44f7-a009-919d6e9667a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:20.976926 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af166f-7666-44f7-a009-919d6e9667a9 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:24:21.004096 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:21.089438 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979de21b-6461-4a4d-ab7b-3221eb0349ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:24:21.090032 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979de21b-6461-4a4d-ab7b-3221eb0349ae service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:21.090308 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979de21b-6461-4a4d-ab7b-3221eb0349ae service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:21.090575 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979de21b-6461-4a4d-ab7b-3221eb0349ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:21.092154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-979de21b-6461-4a4d-ab7b-3221eb0349ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:21.177846 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979de21b-6461-4a4d-ab7b-3221eb0349ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:24:21.179414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979de21b-6461-4a4d-ab7b-3221eb0349ae service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:24:21.198948 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 713/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:24:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:24:23.087975 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548de242-9a05-4f02-aefb-d2303efdbf81 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:23.088548 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548de242-9a05-4f02-aefb-d2303efdbf81 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:23.088548 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548de242-9a05-4f02-aefb-d2303efdbf81 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:23.089906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 728/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 02:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:24:23.094959 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d7069-9d7d-442c-bffa-ce4d16403e02 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:23.095371 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d7069-9d7d-442c-bffa-ce4d16403e02 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:23.095510 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d7069-9d7d-442c-bffa-ce4d16403e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:23.138024 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:23.163392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-302d7069-9d7d-442c-bffa-ce4d16403e02 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:24:23.164607 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-302d7069-9d7d-442c-bffa-ce4d16403e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:23.259938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 714/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 02:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:24:23.298934 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548de242-9a05-4f02-aefb-d2303efdbf81 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:24:23.300479 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-548de242-9a05-4f02-aefb-d2303efdbf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:23.403159 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548de242-9a05-4f02-aefb-d2303efdbf81 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:24:23.436061 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:23.478342 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3069fe-b6f2-4e36-b7cf-64ac4533f520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:24:23.478948 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3069fe-b6f2-4e36-b7cf-64ac4533f520 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:23.479233 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3069fe-b6f2-4e36-b7cf-64ac4533f520 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:23.479502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3069fe-b6f2-4e36-b7cf-64ac4533f520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:23.482346 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5c3069fe-b6f2-4e36-b7cf-64ac4533f520 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:23.589823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3069fe-b6f2-4e36-b7cf-64ac4533f520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:24:23.591266 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3069fe-b6f2-4e36-b7cf-64ac4533f520 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:24:23.610888 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 729/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:24:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:24:25.827571 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41431b8-6c70-4276-b4c2-a271b1bad5d8 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:25.828148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41431b8-6c70-4276-b4c2-a271b1bad5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:25.828148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41431b8-6c70-4276-b4c2-a271b1bad5d8 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:25.829775 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 715/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 02:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:24:25.835291 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd98be1-5350-4f17-9d64-29d726f3d968 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:25.835699 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd98be1-5350-4f17-9d64-29d726f3d968 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:25.835845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd98be1-5350-4f17-9d64-29d726f3d968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:25.905865 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ebd98be1-5350-4f17-9d64-29d726f3d968 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:24:25.907086 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ebd98be1-5350-4f17-9d64-29d726f3d968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:25.919805 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:26.005990 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 730/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 02:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:24:26.043905 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41431b8-6c70-4276-b4c2-a271b1bad5d8 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:24:26.045397 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f41431b8-6c70-4276-b4c2-a271b1bad5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:26.147119 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41431b8-6c70-4276-b4c2-a271b1bad5d8 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:24:26.159327 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:26.225294 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf367dc-76cc-44de-9fb0-acaf91dfe7a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:24:26.225899 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf367dc-76cc-44de-9fb0-acaf91dfe7a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:26.226180 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf367dc-76cc-44de-9fb0-acaf91dfe7a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:26.226452 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf367dc-76cc-44de-9fb0-acaf91dfe7a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:26.228049 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-fbf367dc-76cc-44de-9fb0-acaf91dfe7a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:26.335685 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf367dc-76cc-44de-9fb0-acaf91dfe7a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:24:26.337123 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf367dc-76cc-44de-9fb0-acaf91dfe7a2 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:24:26.355203 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 716/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:24:28.645107 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e01a60-7534-46b2-977b-fad271a1f058 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:28.645677 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e01a60-7534-46b2-977b-fad271a1f058 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:28.645677 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e01a60-7534-46b2-977b-fad271a1f058 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:28.647006 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 731/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 02:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:24:28.653411 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323e3e1-2349-4098-82a2-828f685010ea None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:28.653867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323e3e1-2349-4098-82a2-828f685010ea None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:28.653982 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323e3e1-2349-4098-82a2-828f685010ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:28.700153 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:28.718516 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-f323e3e1-2349-4098-82a2-828f685010ea None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:24:28.719747 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f323e3e1-2349-4098-82a2-828f685010ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:28.813306 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 717/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 02:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:24:28.853100 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e01a60-7534-46b2-977b-fad271a1f058 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:24:28.854637 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a3e01a60-7534-46b2-977b-fad271a1f058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:28.957233 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e01a60-7534-46b2-977b-fad271a1f058 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:24:28.997890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:29.031239 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bb6b6-1e11-4f88-9ce9-a42900efbd2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:24:29.031831 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bb6b6-1e11-4f88-9ce9-a42900efbd2e service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:29.032110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bb6b6-1e11-4f88-9ce9-a42900efbd2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:29.032379 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bb6b6-1e11-4f88-9ce9-a42900efbd2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:29.033991 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9e8bb6b6-1e11-4f88-9ce9-a42900efbd2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:29.139270 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bb6b6-1e11-4f88-9ce9-a42900efbd2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:24:29.140688 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bb6b6-1e11-4f88-9ce9-a42900efbd2e service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:24:29.159202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 732/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:24:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:24:31.282114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5f64d-14ea-49b6-9fe0-ab92b87579ca None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:31.282658 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5f64d-14ea-49b6-9fe0-ab92b87579ca None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:31.282658 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5f64d-14ea-49b6-9fe0-ab92b87579ca None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:31.284021 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 718/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 02:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:24:31.289271 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952b9fc-41db-4d06-8891-89c5d9035e7f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:31.289689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952b9fc-41db-4d06-8891-89c5d9035e7f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:31.289902 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952b9fc-41db-4d06-8891-89c5d9035e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:31.355278 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-3952b9fc-41db-4d06-8891-89c5d9035e7f None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:24:31.356471 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3952b9fc-41db-4d06-8891-89c5d9035e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:31.376585 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:31.451019 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 733/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 02:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:24:31.491050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5f64d-14ea-49b6-9fe0-ab92b87579ca None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:24:31.492600 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9ea5f64d-14ea-49b6-9fe0-ab92b87579ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:31.593916 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5f64d-14ea-49b6-9fe0-ab92b87579ca None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:24:31.612948 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:31.670153 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b32ff-ee61-454c-bf12-c427a01774e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:24:31.670753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b32ff-ee61-454c-bf12-c427a01774e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:31.671029 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b32ff-ee61-454c-bf12-c427a01774e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:31.671298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b32ff-ee61-454c-bf12-c427a01774e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:31.672882 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a59b32ff-ee61-454c-bf12-c427a01774e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:31.779488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b32ff-ee61-454c-bf12-c427a01774e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:24:31.780922 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b32ff-ee61-454c-bf12-c427a01774e6 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:24:31.798436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 719/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:24:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:24:33.920983 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95b03d-f90f-4559-8f11-a44708c009fc None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:33.923279 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95b03d-f90f-4559-8f11-a44708c009fc None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:33.923279 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95b03d-f90f-4559-8f11-a44708c009fc None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:33.923279 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 734/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 02:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:24:33.928207 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32678d2b-22b5-40ab-a1c1-6dc53840f4fd None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:33.928645 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32678d2b-22b5-40ab-a1c1-6dc53840f4fd None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:33.928766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32678d2b-22b5-40ab-a1c1-6dc53840f4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:33.995849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:33.998658 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-32678d2b-22b5-40ab-a1c1-6dc53840f4fd None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:24:34.000449 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-32678d2b-22b5-40ab-a1c1-6dc53840f4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:34.101419 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 720/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 02:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:24:34.140153 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95b03d-f90f-4559-8f11-a44708c009fc None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:24:34.141736 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3f95b03d-f90f-4559-8f11-a44708c009fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:34.244735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95b03d-f90f-4559-8f11-a44708c009fc None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:24:34.293085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:34.318583 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5a391-c2e2-463d-8f6b-9e5c8e956f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:24:34.319174 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5a391-c2e2-463d-8f6b-9e5c8e956f28 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:34.319454 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5a391-c2e2-463d-8f6b-9e5c8e956f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:34.319726 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5a391-c2e2-463d-8f6b-9e5c8e956f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:34.321353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bfc5a391-c2e2-463d-8f6b-9e5c8e956f28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:34.426962 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5a391-c2e2-463d-8f6b-9e5c8e956f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:24:34.428383 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5a391-c2e2-463d-8f6b-9e5c8e956f28 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:24:34.446711 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 735/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:24:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:24:36.491726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0e500-0ee7-4a17-a30c-132ca0d817de None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:36.492322 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0e500-0ee7-4a17-a30c-132ca0d817de None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:36.492322 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0e500-0ee7-4a17-a30c-132ca0d817de None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:36.494547 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 721/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 02:24:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:24:36.499944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b93841-f59a-40a1-a5b8-4171328bed8b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:36.500360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b93841-f59a-40a1-a5b8-4171328bed8b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:36.500498 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b93841-f59a-40a1-a5b8-4171328bed8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:36.567893 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c6b93841-f59a-40a1-a5b8-4171328bed8b None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:24:36.569176 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c6b93841-f59a-40a1-a5b8-4171328bed8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:36.597434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:36.663884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 736/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 02:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:24:36.702300 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0e500-0ee7-4a17-a30c-132ca0d817de None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:24:36.703859 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e4a0e500-0ee7-4a17-a30c-132ca0d817de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:36.806302 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0e500-0ee7-4a17-a30c-132ca0d817de None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:24:36.834660 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:36.879357 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4ffd5-9310-4258-8eb6-8a0cfaa5561f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:24:36.879955 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4ffd5-9310-4258-8eb6-8a0cfaa5561f service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:36.880230 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4ffd5-9310-4258-8eb6-8a0cfaa5561f service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:36.880497 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4ffd5-9310-4258-8eb6-8a0cfaa5561f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:36.882104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-14a4ffd5-9310-4258-8eb6-8a0cfaa5561f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:36.989352 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4ffd5-9310-4258-8eb6-8a0cfaa5561f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:24:36.990776 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a4ffd5-9310-4258-8eb6-8a0cfaa5561f service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:24:37.008642 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 722/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:24:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:24:39.052147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9c6ec-9b5e-45af-a1c7-16550dda74d1 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:39.052722 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9c6ec-9b5e-45af-a1c7-16550dda74d1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:39.052722 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9c6ec-9b5e-45af-a1c7-16550dda74d1 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:39.054075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 737/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 02:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:24:39.059275 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a1655-ff6f-4c7e-8870-8d141bb4e813 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:39.059674 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a1655-ff6f-4c7e-8870-8d141bb4e813 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:39.059829 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a1655-ff6f-4c7e-8870-8d141bb4e813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:39.125250 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-941a1655-ff6f-4c7e-8870-8d141bb4e813 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:24:39.126461 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-941a1655-ff6f-4c7e-8870-8d141bb4e813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:39.135117 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:39.222874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 723/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 02:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:24:39.261403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9c6ec-9b5e-45af-a1c7-16550dda74d1 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:24:39.263006 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d7d9c6ec-9b5e-45af-a1c7-16550dda74d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:39.365583 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9c6ec-9b5e-45af-a1c7-16550dda74d1 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:24:39.420478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:39.439129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0d53d-53ef-46cd-92f9-076c10105e8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:24:39.439723 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0d53d-53ef-46cd-92f9-076c10105e8b service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:39.440005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0d53d-53ef-46cd-92f9-076c10105e8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:39.440277 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0d53d-53ef-46cd-92f9-076c10105e8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:39.441895 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0ed0d53d-53ef-46cd-92f9-076c10105e8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:39.548620 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0d53d-53ef-46cd-92f9-076c10105e8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:24:39.550094 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0d53d-53ef-46cd-92f9-076c10105e8b service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:24:39.568649 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 738/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:24:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:24:41.601032 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5e1c7-9e58-4647-aefb-f116aa8653ae None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:41.601576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5e1c7-9e58-4647-aefb-f116aa8653ae None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:41.601672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5e1c7-9e58-4647-aefb-f116aa8653ae None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:41.603060 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 724/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 02:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:24:41.608310 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7880f-6777-4a58-a0c1-f949b97edfd7 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:41.608749 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7880f-6777-4a58-a0c1-f949b97edfd7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:41.608970 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b7880f-6777-4a58-a0c1-f949b97edfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:41.674050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f3b7880f-6777-4a58-a0c1-f949b97edfd7 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:24:41.675262 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f3b7880f-6777-4a58-a0c1-f949b97edfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:41.713902 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:41.772251 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 739/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 02:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:24:41.809970 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5e1c7-9e58-4647-aefb-f116aa8653ae None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:24:41.811505 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-dfa5e1c7-9e58-4647-aefb-f116aa8653ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:41.913791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5e1c7-9e58-4647-aefb-f116aa8653ae None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:24:41.950773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:41.985933 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230b06d-8041-47c0-834d-999f81bf8929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:24:41.987457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230b06d-8041-47c0-834d-999f81bf8929 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:41.987732 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230b06d-8041-47c0-834d-999f81bf8929 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:41.988003 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230b06d-8041-47c0-834d-999f81bf8929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:41.989606 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6230b06d-8041-47c0-834d-999f81bf8929 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:42.096526 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230b06d-8041-47c0-834d-999f81bf8929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:24:42.097991 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230b06d-8041-47c0-834d-999f81bf8929 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:24:42.116021 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 725/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:24:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:24:44.141447 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1e7ef-a893-4fee-8db3-b64f36bdc7a5 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:44.141999 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1e7ef-a893-4fee-8db3-b64f36bdc7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:44.141999 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1e7ef-a893-4fee-8db3-b64f36bdc7a5 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:44.143366 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 740/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 02:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:24:44.148868 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd77a8-b773-461e-98ce-0303a8e1e6d4 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:44.149336 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd77a8-b773-461e-98ce-0303a8e1e6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:44.149498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd77a8-b773-461e-98ce-0303a8e1e6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:44.214894 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-f3fd77a8-b773-461e-98ce-0303a8e1e6d4 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:24:44.216115 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f3fd77a8-b773-461e-98ce-0303a8e1e6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:44.234389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:44.312498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 726/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 02:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:24:44.349554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1e7ef-a893-4fee-8db3-b64f36bdc7a5 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:24:44.351074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e5c1e7ef-a893-4fee-8db3-b64f36bdc7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:44.452523 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1e7ef-a893-4fee-8db3-b64f36bdc7a5 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:24:44.518588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:44.525688 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78aef0-4f45-4b1f-b543-bbee9d7f40e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:24:44.526290 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78aef0-4f45-4b1f-b543-bbee9d7f40e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:44.526570 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78aef0-4f45-4b1f-b543-bbee9d7f40e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:44.526840 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78aef0-4f45-4b1f-b543-bbee9d7f40e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:44.528412 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9f78aef0-4f45-4b1f-b543-bbee9d7f40e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:44.635495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78aef0-4f45-4b1f-b543-bbee9d7f40e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:24:44.636924 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78aef0-4f45-4b1f-b543-bbee9d7f40e9 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:24:44.654953 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 741/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:24:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:24:46.641767 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060128ac-02bf-4bdd-9cbf-a15f9b2b9af5 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:46.642330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060128ac-02bf-4bdd-9cbf-a15f9b2b9af5 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:46.642330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060128ac-02bf-4bdd-9cbf-a15f9b2b9af5 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:46.643681 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 727/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 02:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:24:46.649402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795067e-5ca9-47ab-a709-244c87a21827 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:46.650235 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795067e-5ca9-47ab-a709-244c87a21827 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:46.650235 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795067e-5ca9-47ab-a709-244c87a21827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:46.716411 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a795067e-5ca9-47ab-a709-244c87a21827 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:24:46.717664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a795067e-5ca9-47ab-a709-244c87a21827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:46.766743 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:46.815695 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 742/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 02:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:24:46.852946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060128ac-02bf-4bdd-9cbf-a15f9b2b9af5 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:24:46.854792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-060128ac-02bf-4bdd-9cbf-a15f9b2b9af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:46.957600 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060128ac-02bf-4bdd-9cbf-a15f9b2b9af5 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:24:47.005471 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:47.032141 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329be2af-404e-41ba-a3b5-275e814f499e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:24:47.032741 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329be2af-404e-41ba-a3b5-275e814f499e service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:24:47.033053 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329be2af-404e-41ba-a3b5-275e814f499e service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:24:47.033324 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329be2af-404e-41ba-a3b5-275e814f499e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:24:47.034925 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-329be2af-404e-41ba-a3b5-275e814f499e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:24:47.140820 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329be2af-404e-41ba-a3b5-275e814f499e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:24:47.142292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329be2af-404e-41ba-a3b5-275e814f499e service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:24:47.160737 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 728/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:24:56.813968 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=22 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:24:57.158724 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=66 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:25:06.487013 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66a34c-ea2c-4b5c-b998-262abfd6e796 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:25:06.487614 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66a34c-ea2c-4b5c-b998-262abfd6e796 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:25:06.487614 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb66a34c-ea2c-4b5c-b998-262abfd6e796 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:25:06.488913 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 743/1471] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:25:06.494495 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12f954-15f6-410a-ab90-831344b959c2 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:25:06.494939 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12f954-15f6-410a-ab90-831344b959c2 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:25:06.495043 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12f954-15f6-410a-ab90-831344b959c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:25:06.561035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-ee12f954-15f6-410a-ab90-831344b959c2 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:25:06.562240 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ee12f954-15f6-410a-ab90-831344b959c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:25:06.657968 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 729/1472] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:25:06.740788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67226124-1998-4d78-8640-189dc12e38e7 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:25:06.741010 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67226124-1998-4d78-8640-189dc12e38e7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:25:06.741309 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67226124-1998-4d78-8640-189dc12e38e7 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:25:06.742666 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 744/1473] 10.222.0.16 () {54 vars in 967 bytes} [Tue Aug 9 02:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:25:06.747649 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c8593-12ed-4b5d-8bf3-ef6eb3f2475a None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:25:06.747956 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c8593-12ed-4b5d-8bf3-ef6eb3f2475a None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:25:06.748233 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c8593-12ed-4b5d-8bf3-ef6eb3f2475a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:25:06.825826 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-055c8593-12ed-4b5d-8bf3-ef6eb3f2475a None None] MFA Rules not processed for user `63645a88f5924a57b5b828aacd856902`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:25:06.827042 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-055c8593-12ed-4b5d-8bf3-ef6eb3f2475a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:25:06.847548 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:25:06.904677 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 730/1474] 10.222.0.16 () {58 vars in 1064 bytes} [Tue Aug 9 02:25:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:25:06.912097 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67226124-1998-4d78-8640-189dc12e38e7 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:25:06.913697 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-67226124-1998-4d78-8640-189dc12e38e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:25:07.016150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67226124-1998-4d78-8640-189dc12e38e7 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:25:07.087047 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c857cc-d0a1-49c0-a03f-8436151cb240 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63645a88f5924a57b5b828aacd856902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:25:07.087645 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c857cc-d0a1-49c0-a03f-8436151cb240 service glance] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:25:07.087923 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c857cc-d0a1-49c0-a03f-8436151cb240 service glance] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:25:07.088192 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c857cc-d0a1-49c0-a03f-8436151cb240 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:25:07.089840 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d3c857cc-d0a1-49c0-a03f-8436151cb240 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:25:07.143298 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:25:07.205978 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c857cc-d0a1-49c0-a03f-8436151cb240 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:25:07.207456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c857cc-d0a1-49c0-a03f-8436151cb240 service glance] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:25:07.225690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 745/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:25:09.283209 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3ba73-9b31-404a-8d47-cfe5885eb2e5 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:25:09.283799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3ba73-9b31-404a-8d47-cfe5885eb2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:25:09.283799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3ba73-9b31-404a-8d47-cfe5885eb2e5 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:25:09.285188 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 731/1476] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:25:09.290444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c544b5-83df-469a-9ef2-999ba1a4ac9b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:25:09.290866 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c544b5-83df-469a-9ef2-999ba1a4ac9b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:25:09.290992 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c544b5-83df-469a-9ef2-999ba1a4ac9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:25:09.358690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-33c544b5-83df-469a-9ef2-999ba1a4ac9b None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:25:09.360028 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-33c544b5-83df-469a-9ef2-999ba1a4ac9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:25:09.455200 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 746/1477] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:25:09.478464 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3ba73-9b31-404a-8d47-cfe5885eb2e5 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:25:09.479968 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a4a3ba73-9b31-404a-8d47-cfe5885eb2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:25:09.602448 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3ba73-9b31-404a-8d47-cfe5885eb2e5 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:25:09.649711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:25:09.694865 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f44f43-3794-4c5a-a98f-b897b72ff05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:25:09.695468 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f44f43-3794-4c5a-a98f-b897b72ff05a admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:25:09.695746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f44f43-3794-4c5a-a98f-b897b72ff05a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:25:09.696016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f44f43-3794-4c5a-a98f-b897b72ff05a admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:25:09.696651 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f44f43-3794-4c5a-a98f-b897b72ff05a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:25:09.698468 dv-cinder-852461-1-smb devstack@keystone.service[80286]: WARNING py.warnings [None req-58f44f43-3794-4c5a-a98f-b897b72ff05a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 02:25:09.698468 dv-cinder-852461-1-smb devstack@keystone.service[80286]: warnings.warn(msg) Aug 09 02:25:09.698468 dv-cinder-852461-1-smb devstack@keystone.service[80286]: Aug 09 02:25:09.699596 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f44f43-3794-4c5a-a98f-b897b72ff05a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:25:09.717893 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 732/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 9 02:25:09 2022] GET /identity/v3/projects => generated 2553 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:25:11.718435 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c673412-4852-46d4-8187-c3f9d9dd97bb None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:25:11.718974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c673412-4852-46d4-8187-c3f9d9dd97bb None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:25:11.718974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c673412-4852-46d4-8187-c3f9d9dd97bb None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:25:11.720311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 747/1479] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:25:11.725524 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38d7f9-09c8-412e-a63a-fca1f1cafc9b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:25:11.726429 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38d7f9-09c8-412e-a63a-fca1f1cafc9b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:25:11.726604 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38d7f9-09c8-412e-a63a-fca1f1cafc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:25:11.790895 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-5f38d7f9-09c8-412e-a63a-fca1f1cafc9b None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:25:11.792092 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5f38d7f9-09c8-412e-a63a-fca1f1cafc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:25:11.885956 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 733/1480] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:25:11.928743 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c673412-4852-46d4-8187-c3f9d9dd97bb None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:25:11.930906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9c673412-4852-46d4-8187-c3f9d9dd97bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:25:11.940843 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:25:12.082160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c673412-4852-46d4-8187-c3f9d9dd97bb None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:25:12.160765 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:25:12.193495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d817448-38d8-4816-9c05-c1b7e6c805c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:25:12.194101 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d817448-38d8-4816-9c05-c1b7e6c805c9 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:25:12.194382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d817448-38d8-4816-9c05-c1b7e6c805c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:25:12.194671 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d817448-38d8-4816-9c05-c1b7e6c805c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:25:12.196271 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0d817448-38d8-4816-9c05-c1b7e6c805c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:25:12.284021 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d817448-38d8-4816-9c05-c1b7e6c805c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:25:12.285646 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d817448-38d8-4816-9c05-c1b7e6c805c9 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:25:12.303691 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 748/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:25:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:25:14.489599 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410a066-1668-410c-bcce-9edc3b9908e6 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:25:14.490165 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410a066-1668-410c-bcce-9edc3b9908e6 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:25:14.490165 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410a066-1668-410c-bcce-9edc3b9908e6 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:25:14.492031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 734/1482] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:25:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:25:14.497412 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1c576-ca1b-4a40-ae84-6da25f0862f5 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:25:14.497793 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1c576-ca1b-4a40-ae84-6da25f0862f5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:25:14.497962 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1c576-ca1b-4a40-ae84-6da25f0862f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:25:14.562921 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-15f1c576-ca1b-4a40-ae84-6da25f0862f5 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:25:14.564123 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-15f1c576-ca1b-4a40-ae84-6da25f0862f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:25:14.610539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:25:14.661746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 749/1483] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:25:14.698678 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410a066-1668-410c-bcce-9edc3b9908e6 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:25:14.700204 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f410a066-1668-410c-bcce-9edc3b9908e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:25:14.723324 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:25:14.804478 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410a066-1668-410c-bcce-9edc3b9908e6 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:25:14.876214 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdadf85-aa60-4ac7-9750-3f05851c6ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:25:14.876811 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdadf85-aa60-4ac7-9750-3f05851c6ccd service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:25:14.877117 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdadf85-aa60-4ac7-9750-3f05851c6ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:25:14.877389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdadf85-aa60-4ac7-9750-3f05851c6ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:25:14.878983 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9fdadf85-aa60-4ac7-9750-3f05851c6ccd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:25:14.951055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:25:14.985748 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdadf85-aa60-4ac7-9750-3f05851c6ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:25:14.987186 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdadf85-aa60-4ac7-9750-3f05851c6ccd service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:25:15.005798 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 735/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:25:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:25:17.034434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8027c2-020c-4620-9da9-45bf5100f0c8 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:25:17.034955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8027c2-020c-4620-9da9-45bf5100f0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:25:17.035101 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8027c2-020c-4620-9da9-45bf5100f0c8 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:25:17.036348 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 750/1485] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:25:17.041536 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72daff37-2794-4e2b-9353-3ca3fbbec75d None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:25:17.041976 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72daff37-2794-4e2b-9353-3ca3fbbec75d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:25:17.042101 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72daff37-2794-4e2b-9353-3ca3fbbec75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:25:17.107694 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-72daff37-2794-4e2b-9353-3ca3fbbec75d None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:25:17.108894 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-72daff37-2794-4e2b-9353-3ca3fbbec75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:25:17.204334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 736/1486] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:25:17.242624 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8027c2-020c-4620-9da9-45bf5100f0c8 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:25:17.244419 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5d8027c2-020c-4620-9da9-45bf5100f0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:25:17.349179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8027c2-020c-4620-9da9-45bf5100f0c8 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:25:17.420242 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:25:17.422448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339b95e-4312-4f0f-ac2a-8f3f6cf6a721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:25:17.423270 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339b95e-4312-4f0f-ac2a-8f3f6cf6a721 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:25:17.423606 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339b95e-4312-4f0f-ac2a-8f3f6cf6a721 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:25:17.424112 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339b95e-4312-4f0f-ac2a-8f3f6cf6a721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:25:17.425980 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d339b95e-4312-4f0f-ac2a-8f3f6cf6a721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:25:17.534095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339b95e-4312-4f0f-ac2a-8f3f6cf6a721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:25:17.535535 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339b95e-4312-4f0f-ac2a-8f3f6cf6a721 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:25:17.554442 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 751/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:25:19.667784 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e0a3d-a7e9-4531-9f39-81147d283333 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:25:19.668373 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e0a3d-a7e9-4531-9f39-81147d283333 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:25:19.668373 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e0a3d-a7e9-4531-9f39-81147d283333 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:25:19.669724 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 737/1488] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:25:19.674927 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0f268-5277-41e0-91f3-683fbe769d7c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:25:19.675368 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0f268-5277-41e0-91f3-683fbe769d7c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:25:19.675477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0f268-5277-41e0-91f3-683fbe769d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:25:19.747556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d6c0f268-5277-41e0-91f3-683fbe769d7c None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:25:19.748779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d6c0f268-5277-41e0-91f3-683fbe769d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:25:19.800026 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:25:19.843886 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 752/1489] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:25:19.887290 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e0a3d-a7e9-4531-9f39-81147d283333 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:25:19.888817 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2b0e0a3d-a7e9-4531-9f39-81147d283333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:25:19.924890 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:25:19.992305 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e0a3d-a7e9-4531-9f39-81147d283333 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:25:20.064555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1e4a7-4835-4365-8687-b5556562563e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:25:20.065119 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1e4a7-4835-4365-8687-b5556562563e service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:25:20.065400 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1e4a7-4835-4365-8687-b5556562563e service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:25:20.065667 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1e4a7-4835-4365-8687-b5556562563e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:25:20.067258 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6fd1e4a7-4835-4365-8687-b5556562563e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:25:20.148633 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:25:20.177511 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1e4a7-4835-4365-8687-b5556562563e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:25:20.178975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1e4a7-4835-4365-8687-b5556562563e service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:25:20.197148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 738/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:25:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:25:22.363537 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b59711-18c1-441d-8133-6ed4e2c617c5 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:25:22.364030 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b59711-18c1-441d-8133-6ed4e2c617c5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:25:22.364145 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b59711-18c1-441d-8133-6ed4e2c617c5 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:25:22.365512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 753/1491] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 9 02:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:25:22.371514 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba3245-b564-4ced-b355-3aa26a8cdead None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:25:22.371951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba3245-b564-4ced-b355-3aa26a8cdead None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:25:22.372057 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba3245-b564-4ced-b355-3aa26a8cdead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:25:22.437117 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-61ba3245-b564-4ced-b355-3aa26a8cdead None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:25:22.438331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-61ba3245-b564-4ced-b355-3aa26a8cdead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:25:22.531436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 739/1492] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 9 02:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:25:22.571129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b59711-18c1-441d-8133-6ed4e2c617c5 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:25:22.572675 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d2b59711-18c1-441d-8133-6ed4e2c617c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:25:22.678191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b59711-18c1-441d-8133-6ed4e2c617c5 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:25:22.754653 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b80c3a-4815-462c-b801-e43ac27e7a89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:25:22.755257 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b80c3a-4815-462c-b801-e43ac27e7a89 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:25:22.755535 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b80c3a-4815-462c-b801-e43ac27e7a89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:25:22.755805 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b80c3a-4815-462c-b801-e43ac27e7a89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:25:22.757466 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-41b80c3a-4815-462c-b801-e43ac27e7a89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:25:22.766551 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:25:22.865521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b80c3a-4815-462c-b801-e43ac27e7a89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:25:22.867494 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b80c3a-4815-462c-b801-e43ac27e7a89 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:25:22.885999 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 754/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:25:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:25:32.529692 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=82 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:25:32.883802 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=50 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:26:39.527969 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cd0d2-1461-4715-b7e3-c4062b123692 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:26:39.528577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cd0d2-1461-4715-b7e3-c4062b123692 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:26:39.528577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cd0d2-1461-4715-b7e3-c4062b123692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:26:39.603854 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a14cd0d2-1461-4715-b7e3-c4062b123692 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:26:39.605070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a14cd0d2-1461-4715-b7e3-c4062b123692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:26:39.699275 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 740/1494] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:26:39.707392 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c6543-9576-45f0-93f3-03ddf7397e56 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:26:39.707904 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c6543-9576-45f0-93f3-03ddf7397e56 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:26:39.708026 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c6543-9576-45f0-93f3-03ddf7397e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:26:39.782742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b79c6543-9576-45f0-93f3-03ddf7397e56 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:26:39.783864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b79c6543-9576-45f0-93f3-03ddf7397e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:26:39.879247 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 755/1495] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:26:39.883985 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cd0d2-1461-4715-b7e3-c4062b123692 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:26:39.885213 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a14cd0d2-1461-4715-b7e3-c4062b123692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:26:39.897090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cd0d2-1461-4715-b7e3-c4062b123692 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:26:39.957872 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:26:39.992879 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804b186-1215-4c80-bf11-e00a6b21e59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:26:39.993517 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804b186-1215-4c80-bf11-e00a6b21e59f admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:26:39.993793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804b186-1215-4c80-bf11-e00a6b21e59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:26:39.994060 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804b186-1215-4c80-bf11-e00a6b21e59f admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:26:39.994831 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804b186-1215-4c80-bf11-e00a6b21e59f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:26:39.995184 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804b186-1215-4c80-bf11-e00a6b21e59f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:26:39.996312 dv-cinder-852461-1-smb devstack@keystone.service[80286]: WARNING py.warnings [None req-5804b186-1215-4c80-bf11-e00a6b21e59f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 02:26:39.996312 dv-cinder-852461-1-smb devstack@keystone.service[80286]: warnings.warn(msg) Aug 09 02:26:39.996312 dv-cinder-852461-1-smb devstack@keystone.service[80286]: Aug 09 02:26:39.997267 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804b186-1215-4c80-bf11-e00a6b21e59f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:26:40.008897 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 741/1496] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:26:40.017102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c6543-9576-45f0-93f3-03ddf7397e56 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:26:40.026537 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c6543-9576-45f0-93f3-03ddf7397e56 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:26:40.087564 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:26:40.121508 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f45ef3-7d84-480a-98a2-c46187ebed4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:26:40.122113 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f45ef3-7d84-480a-98a2-c46187ebed4e admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:26:40.122391 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f45ef3-7d84-480a-98a2-c46187ebed4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:26:40.122656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f45ef3-7d84-480a-98a2-c46187ebed4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:26:40.123284 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f45ef3-7d84-480a-98a2-c46187ebed4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:26:40.125003 dv-cinder-852461-1-smb devstack@keystone.service[80285]: WARNING py.warnings [None req-42f45ef3-7d84-480a-98a2-c46187ebed4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 02:26:40.125003 dv-cinder-852461-1-smb devstack@keystone.service[80285]: warnings.warn(msg) Aug 09 02:26:40.125003 dv-cinder-852461-1-smb devstack@keystone.service[80285]: Aug 09 02:26:40.126253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f45ef3-7d84-480a-98a2-c46187ebed4e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:26:40.181560 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 756/1497] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:26:40 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:26:40.185881 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804b186-1215-4c80-bf11-e00a6b21e59f admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:26:40.187389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5804b186-1215-4c80-bf11-e00a6b21e59f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:26:40.221500 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804b186-1215-4c80-bf11-e00a6b21e59f admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:26:40.313380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f62402-702c-4030-a02a-a6568e1bc654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:26:40.313983 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f62402-702c-4030-a02a-a6568e1bc654 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:26:40.314266 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f62402-702c-4030-a02a-a6568e1bc654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:26:40.314541 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f62402-702c-4030-a02a-a6568e1bc654 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:26:40.315160 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f62402-702c-4030-a02a-a6568e1bc654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:26:40.316174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: WARNING py.warnings [None req-11f62402-702c-4030-a02a-a6568e1bc654 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 02:26:40.316174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: warnings.warn(msg) Aug 09 02:26:40.316174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: Aug 09 02:26:40.317918 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f62402-702c-4030-a02a-a6568e1bc654 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:26:40.361651 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 742/1498] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:26:40 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:26:40.365721 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f45ef3-7d84-480a-98a2-c46187ebed4e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:26:40.367522 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-42f45ef3-7d84-480a-98a2-c46187ebed4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:26:40.427803 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f45ef3-7d84-480a-98a2-c46187ebed4e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:26:40.508564 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:26:40.519264 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89df5c-0340-4f9a-9e93-7d8c61b78417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:26:40.519860 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89df5c-0340-4f9a-9e93-7d8c61b78417 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:26:40.520137 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89df5c-0340-4f9a-9e93-7d8c61b78417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:26:40.520403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89df5c-0340-4f9a-9e93-7d8c61b78417 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:26:40.521678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89df5c-0340-4f9a-9e93-7d8c61b78417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:26:40.522689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: WARNING py.warnings [None req-7f89df5c-0340-4f9a-9e93-7d8c61b78417 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 02:26:40.522689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: warnings.warn(msg) Aug 09 02:26:40.522689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: Aug 09 02:26:40.523573 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89df5c-0340-4f9a-9e93-7d8c61b78417 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:26:40.535656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 757/1499] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:26:40.539667 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f62402-702c-4030-a02a-a6568e1bc654 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:26:40.541237 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-11f62402-702c-4030-a02a-a6568e1bc654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:26:40.553417 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f62402-702c-4030-a02a-a6568e1bc654 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:26:40.578439 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:26:40.648501 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b70b09-19aa-414f-aace-61cf07f6d3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:26:40.649075 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b70b09-19aa-414f-aace-61cf07f6d3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:26:40.649352 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b70b09-19aa-414f-aace-61cf07f6d3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:26:40.649618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b70b09-19aa-414f-aace-61cf07f6d3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:26:40.650248 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b70b09-19aa-414f-aace-61cf07f6d3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:26:40.651277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: WARNING py.warnings [None req-b0b70b09-19aa-414f-aace-61cf07f6d3f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 02:26:40.651277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: warnings.warn(msg) Aug 09 02:26:40.651277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: Aug 09 02:26:40.652143 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b70b09-19aa-414f-aace-61cf07f6d3f6 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:26:40.664494 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 743/1500] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:26:40.668608 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89df5c-0340-4f9a-9e93-7d8c61b78417 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:26:40.670144 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7f89df5c-0340-4f9a-9e93-7d8c61b78417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:26:40.703253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89df5c-0340-4f9a-9e93-7d8c61b78417 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:26:40.795693 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a81808-cf97-45ec-8934-917d7f1a57d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:26:40.796343 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a81808-cf97-45ec-8934-917d7f1a57d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:26:40.796621 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a81808-cf97-45ec-8934-917d7f1a57d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:26:40.796893 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a81808-cf97-45ec-8934-917d7f1a57d1 admin admin] PATH_INFO: `/v3/projects/c5de0b37bdf14e4690f9d87aba07a1c8/users/2742f462f304433297df4dacdd8c1e94/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:26:40.819706 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a81808-cf97-45ec-8934-917d7f1a57d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5de0b37bdf14e4690f9d87aba07a1c8, user_id=2742f462f304433297df4dacdd8c1e94, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:26:40.820729 dv-cinder-852461-1-smb devstack@keystone.service[80285]: WARNING py.warnings [None req-69a81808-cf97-45ec-8934-917d7f1a57d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 02:26:40.820729 dv-cinder-852461-1-smb devstack@keystone.service[80285]: warnings.warn(msg) Aug 09 02:26:40.820729 dv-cinder-852461-1-smb devstack@keystone.service[80285]: Aug 09 02:26:40.822706 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a81808-cf97-45ec-8934-917d7f1a57d1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:26:40.846934 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 758/1501] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:26:40 2022] PUT /identity/v3/projects/c5de0b37bdf14e4690f9d87aba07a1c8/users/2742f462f304433297df4dacdd8c1e94/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:26:40.859127 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037c43d-d13d-4ce2-84a1-59eb44f58b28 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:26:40.859405 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037c43d-d13d-4ce2-84a1-59eb44f58b28 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:26:40.859682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037c43d-d13d-4ce2-84a1-59eb44f58b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:26:40.917180 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a037c43d-d13d-4ce2-84a1-59eb44f58b28 None None] MFA Rules not processed for user `2742f462f304433297df4dacdd8c1e94`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:26:40.918329 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a037c43d-d13d-4ce2-84a1-59eb44f58b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:26:40.997940 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 744/1502] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:26:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:26:41.011148 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b60c7c-e662-402b-bb9e-431cdde2d5b8 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:26:41.011430 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b60c7c-e662-402b-bb9e-431cdde2d5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:26:41.011699 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b60c7c-e662-402b-bb9e-431cdde2d5b8 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:26:41.013045 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 759/1503] 10.222.0.16 () {54 vars in 964 bytes} [Tue Aug 9 02:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:26:41.017652 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec88061-fbe5-4f24-91e4-1d261d5223a6 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:26:41.017947 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec88061-fbe5-4f24-91e4-1d261d5223a6 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:26:41.018225 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec88061-fbe5-4f24-91e4-1d261d5223a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:26:41.050288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:26:41.094957 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-2ec88061-fbe5-4f24-91e4-1d261d5223a6 None None] MFA Rules not processed for user `9500a1b1de2344f78580bed52cc302a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:26:41.096157 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2ec88061-fbe5-4f24-91e4-1d261d5223a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:26:41.171489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 745/1504] 10.222.0.16 () {58 vars in 1061 bytes} [Tue Aug 9 02:26:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:26:41.179730 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b60c7c-e662-402b-bb9e-431cdde2d5b8 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:26:41.181287 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-13b60c7c-e662-402b-bb9e-431cdde2d5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:26:41.230298 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:26:41.287788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b60c7c-e662-402b-bb9e-431cdde2d5b8 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:26:41.360231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b32d50-352b-4446-8214-44e3ab2b420b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:26:41.360827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b32d50-352b-4446-8214-44e3ab2b420b service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:26:41.361133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b32d50-352b-4446-8214-44e3ab2b420b service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:26:41.361402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b32d50-352b-4446-8214-44e3ab2b420b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:26:41.362979 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-50b32d50-352b-4446-8214-44e3ab2b420b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:26:41.457706 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b32d50-352b-4446-8214-44e3ab2b420b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:26:41.459585 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b32d50-352b-4446-8214-44e3ab2b420b service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:26:41.463062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:26:41.478711 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 760/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:26:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:26:41.522920 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e637c4-a58b-4794-9aab-75a6a7a2e94d None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:26:41.523207 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e637c4-a58b-4794-9aab-75a6a7a2e94d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:26:41.523483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e637c4-a58b-4794-9aab-75a6a7a2e94d None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:26:41.524752 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 746/1506] 10.222.0.16 () {52 vars in 830 bytes} [Tue Aug 9 02:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:26:41.528408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b32d50-352b-4446-8214-44e3ab2b420b service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:26:41.529647 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-50b32d50-352b-4446-8214-44e3ab2b420b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:26:41.627761 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b32d50-352b-4446-8214-44e3ab2b420b service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:26:41.720512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b3977-5155-4a37-a8fc-c3e13deb0ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:26:41.721098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b3977-5155-4a37-a8fc-c3e13deb0ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:26:41.721381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b3977-5155-4a37-a8fc-c3e13deb0ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:26:41.721652 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b3977-5155-4a37-a8fc-c3e13deb0ee8 admin admin] PATH_INFO: `/v3/users/2742f462f304433297df4dacdd8c1e94` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:26:41.733870 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b3977-5155-4a37-a8fc-c3e13deb0ee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2742f462f304433297df4dacdd8c1e94)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:26:41.734894 dv-cinder-852461-1-smb devstack@keystone.service[80285]: WARNING py.warnings [None req-918b3977-5155-4a37-a8fc-c3e13deb0ee8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 02:26:41.734894 dv-cinder-852461-1-smb devstack@keystone.service[80285]: warnings.warn(msg) Aug 09 02:26:41.734894 dv-cinder-852461-1-smb devstack@keystone.service[80285]: Aug 09 02:26:41.736096 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b3977-5155-4a37-a8fc-c3e13deb0ee8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:26:41.745994 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:26:41.801704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-918b3977-5155-4a37-a8fc-c3e13deb0ee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2742f462f304433297df4dacdd8c1e94'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:26:41.811138 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-918b3977-5155-4a37-a8fc-c3e13deb0ee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2742f462f304433297df4dacdd8c1e94'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:26:41.811567 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-918b3977-5155-4a37-a8fc-c3e13deb0ee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2742f462f304433297df4dacdd8c1e94'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:26:41.834232 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-918b3977-5155-4a37-a8fc-c3e13deb0ee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2742f462f304433297df4dacdd8c1e94'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:26:41.847610 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-918b3977-5155-4a37-a8fc-c3e13deb0ee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2742f462f304433297df4dacdd8c1e94'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:26:41.853157 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 761/1507] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:26:41 2022] DELETE /identity/v3/users/2742f462f304433297df4dacdd8c1e94 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:26:41.857656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9f170-957b-4bdc-a543-210eddd2161f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:26:41.858104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9f170-957b-4bdc-a543-210eddd2161f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:26:41.858212 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9f170-957b-4bdc-a543-210eddd2161f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:26:41.914766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-aad9f170-957b-4bdc-a543-210eddd2161f None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:26:41.916207 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-aad9f170-957b-4bdc-a543-210eddd2161f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:26:41.995614 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:26:42.008638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 747/1508] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:26:42.018264 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b3977-5155-4a37-a8fc-c3e13deb0ee8 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:26:42.019472 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-918b3977-5155-4a37-a8fc-c3e13deb0ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:26:42.124270 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b3977-5155-4a37-a8fc-c3e13deb0ee8 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:26:42.178277 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:26:42.199972 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358da44-e20e-4010-a389-99d7e5b942e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:26:42.200579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358da44-e20e-4010-a389-99d7e5b942e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:26:42.200860 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358da44-e20e-4010-a389-99d7e5b942e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:26:42.201170 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358da44-e20e-4010-a389-99d7e5b942e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:26:42.202774 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2358da44-e20e-4010-a389-99d7e5b942e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:26:42.309367 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358da44-e20e-4010-a389-99d7e5b942e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:26:42.311319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358da44-e20e-4010-a389-99d7e5b942e4 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:26:42.333816 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 762/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:26:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:26:42.750137 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9f170-957b-4bdc-a543-210eddd2161f None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:26:42.751451 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-aad9f170-957b-4bdc-a543-210eddd2161f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:26:42.763134 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9f170-957b-4bdc-a543-210eddd2161f None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:26:42.860436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de1ca5-af98-4630-b463-e7c26b2631a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:26:42.861088 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de1ca5-af98-4630-b463-e7c26b2631a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:26:42.861285 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de1ca5-af98-4630-b463-e7c26b2631a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:26:42.861550 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de1ca5-af98-4630-b463-e7c26b2631a8 admin admin] PATH_INFO: `/v3/projects/c5de0b37bdf14e4690f9d87aba07a1c8` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:26:42.871425 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de1ca5-af98-4630-b463-e7c26b2631a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5de0b37bdf14e4690f9d87aba07a1c8)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:26:42.872450 dv-cinder-852461-1-smb devstack@keystone.service[80286]: WARNING py.warnings [None req-11de1ca5-af98-4630-b463-e7c26b2631a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 02:26:42.872450 dv-cinder-852461-1-smb devstack@keystone.service[80286]: warnings.warn(msg) Aug 09 02:26:42.872450 dv-cinder-852461-1-smb devstack@keystone.service[80286]: Aug 09 02:26:42.873732 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de1ca5-af98-4630-b463-e7c26b2631a8 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:26:42.929830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-11de1ca5-af98-4630-b463-e7c26b2631a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5de0b37bdf14e4690f9d87aba07a1c8', 'request_id': 'req-11de1ca5-af98-4630-b463-e7c26b2631a8'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:26:42.935970 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-11de1ca5-af98-4630-b463-e7c26b2631a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5de0b37bdf14e4690f9d87aba07a1c8', 'request_id': 'req-11de1ca5-af98-4630-b463-e7c26b2631a8'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:26:42.951315 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-11de1ca5-af98-4630-b463-e7c26b2631a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5de0b37bdf14e4690f9d87aba07a1c8', 'request_id': 'req-11de1ca5-af98-4630-b463-e7c26b2631a8'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:26:42.978160 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-11de1ca5-af98-4630-b463-e7c26b2631a8 admin admin] The token cache is being invalidate because project c5de0b37bdf14e4690f9d87aba07a1c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:26:42.978453 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-11de1ca5-af98-4630-b463-e7c26b2631a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:26:42.979463 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-11de1ca5-af98-4630-b463-e7c26b2631a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:26:42.980286 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 748/1510] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:26:42 2022] DELETE /identity/v3/projects/c5de0b37bdf14e4690f9d87aba07a1c8 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:26:52.331482 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=62 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:26:52.976267 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:28:15.447602 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989b7c3-ed64-4d29-9495-f71226ceabc9 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:15.448242 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989b7c3-ed64-4d29-9495-f71226ceabc9 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:15.448242 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989b7c3-ed64-4d29-9495-f71226ceabc9 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:15.449566 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 763/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 02:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:28:15.454221 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb32afd-77cf-4938-8dc6-93b62dc16489 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:15.454629 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb32afd-77cf-4938-8dc6-93b62dc16489 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:15.454763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb32afd-77cf-4938-8dc6-93b62dc16489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:15.533874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-5cb32afd-77cf-4938-8dc6-93b62dc16489 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:28:15.535075 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5cb32afd-77cf-4938-8dc6-93b62dc16489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:28:15.635259 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 749/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 02:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:28:15.790259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989b7c3-ed64-4d29-9495-f71226ceabc9 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:28:15.792371 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0989b7c3-ed64-4d29-9495-f71226ceabc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:28:15.908333 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989b7c3-ed64-4d29-9495-f71226ceabc9 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:28:15.913739 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ac0a6-e1c1-4d75-8c55-67775a914cf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:28:15.914334 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ac0a6-e1c1-4d75-8c55-67775a914cf9 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:15.914611 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ac0a6-e1c1-4d75-8c55-67775a914cf9 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:15.914877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ac0a6-e1c1-4d75-8c55-67775a914cf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:15.922688 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ac0a6-e1c1-4d75-8c55-67775a914cf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:28:15.924766 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ac0a6-e1c1-4d75-8c55-67775a914cf9 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:28:15.933939 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 764/1513] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:28:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:28:16.749184 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622e1d4-e087-42ea-8394-c4ccbe9200e5 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:16.749751 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622e1d4-e087-42ea-8394-c4ccbe9200e5 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:16.749751 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622e1d4-e087-42ea-8394-c4ccbe9200e5 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:16.751103 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 750/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 02:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:28:16.759471 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868ec11-df36-4df6-9635-1d562282feda None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:16.759936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868ec11-df36-4df6-9635-1d562282feda None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:16.760043 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868ec11-df36-4df6-9635-1d562282feda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:16.779881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7868ec11-df36-4df6-9635-1d562282feda None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:28:16.781100 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7868ec11-df36-4df6-9635-1d562282feda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:28:16.789435 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 765/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 02:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:28:16.940716 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622e1d4-e087-42ea-8394-c4ccbe9200e5 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:28:16.955564 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622e1d4-e087-42ea-8394-c4ccbe9200e5 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:28:16.961326 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed638a-21e5-40d2-b027-bb4f1b80d3db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:28:16.961927 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed638a-21e5-40d2-b027-bb4f1b80d3db service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:16.962206 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed638a-21e5-40d2-b027-bb4f1b80d3db service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:16.962478 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed638a-21e5-40d2-b027-bb4f1b80d3db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:16.970664 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed638a-21e5-40d2-b027-bb4f1b80d3db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:28:16.972253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed638a-21e5-40d2-b027-bb4f1b80d3db service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:28:16.982039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 751/1516] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:28:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:28:17.315724 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de8c92-22de-49f9-bc74-da8f14bfb42f None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:17.316009 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de8c92-22de-49f9-bc74-da8f14bfb42f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:17.316285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de8c92-22de-49f9-bc74-da8f14bfb42f None None] PATH_INFO: `/v3` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:17.317599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 766/1517] 10.222.0.17 () {54 vars in 925 bytes} [Tue Aug 9 02:28:17 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:28:17.326944 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b9b8d-2de9-4ed0-a509-0e2e517969bd None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:17.327235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b9b8d-2de9-4ed0-a509-0e2e517969bd None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:17.327511 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b9b8d-2de9-4ed0-a509-0e2e517969bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:17.386878 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-300b9b8d-2de9-4ed0-a509-0e2e517969bd None None] MFA Rules not processed for user `5fe21d9a65a34abeae7329df924d7998`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:28:17.388108 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-300b9b8d-2de9-4ed0-a509-0e2e517969bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:28:17.404653 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:28:17.460953 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 752/1518] 10.222.0.17 () {58 vars in 1015 bytes} [Tue Aug 9 02:28:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:28:26.263196 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e1e9a-5530-4fb8-9576-c4974f064815 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:26.263756 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e1e9a-5530-4fb8-9576-c4974f064815 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:26.263756 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e1e9a-5530-4fb8-9576-c4974f064815 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:26.264970 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 767/1519] 10.222.0.16 () {54 vars in 961 bytes} [Tue Aug 9 02:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:28:26.270491 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2651009-be8a-47a4-9ddc-d510a9302a74 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:26.270906 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2651009-be8a-47a4-9ddc-d510a9302a74 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:26.271041 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2651009-be8a-47a4-9ddc-d510a9302a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:26.290713 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a2651009-be8a-47a4-9ddc-d510a9302a74 None None] MFA Rules not processed for user `5fe21d9a65a34abeae7329df924d7998`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:28:26.291914 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a2651009-be8a-47a4-9ddc-d510a9302a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:28:26.300458 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 753/1520] 10.222.0.16 () {58 vars in 1058 bytes} [Tue Aug 9 02:28:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:28:26.308028 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e1e9a-5530-4fb8-9576-c4974f064815 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:28:26.321180 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e1e9a-5530-4fb8-9576-c4974f064815 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:28:26.326111 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17cf26-f525-441f-a1b5-52f5aa519be8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fe21d9a65a34abeae7329df924d7998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:28:26.326697 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17cf26-f525-441f-a1b5-52f5aa519be8 service placement] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:26.326977 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17cf26-f525-441f-a1b5-52f5aa519be8 service placement] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:26.327252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17cf26-f525-441f-a1b5-52f5aa519be8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:26.335848 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17cf26-f525-441f-a1b5-52f5aa519be8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:28:26.337469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17cf26-f525-441f-a1b5-52f5aa519be8 service placement] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:28:26.347487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 768/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:28:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:28:28.189303 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dc509-5c6d-4444-836b-fd52749c1043 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:28.189859 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dc509-5c6d-4444-836b-fd52749c1043 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:28.189859 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dc509-5c6d-4444-836b-fd52749c1043 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:28.191189 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 754/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 02:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:28:28.195851 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb481043-517a-4bcb-b874-06f4f94cb898 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:28.196245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb481043-517a-4bcb-b874-06f4f94cb898 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:28.196402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb481043-517a-4bcb-b874-06f4f94cb898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:28.215704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-fb481043-517a-4bcb-b874-06f4f94cb898 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:28:28.216895 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fb481043-517a-4bcb-b874-06f4f94cb898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:28:28.224553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 769/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 02:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:28:28.377478 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7dc509-5c6d-4444-836b-fd52749c1043 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:28:28.392300 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7dc509-5c6d-4444-836b-fd52749c1043 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:28:28.397692 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19079235-132c-48ef-a1c8-6900b6255c67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:28:28.398277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19079235-132c-48ef-a1c8-6900b6255c67 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:28.398552 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19079235-132c-48ef-a1c8-6900b6255c67 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:28.398820 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19079235-132c-48ef-a1c8-6900b6255c67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:28.406674 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19079235-132c-48ef-a1c8-6900b6255c67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:28:28.408246 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19079235-132c-48ef-a1c8-6900b6255c67 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:28:28.417449 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 755/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:28:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:28:29.247522 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7012a-05ca-4c0b-9fde-098628de02d7 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:29.248055 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7012a-05ca-4c0b-9fde-098628de02d7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:29.248055 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7012a-05ca-4c0b-9fde-098628de02d7 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:29.249370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 770/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 02:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:28:29.254320 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf986176-f5a8-438a-aa35-30aa8fdc9bd3 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:29.254722 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf986176-f5a8-438a-aa35-30aa8fdc9bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:29.254862 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf986176-f5a8-438a-aa35-30aa8fdc9bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:29.274286 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-bf986176-f5a8-438a-aa35-30aa8fdc9bd3 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:28:29.275497 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-bf986176-f5a8-438a-aa35-30aa8fdc9bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:28:29.283976 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 756/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 02:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:28:29.439260 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7012a-05ca-4c0b-9fde-098628de02d7 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:28:29.456360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7012a-05ca-4c0b-9fde-098628de02d7 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:28:29.461796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad93171-e55b-457a-a6b8-bb7fc1540dfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:28:29.462383 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad93171-e55b-457a-a6b8-bb7fc1540dfb service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:29.462658 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad93171-e55b-457a-a6b8-bb7fc1540dfb service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:29.462925 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad93171-e55b-457a-a6b8-bb7fc1540dfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:29.471670 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad93171-e55b-457a-a6b8-bb7fc1540dfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:28:29.473271 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad93171-e55b-457a-a6b8-bb7fc1540dfb service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:28:29.482344 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 771/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:28:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:28:33.255312 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49626b81-c43e-44eb-bfcc-9162ac83439d None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:33.255823 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49626b81-c43e-44eb-bfcc-9162ac83439d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:33.255823 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49626b81-c43e-44eb-bfcc-9162ac83439d None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:33.257207 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 757/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 02:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:28:33.262302 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cd6f5-e680-4c91-8aa7-6a0bb9a3c0cd None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:33.262777 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cd6f5-e680-4c91-8aa7-6a0bb9a3c0cd None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:33.262882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043cd6f5-e680-4c91-8aa7-6a0bb9a3c0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:33.281738 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-043cd6f5-e680-4c91-8aa7-6a0bb9a3c0cd None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:28:33.282949 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-043cd6f5-e680-4c91-8aa7-6a0bb9a3c0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:28:33.290794 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 772/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 02:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:28:33.363053 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49626b81-c43e-44eb-bfcc-9162ac83439d None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:28:33.365108 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-49626b81-c43e-44eb-bfcc-9162ac83439d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:28:33.454634 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49626b81-c43e-44eb-bfcc-9162ac83439d None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:28:33.458368 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41f841-aa7a-4177-a146-dcc55cb28302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:28:33.458992 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41f841-aa7a-4177-a146-dcc55cb28302 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:33.459276 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41f841-aa7a-4177-a146-dcc55cb28302 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:33.459553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41f841-aa7a-4177-a146-dcc55cb28302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:33.470582 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41f841-aa7a-4177-a146-dcc55cb28302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:28:33.472064 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41f841-aa7a-4177-a146-dcc55cb28302 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:28:33.482748 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 758/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:28:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:28:35.466191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba35976-f2ac-4d75-8847-edf8ea3d2877 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:35.466758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba35976-f2ac-4d75-8847-edf8ea3d2877 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:35.466758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba35976-f2ac-4d75-8847-edf8ea3d2877 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:35.468084 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 773/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 02:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:28:35.473233 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ace4a-ca9d-42d4-b1eb-1c4598d11d92 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:35.473616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ace4a-ca9d-42d4-b1eb-1c4598d11d92 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:35.473794 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ace4a-ca9d-42d4-b1eb-1c4598d11d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:35.493589 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-775ace4a-ca9d-42d4-b1eb-1c4598d11d92 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:28:35.494795 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-775ace4a-ca9d-42d4-b1eb-1c4598d11d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:28:35.503011 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 759/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 02:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:28:35.537689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba35976-f2ac-4d75-8847-edf8ea3d2877 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:28:35.549656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba35976-f2ac-4d75-8847-edf8ea3d2877 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:28:35.553168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe1b5f-db94-4f98-a58a-aab0d074e3d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:28:35.553753 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe1b5f-db94-4f98-a58a-aab0d074e3d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:35.554029 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe1b5f-db94-4f98-a58a-aab0d074e3d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:35.554297 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe1b5f-db94-4f98-a58a-aab0d074e3d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:35.563978 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe1b5f-db94-4f98-a58a-aab0d074e3d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:28:35.565443 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe1b5f-db94-4f98-a58a-aab0d074e3d2 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:28:35.574571 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 774/1533] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:28:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:28:38.979847 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8f5c3-b90f-4513-b4d9-8cb619a043de None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:38.980236 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8f5c3-b90f-4513-b4d9-8cb619a043de None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:38.980405 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8f5c3-b90f-4513-b4d9-8cb619a043de None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:38.981822 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 760/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 02:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:28:38.987416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bdbe5-9f89-4837-8b60-90887cf2cd8e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:38.987855 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bdbe5-9f89-4837-8b60-90887cf2cd8e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:38.987960 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bdbe5-9f89-4837-8b60-90887cf2cd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:39.007753 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-421bdbe5-9f89-4837-8b60-90887cf2cd8e None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:28:39.008954 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-421bdbe5-9f89-4837-8b60-90887cf2cd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:28:39.017364 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 775/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 02:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:28:39.318138 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8f5c3-b90f-4513-b4d9-8cb619a043de None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:28:39.319792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a4e8f5c3-b90f-4513-b4d9-8cb619a043de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:28:39.383676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:28:39.397937 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8f5c3-b90f-4513-b4d9-8cb619a043de None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:28:39.401469 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f90c3e-468f-4a3a-9a27-c0e384f3372c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:28:39.402063 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f90c3e-468f-4a3a-9a27-c0e384f3372c service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:39.402341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f90c3e-468f-4a3a-9a27-c0e384f3372c service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:39.402615 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f90c3e-468f-4a3a-9a27-c0e384f3372c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:39.411768 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f90c3e-468f-4a3a-9a27-c0e384f3372c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:28:39.413215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f90c3e-468f-4a3a-9a27-c0e384f3372c service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:28:39.422832 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 761/1536] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:28:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:28:41.421275 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37aee88-02a9-46b4-8ffc-59bd13e3b13c None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:41.421834 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37aee88-02a9-46b4-8ffc-59bd13e3b13c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:41.421959 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37aee88-02a9-46b4-8ffc-59bd13e3b13c None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:41.423257 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 776/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 02:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:28:41.428664 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fd086-f302-4e79-940a-e23c6b021478 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:41.429079 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fd086-f302-4e79-940a-e23c6b021478 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:41.429285 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fd086-f302-4e79-940a-e23c6b021478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:41.448228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-ba1fd086-f302-4e79-940a-e23c6b021478 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:28:41.449462 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ba1fd086-f302-4e79-940a-e23c6b021478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:28:41.457759 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 762/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 02:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:28:41.757979 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37aee88-02a9-46b4-8ffc-59bd13e3b13c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:28:41.759689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b37aee88-02a9-46b4-8ffc-59bd13e3b13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:28:41.773370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37aee88-02a9-46b4-8ffc-59bd13e3b13c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:28:41.776872 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd72ae0-f7a1-49b9-b67b-cef2b36195ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:28:41.777485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd72ae0-f7a1-49b9-b67b-cef2b36195ef service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:28:41.777771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd72ae0-f7a1-49b9-b67b-cef2b36195ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:28:41.778248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd72ae0-f7a1-49b9-b67b-cef2b36195ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:28:41.787279 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd72ae0-f7a1-49b9-b67b-cef2b36195ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:28:41.788714 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd72ae0-f7a1-49b9-b67b-cef2b36195ef service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:28:41.798096 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 777/1539] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:28:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:28:51.443533 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=11 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:28:51.793937 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:05.015840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd4b5d-1a68-418d-b01f-ec316aee4b77 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.016929 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd4b5d-1a68-418d-b01f-ec316aee4b77 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.017464 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd4b5d-1a68-418d-b01f-ec316aee4b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.040465 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c029119-c614-4d41-a1fe-4a3d6d390692 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.041445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c029119-c614-4d41-a1fe-4a3d6d390692 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.041897 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c029119-c614-4d41-a1fe-4a3d6d390692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.045570 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-05dd4b5d-1a68-418d-b01f-ec316aee4b77 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:05.053041 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-05dd4b5d-1a68-418d-b01f-ec316aee4b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:05.056266 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 763/1540] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:30:05.065654 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1ff03-4f48-487e-93f5-80eed5216365 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.065974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1ff03-4f48-487e-93f5-80eed5216365 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.066357 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1ff03-4f48-487e-93f5-80eed5216365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.082040 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-3c029119-c614-4d41-a1fe-4a3d6d390692 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:05.083905 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3c029119-c614-4d41-a1fe-4a3d6d390692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:05.087841 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-dbe1ff03-4f48-487e-93f5-80eed5216365 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:05.090046 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-dbe1ff03-4f48-487e-93f5-80eed5216365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:05.099230 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 764/1541] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:05.104256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1ff03-4f48-487e-93f5-80eed5216365 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:05.106435 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 778/1542] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:05.115248 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1ff03-4f48-487e-93f5-80eed5216365 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:05.115705 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c5c1d-05c7-441c-83e3-9f1c956af1a3 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.116225 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c5c1d-05c7-441c-83e3-9f1c956af1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.116743 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c5c1d-05c7-441c-83e3-9f1c956af1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.127932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aacfa1-5ea2-4183-a91e-b49d4520f963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:05.128550 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aacfa1-5ea2-4183-a91e-b49d4520f963 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.128830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aacfa1-5ea2-4183-a91e-b49d4520f963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.129130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aacfa1-5ea2-4183-a91e-b49d4520f963 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.129783 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aacfa1-5ea2-4183-a91e-b49d4520f963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:30:05.130087 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aacfa1-5ea2-4183-a91e-b49d4520f963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:05.131977 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aacfa1-5ea2-4183-a91e-b49d4520f963 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:05.150258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-4e9c5c1d-05c7-441c-83e3-9f1c956af1a3 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:05.152410 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4e9c5c1d-05c7-441c-83e3-9f1c956af1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:05.156354 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 765/1543] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:30:05.159946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aacfa1-5ea2-4183-a91e-b49d4520f963 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:05.170970 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 779/1544] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:05.175957 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c5c1d-05c7-441c-83e3-9f1c956af1a3 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:05.177400 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aacfa1-5ea2-4183-a91e-b49d4520f963 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:05.182974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0ebb7-5505-4c84-a85e-382a432e7359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:05.183162 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0ebb7-5505-4c84-a85e-382a432e7359 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.183400 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0ebb7-5505-4c84-a85e-382a432e7359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.183643 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0ebb7-5505-4c84-a85e-382a432e7359 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.184253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0ebb7-5505-4c84-a85e-382a432e7359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:05.185390 dv-cinder-852461-1-smb devstack@keystone.service[80286]: WARNING py.warnings [None req-abb0ebb7-5505-4c84-a85e-382a432e7359 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 02:30:05.185390 dv-cinder-852461-1-smb devstack@keystone.service[80286]: warnings.warn(msg) Aug 09 02:30:05.185390 dv-cinder-852461-1-smb devstack@keystone.service[80286]: Aug 09 02:30:05.187079 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0ebb7-5505-4c84-a85e-382a432e7359 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:05.188445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c5c1d-05c7-441c-83e3-9f1c956af1a3 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:05.201962 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b327ff8-1620-4c2b-a517-31997aaafc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:05.202904 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b327ff8-1620-4c2b-a517-31997aaafc22 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.203443 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b327ff8-1620-4c2b-a517-31997aaafc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.203967 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b327ff8-1620-4c2b-a517-31997aaafc22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.204857 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b327ff8-1620-4c2b-a517-31997aaafc22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:30:05.205429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b327ff8-1620-4c2b-a517-31997aaafc22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:05.206693 dv-cinder-852461-1-smb devstack@keystone.service[80285]: WARNING py.warnings [None req-3b327ff8-1620-4c2b-a517-31997aaafc22 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 02:30:05.206693 dv-cinder-852461-1-smb devstack@keystone.service[80285]: warnings.warn(msg) Aug 09 02:30:05.206693 dv-cinder-852461-1-smb devstack@keystone.service[80285]: Aug 09 02:30:05.208029 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b327ff8-1620-4c2b-a517-31997aaafc22 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:05.222185 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 780/1545] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:30:05.223826 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8c5e7-81be-4e75-bbc3-a401c6bf7445 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.224347 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8c5e7-81be-4e75-bbc3-a401c6bf7445 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.224852 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8c5e7-81be-4e75-bbc3-a401c6bf7445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.268725 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a3e8c5e7-81be-4e75-bbc3-a401c6bf7445 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:05.270307 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 766/1546] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:05 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:30:05.270634 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a3e8c5e7-81be-4e75-bbc3-a401c6bf7445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:05.271147 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0ebb7-5505-4c84-a85e-382a432e7359 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:05.345872 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 781/1547] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:05.346937 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8c5e7-81be-4e75-bbc3-a401c6bf7445 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:05.348628 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0ebb7-5505-4c84-a85e-382a432e7359 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:05.353941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a8586-27d5-4162-b718-f021007a0670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:05.354643 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a8586-27d5-4162-b718-f021007a0670 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.354926 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a8586-27d5-4162-b718-f021007a0670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.355198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a8586-27d5-4162-b718-f021007a0670 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.355817 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a8586-27d5-4162-b718-f021007a0670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:05.356671 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8c5e7-81be-4e75-bbc3-a401c6bf7445 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:05.357750 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a8586-27d5-4162-b718-f021007a0670 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:05.361516 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370fad9-68c3-49d5-b2c0-54b91ac872b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:05.362103 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370fad9-68c3-49d5-b2c0-54b91ac872b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.362561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370fad9-68c3-49d5-b2c0-54b91ac872b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.362691 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370fad9-68c3-49d5-b2c0-54b91ac872b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.363547 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370fad9-68c3-49d5-b2c0-54b91ac872b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:05.364306 dv-cinder-852461-1-smb devstack@keystone.service[80285]: WARNING py.warnings [None req-c370fad9-68c3-49d5-b2c0-54b91ac872b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 02:30:05.364306 dv-cinder-852461-1-smb devstack@keystone.service[80285]: warnings.warn(msg) Aug 09 02:30:05.364306 dv-cinder-852461-1-smb devstack@keystone.service[80285]: Aug 09 02:30:05.365522 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370fad9-68c3-49d5-b2c0-54b91ac872b2 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:05.385588 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 767/1548] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:05 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:05.387991 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd0c53-ac21-40bd-a20a-e004c2860472 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.388288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd0c53-ac21-40bd-a20a-e004c2860472 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.388562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd0c53-ac21-40bd-a20a-e004c2860472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.389203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 782/1549] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:05 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:05.390571 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806862f7-c415-4c0c-81ab-f361fae47107 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.390857 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806862f7-c415-4c0c-81ab-f361fae47107 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.391127 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806862f7-c415-4c0c-81ab-f361fae47107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.410671 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-806862f7-c415-4c0c-81ab-f361fae47107 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:05.410887 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-eacd0c53-ac21-40bd-a20a-e004c2860472 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:05.411875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-806862f7-c415-4c0c-81ab-f361fae47107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:05.411996 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-eacd0c53-ac21-40bd-a20a-e004c2860472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:05.470366 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 768/1550] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:05.471604 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ab1be-934e-4d42-9a79-d27f5940cb73 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.471889 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ab1be-934e-4d42-9a79-d27f5940cb73 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.472161 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ab1be-934e-4d42-9a79-d27f5940cb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.476790 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 783/1551] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:05.478222 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed91975-d3d2-4f4b-b663-631b3dcb63c0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.478518 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed91975-d3d2-4f4b-b663-631b3dcb63c0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.478794 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed91975-d3d2-4f4b-b663-631b3dcb63c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.496810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-2d8ab1be-934e-4d42-9a79-d27f5940cb73 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:05.498063 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2d8ab1be-934e-4d42-9a79-d27f5940cb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:05.498618 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-bed91975-d3d2-4f4b-b663-631b3dcb63c0 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:05.499801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bed91975-d3d2-4f4b-b663-631b3dcb63c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:05.513271 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 769/1552] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:05.513271 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9c842-ed8a-4d55-85b9-55bf074dd6d7 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.513271 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9c842-ed8a-4d55-85b9-55bf074dd6d7 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.513271 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9c842-ed8a-4d55-85b9-55bf074dd6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.513759 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 784/1553] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:05.513759 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae477d-fd0b-42cc-afa1-fa2a61e2100c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.513759 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae477d-fd0b-42cc-afa1-fa2a61e2100c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.513759 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae477d-fd0b-42cc-afa1-fa2a61e2100c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.532245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-86ae477d-fd0b-42cc-afa1-fa2a61e2100c None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:05.533012 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c8c9c842-ed8a-4d55-85b9-55bf074dd6d7 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:05.533486 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-86ae477d-fd0b-42cc-afa1-fa2a61e2100c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:05.534207 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c8c9c842-ed8a-4d55-85b9-55bf074dd6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:05.541225 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 785/1554] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:05.542179 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 770/1555] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:05.543013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9c842-ed8a-4d55-85b9-55bf074dd6d7 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:05.545552 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae477d-fd0b-42cc-afa1-fa2a61e2100c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:05.552783 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9c842-ed8a-4d55-85b9-55bf074dd6d7 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:05.554697 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae477d-fd0b-42cc-afa1-fa2a61e2100c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:05.557461 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf38c4-c769-4bd0-af15-f10e71ab676e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:05.558094 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf38c4-c769-4bd0-af15-f10e71ab676e admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.558374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf38c4-c769-4bd0-af15-f10e71ab676e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.558645 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf38c4-c769-4bd0-af15-f10e71ab676e admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.559288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf38c4-c769-4bd0-af15-f10e71ab676e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:05.559405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8c22e-5d6f-481b-8858-cecd37be5abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:05.559962 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8c22e-5d6f-481b-8858-cecd37be5abe admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.560247 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8c22e-5d6f-481b-8858-cecd37be5abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.560523 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8c22e-5d6f-481b-8858-cecd37be5abe admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.560878 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf38c4-c769-4bd0-af15-f10e71ab676e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:05.561175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8c22e-5d6f-481b-8858-cecd37be5abe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:05.563094 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8c22e-5d6f-481b-8858-cecd37be5abe admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:05.570811 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 771/1556] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:05.572132 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc5460-b1a8-43ae-bdbc-71701adb8db6 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.572429 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc5460-b1a8-43ae-bdbc-71701adb8db6 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.572707 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc5460-b1a8-43ae-bdbc-71701adb8db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.582583 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:05.589704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 786/1557] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:05 2022] POST /identity/v3/users => generated 286 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:05.589704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ec480-57a7-4085-ab6c-e09a779f2b76 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.589704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ec480-57a7-4085-ab6c-e09a779f2b76 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.589704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ec480-57a7-4085-ab6c-e09a779f2b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.595083 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a6fc5460-b1a8-43ae-bdbc-71701adb8db6 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:05.596850 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a6fc5460-b1a8-43ae-bdbc-71701adb8db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:05.604957 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 772/1558] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:05.607473 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ce5ec480-57a7-4085-ab6c-e09a779f2b76 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:05.608673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ce5ec480-57a7-4085-ab6c-e09a779f2b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:05.609793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69fd5d-6583-41e1-819c-25a51ffad7a3 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.610082 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69fd5d-6583-41e1-819c-25a51ffad7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.610362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69fd5d-6583-41e1-819c-25a51ffad7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.617107 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 787/1559] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:05.617107 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031851b-37ae-4240-9d07-4e32bc7ad741 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.617107 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031851b-37ae-4240-9d07-4e32bc7ad741 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.617107 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031851b-37ae-4240-9d07-4e32bc7ad741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.630729 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-2e69fd5d-6583-41e1-819c-25a51ffad7a3 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:05.631927 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2e69fd5d-6583-41e1-819c-25a51ffad7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:05.640121 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7031851b-37ae-4240-9d07-4e32bc7ad741 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:05.640817 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 773/1560] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:05.641324 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7031851b-37ae-4240-9d07-4e32bc7ad741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:05.641696 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69fd5d-6583-41e1-819c-25a51ffad7a3 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:05.649353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 788/1561] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:05.650529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe4901-15bd-4331-9e9c-38075c43747f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.650816 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe4901-15bd-4331-9e9c-38075c43747f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.651032 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69fd5d-6583-41e1-819c-25a51ffad7a3 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:05.651149 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe4901-15bd-4331-9e9c-38075c43747f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.655874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff5cf7-1ef4-4e4d-b9d9-5f6a628d7776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:05.656468 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff5cf7-1ef4-4e4d-b9d9-5f6a628d7776 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.656746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff5cf7-1ef4-4e4d-b9d9-5f6a628d7776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.657032 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff5cf7-1ef4-4e4d-b9d9-5f6a628d7776 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.657683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff5cf7-1ef4-4e4d-b9d9-5f6a628d7776 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:30:05.657987 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff5cf7-1ef4-4e4d-b9d9-5f6a628d7776 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:05.659566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff5cf7-1ef4-4e4d-b9d9-5f6a628d7776 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:05.670324 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-4abe4901-15bd-4331-9e9c-38075c43747f None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:05.671021 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 774/1562] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:30:05.671528 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4abe4901-15bd-4331-9e9c-38075c43747f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:05.671894 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff5cf7-1ef4-4e4d-b9d9-5f6a628d7776 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:05.683858 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 789/1563] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:05.683858 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe4901-15bd-4331-9e9c-38075c43747f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:05.684977 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff5cf7-1ef4-4e4d-b9d9-5f6a628d7776 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:05.687430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84145fb1-282f-4323-926f-072c945d9310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:05.688027 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84145fb1-282f-4323-926f-072c945d9310 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.688315 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84145fb1-282f-4323-926f-072c945d9310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.688587 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84145fb1-282f-4323-926f-072c945d9310 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.689258 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84145fb1-282f-4323-926f-072c945d9310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:05.690840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84145fb1-282f-4323-926f-072c945d9310 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:05.694634 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe4901-15bd-4331-9e9c-38075c43747f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:05.699847 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13828a3-38c4-4e78-8d91-889afb16fc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:05.700445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13828a3-38c4-4e78-8d91-889afb16fc7f admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.700727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13828a3-38c4-4e78-8d91-889afb16fc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.701001 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13828a3-38c4-4e78-8d91-889afb16fc7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.701678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13828a3-38c4-4e78-8d91-889afb16fc7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:05.701961 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 775/1564] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:05.702889 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84145fb1-282f-4323-926f-072c945d9310 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:05.706413 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13828a3-38c4-4e78-8d91-889afb16fc7f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:05.707831 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:05.713261 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84145fb1-282f-4323-926f-072c945d9310 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:05.717823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 790/1565] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:05.718597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae6415-b0ce-47b0-a6db-85941b443d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:05.718750 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13828a3-38c4-4e78-8d91-889afb16fc7f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:05.719208 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae6415-b0ce-47b0-a6db-85941b443d86 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.719612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae6415-b0ce-47b0-a6db-85941b443d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.719898 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae6415-b0ce-47b0-a6db-85941b443d86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.720582 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae6415-b0ce-47b0-a6db-85941b443d86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:30:05.720878 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae6415-b0ce-47b0-a6db-85941b443d86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:05.722528 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae6415-b0ce-47b0-a6db-85941b443d86 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:05.728249 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13828a3-38c4-4e78-8d91-889afb16fc7f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:05.732875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08da10-be57-4372-a4b1-0b0d7721d18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:05.733487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08da10-be57-4372-a4b1-0b0d7721d18c admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.733771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08da10-be57-4372-a4b1-0b0d7721d18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.734047 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08da10-be57-4372-a4b1-0b0d7721d18c admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.734686 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08da10-be57-4372-a4b1-0b0d7721d18c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:30:05.735011 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08da10-be57-4372-a4b1-0b0d7721d18c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:05.735114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 776/1566] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:30:05.735919 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae6415-b0ce-47b0-a6db-85941b443d86 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:05.736852 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08da10-be57-4372-a4b1-0b0d7721d18c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:05.750241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 791/1567] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:30:05.751760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08da10-be57-4372-a4b1-0b0d7721d18c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:05.752002 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae6415-b0ce-47b0-a6db-85941b443d86 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:05.756518 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c4702-8d1c-4293-86e4-6dc65dc6f8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:05.757154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c4702-8d1c-4293-86e4-6dc65dc6f8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.757437 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c4702-8d1c-4293-86e4-6dc65dc6f8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.757710 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c4702-8d1c-4293-86e4-6dc65dc6f8d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.758361 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c4702-8d1c-4293-86e4-6dc65dc6f8d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:30:05.758690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c4702-8d1c-4293-86e4-6dc65dc6f8d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:05.760276 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c4702-8d1c-4293-86e4-6dc65dc6f8d3 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:05.762686 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08da10-be57-4372-a4b1-0b0d7721d18c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:05.767224 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb969765-b7c4-46bc-83ef-84dbbeedfc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:05.767812 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb969765-b7c4-46bc-83ef-84dbbeedfc27 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.768097 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb969765-b7c4-46bc-83ef-84dbbeedfc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.768370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb969765-b7c4-46bc-83ef-84dbbeedfc27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.769007 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb969765-b7c4-46bc-83ef-84dbbeedfc27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:30:05.769338 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb969765-b7c4-46bc-83ef-84dbbeedfc27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:05.770903 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb969765-b7c4-46bc-83ef-84dbbeedfc27 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:05.779945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 777/1568] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:30:05.779945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c4702-8d1c-4293-86e4-6dc65dc6f8d3 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:05.783722 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 792/1569] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:30:05.784530 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb969765-b7c4-46bc-83ef-84dbbeedfc27 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:05.784973 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c4702-8d1c-4293-86e4-6dc65dc6f8d3 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:05.789585 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6cd3c-0cd2-47ce-add6-6a339090d23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:05.790178 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6cd3c-0cd2-47ce-add6-6a339090d23b admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.790469 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6cd3c-0cd2-47ce-add6-6a339090d23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.790727 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6cd3c-0cd2-47ce-add6-6a339090d23b admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.791346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6cd3c-0cd2-47ce-add6-6a339090d23b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:05.793307 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6cd3c-0cd2-47ce-add6-6a339090d23b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:05.795823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb969765-b7c4-46bc-83ef-84dbbeedfc27 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:05.800684 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f49a8b-c250-4d06-ba32-5c48000d389c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:05.801299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f49a8b-c250-4d06-ba32-5c48000d389c admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.801579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f49a8b-c250-4d06-ba32-5c48000d389c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.801848 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f49a8b-c250-4d06-ba32-5c48000d389c admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.802865 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f49a8b-c250-4d06-ba32-5c48000d389c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:30:05.802865 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f49a8b-c250-4d06-ba32-5c48000d389c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:05.804350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f49a8b-c250-4d06-ba32-5c48000d389c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:05.817146 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 793/1570] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:30:05.818018 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f49a8b-c250-4d06-ba32-5c48000d389c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:05.827479 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 778/1571] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:05 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:05.827479 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6cd3c-0cd2-47ce-add6-6a339090d23b admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:05.830948 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f49a8b-c250-4d06-ba32-5c48000d389c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:05.887223 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d839bef-b46d-44d9-9f40-3a82083a11ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:05.887885 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d839bef-b46d-44d9-9f40-3a82083a11ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.888090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6cd3c-0cd2-47ce-add6-6a339090d23b admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:05.888204 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d839bef-b46d-44d9-9f40-3a82083a11ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.888427 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d839bef-b46d-44d9-9f40-3a82083a11ad admin admin] PATH_INFO: `/v3/projects/a9a1c4c1a74d4f08a6964b20832c5d5f/users/f3e3f74a4757432da1bb1e5f3a7685dd/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.892748 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cad812-693b-462f-9375-ced210b91476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:05.893384 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cad812-693b-462f-9375-ced210b91476 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.893671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cad812-693b-462f-9375-ced210b91476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.893950 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cad812-693b-462f-9375-ced210b91476 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.894596 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cad812-693b-462f-9375-ced210b91476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:05.896208 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cad812-693b-462f-9375-ced210b91476 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:05.903221 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d839bef-b46d-44d9-9f40-3a82083a11ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a1c4c1a74d4f08a6964b20832c5d5f, user_id=f3e3f74a4757432da1bb1e5f3a7685dd, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:05.905925 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d839bef-b46d-44d9-9f40-3a82083a11ad admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:05.906057 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 779/1572] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:05.906787 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cad812-693b-462f-9375-ced210b91476 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:05.918541 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cad812-693b-462f-9375-ced210b91476 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:05.918949 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 794/1573] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:05 2022] PUT /identity/v3/projects/a9a1c4c1a74d4f08a6964b20832c5d5f/users/f3e3f74a4757432da1bb1e5f3a7685dd/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:05.919719 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d839bef-b46d-44d9-9f40-3a82083a11ad admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:05.977914 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed97bb4-d978-49ce-ba15-6661b9c23be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:05.978766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed97bb4-d978-49ce-ba15-6661b9c23be8 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.979050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed97bb4-d978-49ce-ba15-6661b9c23be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.979327 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed97bb4-d978-49ce-ba15-6661b9c23be8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.980453 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed97bb4-d978-49ce-ba15-6661b9c23be8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:05.982415 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed97bb4-d978-49ce-ba15-6661b9c23be8 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:05.984177 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d839bef-b46d-44d9-9f40-3a82083a11ad admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:05.989359 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34960a44-4517-4339-b1c8-d4580117848a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:05.989963 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34960a44-4517-4339-b1c8-d4580117848a admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:05.990243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34960a44-4517-4339-b1c8-d4580117848a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:05.990518 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34960a44-4517-4339-b1c8-d4580117848a admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:05.991142 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34960a44-4517-4339-b1c8-d4580117848a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:05.993053 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34960a44-4517-4339-b1c8-d4580117848a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:06.005786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:06.013233 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 780/1574] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:05 2022] POST /identity/v3/projects => generated 369 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:06.014214 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed97bb4-d978-49ce-ba15-6661b9c23be8 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:06.021483 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 795/1575] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:05 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:06.022350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34960a44-4517-4339-b1c8-d4580117848a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:06.051372 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:06.078259 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed97bb4-d978-49ce-ba15-6661b9c23be8 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:06.088050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34960a44-4517-4339-b1c8-d4580117848a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:06.093232 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9259b75-6d8c-4177-84ce-7ce2a9989907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:06.093845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9259b75-6d8c-4177-84ce-7ce2a9989907 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:06.094537 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9259b75-6d8c-4177-84ce-7ce2a9989907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:06.094816 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9259b75-6d8c-4177-84ce-7ce2a9989907 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:06.095478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9259b75-6d8c-4177-84ce-7ce2a9989907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:06.097849 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9259b75-6d8c-4177-84ce-7ce2a9989907 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:06.125462 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 796/1576] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:06 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:06.126416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9259b75-6d8c-4177-84ce-7ce2a9989907 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:06.135185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83bec3-19ad-43ed-a9cd-c85eaac4c4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:06.135841 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83bec3-19ad-43ed-a9cd-c85eaac4c4ee admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:06.136124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83bec3-19ad-43ed-a9cd-c85eaac4c4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:06.136426 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83bec3-19ad-43ed-a9cd-c85eaac4c4ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:06.137132 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83bec3-19ad-43ed-a9cd-c85eaac4c4ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:06.139045 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b83bec3-19ad-43ed-a9cd-c85eaac4c4ee admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:06.170345 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 781/1577] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:06 2022] POST /identity/v3/projects => generated 357 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:06.170345 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83bec3-19ad-43ed-a9cd-c85eaac4c4ee admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:06.192666 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9259b75-6d8c-4177-84ce-7ce2a9989907 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:06.228962 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83bec3-19ad-43ed-a9cd-c85eaac4c4ee admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:06.234084 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d04d4-e8f1-4bc0-a76a-093d2cc9ce6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:06.234683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d04d4-e8f1-4bc0-a76a-093d2cc9ce6f admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:06.234959 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d04d4-e8f1-4bc0-a76a-093d2cc9ce6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:06.235227 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d04d4-e8f1-4bc0-a76a-093d2cc9ce6f admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:06.235835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d04d4-e8f1-4bc0-a76a-093d2cc9ce6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:06.238103 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d04d4-e8f1-4bc0-a76a-093d2cc9ce6f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:06.249015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30739a4a-5979-4df3-8300-3833bdf23e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:06.249649 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30739a4a-5979-4df3-8300-3833bdf23e16 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:06.249926 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30739a4a-5979-4df3-8300-3833bdf23e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:06.250191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30739a4a-5979-4df3-8300-3833bdf23e16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:06.250822 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30739a4a-5979-4df3-8300-3833bdf23e16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:06.252744 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30739a4a-5979-4df3-8300-3833bdf23e16 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:06.259528 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 782/1578] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:06 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:06.260311 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d04d4-e8f1-4bc0-a76a-093d2cc9ce6f admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:06.269636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d04d4-e8f1-4bc0-a76a-093d2cc9ce6f admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:06.274808 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8ef32-48ff-4823-a5de-89cf2efb9ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:06.275486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8ef32-48ff-4823-a5de-89cf2efb9ec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:06.275765 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8ef32-48ff-4823-a5de-89cf2efb9ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:06.276036 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8ef32-48ff-4823-a5de-89cf2efb9ec9 admin admin] PATH_INFO: `/v3/projects/5ee35d91f4494672b97f0b6404fcecfe/users/a41212fc006c4b26b151ae200632a0ff/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:06.285069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 797/1579] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:06 2022] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:06.285069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea9dc9-79be-4d37-8f7d-fd16e60fee34 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:06.285069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea9dc9-79be-4d37-8f7d-fd16e60fee34 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:06.285069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea9dc9-79be-4d37-8f7d-fd16e60fee34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:06.291095 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8ef32-48ff-4823-a5de-89cf2efb9ec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee35d91f4494672b97f0b6404fcecfe, user_id=a41212fc006c4b26b151ae200632a0ff, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:06.292703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: WARNING py.warnings [None req-89c8ef32-48ff-4823-a5de-89cf2efb9ec9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 02:30:06.292703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: warnings.warn(msg) Aug 09 02:30:06.292703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: Aug 09 02:30:06.294800 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8ef32-48ff-4823-a5de-89cf2efb9ec9 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:06.303805 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5fea9dc9-79be-4d37-8f7d-fd16e60fee34 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:06.304472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:06.305033 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5fea9dc9-79be-4d37-8f7d-fd16e60fee34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:06.311436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 783/1580] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:06 2022] PUT /identity/v3/projects/5ee35d91f4494672b97f0b6404fcecfe/users/a41212fc006c4b26b151ae200632a0ff/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:06.317931 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8ef32-48ff-4823-a5de-89cf2efb9ec9 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:06.352167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:06.374426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 798/1581] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:06.375224 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea9dc9-79be-4d37-8f7d-fd16e60fee34 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:06.380938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8ef32-48ff-4823-a5de-89cf2efb9ec9 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:06.384412 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea9dc9-79be-4d37-8f7d-fd16e60fee34 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:06.385869 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ab41d-f34b-4dd1-859d-6e2a127e0b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:06.386481 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ab41d-f34b-4dd1-859d-6e2a127e0b73 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:06.386765 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ab41d-f34b-4dd1-859d-6e2a127e0b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:06.387039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ab41d-f34b-4dd1-859d-6e2a127e0b73 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:06.387793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ab41d-f34b-4dd1-859d-6e2a127e0b73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:06.389151 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32831df-9c85-4659-8890-81d289826e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:06.389737 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32831df-9c85-4659-8890-81d289826e8d admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:06.389849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ab41d-f34b-4dd1-859d-6e2a127e0b73 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:06.390018 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32831df-9c85-4659-8890-81d289826e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:06.390295 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32831df-9c85-4659-8890-81d289826e8d admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:06.390903 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32831df-9c85-4659-8890-81d289826e8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:06.392809 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32831df-9c85-4659-8890-81d289826e8d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:06.414235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 784/1582] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:06 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:06.414235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ab41d-f34b-4dd1-859d-6e2a127e0b73 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:06.421411 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 799/1583] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:06 2022] POST /identity/v3/users => generated 292 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:06.421411 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32831df-9c85-4659-8890-81d289826e8d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:06.422310 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ab41d-f34b-4dd1-859d-6e2a127e0b73 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:06.426851 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674032a-12de-406d-b474-312adf5d4e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:06.427435 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674032a-12de-406d-b474-312adf5d4e1f admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:06.427717 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674032a-12de-406d-b474-312adf5d4e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:06.427991 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674032a-12de-406d-b474-312adf5d4e1f admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:06.428637 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674032a-12de-406d-b474-312adf5d4e1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:06.430716 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674032a-12de-406d-b474-312adf5d4e1f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:06.431112 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32831df-9c85-4659-8890-81d289826e8d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:06.435779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593beaba-fe3e-41ef-abdb-be2f920f4048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:06.436370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593beaba-fe3e-41ef-abdb-be2f920f4048 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:06.436654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593beaba-fe3e-41ef-abdb-be2f920f4048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:06.436932 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593beaba-fe3e-41ef-abdb-be2f920f4048 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:06.437585 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593beaba-fe3e-41ef-abdb-be2f920f4048 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:06.439505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593beaba-fe3e-41ef-abdb-be2f920f4048 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:06.451073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 785/1584] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:06 2022] POST /identity/v3/users => generated 291 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:06.451884 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674032a-12de-406d-b474-312adf5d4e1f admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:06.461151 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674032a-12de-406d-b474-312adf5d4e1f admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:06.462805 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 800/1585] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:06 2022] POST /identity/v3/users => generated 279 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:06.466392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b73a98-657c-42fb-a857-fda9be7e7b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:06.466983 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b73a98-657c-42fb-a857-fda9be7e7b9a admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:06.467104 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593beaba-fe3e-41ef-abdb-be2f920f4048 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:06.467265 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b73a98-657c-42fb-a857-fda9be7e7b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:06.467542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b73a98-657c-42fb-a857-fda9be7e7b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:06.468179 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b73a98-657c-42fb-a857-fda9be7e7b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:06.469880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b73a98-657c-42fb-a857-fda9be7e7b9a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:06.477158 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593beaba-fe3e-41ef-abdb-be2f920f4048 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:06.481887 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48ae46-403a-402c-a28d-867c724922c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:06.482469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48ae46-403a-402c-a28d-867c724922c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:06.482742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48ae46-403a-402c-a28d-867c724922c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:06.483014 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48ae46-403a-402c-a28d-867c724922c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:06.483623 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48ae46-403a-402c-a28d-867c724922c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:06.485315 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 786/1586] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:06.485557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d48ae46-403a-402c-a28d-867c724922c8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:06.487011 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54e042-57a1-475d-8e22-775ede48fff4 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:06.487296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54e042-57a1-475d-8e22-775ede48fff4 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:06.487570 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54e042-57a1-475d-8e22-775ede48fff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:06.509435 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 801/1587] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:06 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:06.510245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48ae46-403a-402c-a28d-867c724922c8 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:06.514528 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-ef54e042-57a1-475d-8e22-775ede48fff4 None None] MFA Rules not processed for user `a41212fc006c4b26b151ae200632a0ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:06.515739 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ef54e042-57a1-475d-8e22-775ede48fff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:06.563500 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48ae46-403a-402c-a28d-867c724922c8 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:06.567181 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487be0d4-c9b3-4fd5-a88a-110f0c98be74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:06.567784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487be0d4-c9b3-4fd5-a88a-110f0c98be74 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:06.568064 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487be0d4-c9b3-4fd5-a88a-110f0c98be74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:06.568337 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487be0d4-c9b3-4fd5-a88a-110f0c98be74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:06.577293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487be0d4-c9b3-4fd5-a88a-110f0c98be74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:06.578156 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 787/1588] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:06.578722 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487be0d4-c9b3-4fd5-a88a-110f0c98be74 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:06.578988 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54e042-57a1-475d-8e22-775ede48fff4 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:06.588485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 802/1589] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:06.589424 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54e042-57a1-475d-8e22-775ede48fff4 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:06.589852 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487be0d4-c9b3-4fd5-a88a-110f0c98be74 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:06.593976 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4021fd-0984-4186-a326-54308a955245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:06.594611 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4021fd-0984-4186-a326-54308a955245 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:06.594899 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4021fd-0984-4186-a326-54308a955245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:06.595177 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4021fd-0984-4186-a326-54308a955245 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:06.595943 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4021fd-0984-4186-a326-54308a955245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:06.597573 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4021fd-0984-4186-a326-54308a955245 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:06.598998 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487be0d4-c9b3-4fd5-a88a-110f0c98be74 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:06.603665 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6674a96-722b-4446-b53f-347750ad657a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:06.604263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6674a96-722b-4446-b53f-347750ad657a admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:06.605263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6674a96-722b-4446-b53f-347750ad657a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:06.605543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6674a96-722b-4446-b53f-347750ad657a admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:06.606186 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6674a96-722b-4446-b53f-347750ad657a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:06.607778 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6674a96-722b-4446-b53f-347750ad657a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:06.609726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 788/1590] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:06.610561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4021fd-0984-4186-a326-54308a955245 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:06.625274 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4021fd-0984-4186-a326-54308a955245 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:06.625519 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 803/1591] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:06.625519 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6674a96-722b-4446-b53f-347750ad657a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:06.629262 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f1943-2a69-46ce-bf18-06aec4ec43cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:06.629876 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f1943-2a69-46ce-bf18-06aec4ec43cc admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:06.630160 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f1943-2a69-46ce-bf18-06aec4ec43cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:06.630437 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f1943-2a69-46ce-bf18-06aec4ec43cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:06.631084 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f1943-2a69-46ce-bf18-06aec4ec43cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:06.632685 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f1943-2a69-46ce-bf18-06aec4ec43cc admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:06.635418 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6674a96-722b-4446-b53f-347750ad657a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:06.640501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febf988-9113-4491-9305-d477fb6ca60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:06.641132 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febf988-9113-4491-9305-d477fb6ca60e admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:06.641413 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febf988-9113-4491-9305-d477fb6ca60e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:06.641680 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febf988-9113-4491-9305-d477fb6ca60e admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:06.642311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febf988-9113-4491-9305-d477fb6ca60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:06.646959 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febf988-9113-4491-9305-d477fb6ca60e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:06.647094 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 789/1592] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:06.647094 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f1943-2a69-46ce-bf18-06aec4ec43cc admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:06.658481 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f1943-2a69-46ce-bf18-06aec4ec43cc admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:06.659096 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 804/1593] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:06.662771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febf988-9113-4491-9305-d477fb6ca60e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:06.663894 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c98bb-01a6-4eec-b065-6229485534cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:06.664645 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c98bb-01a6-4eec-b065-6229485534cd admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:06.664997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c98bb-01a6-4eec-b065-6229485534cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:06.665380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c98bb-01a6-4eec-b065-6229485534cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:06.666141 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c98bb-01a6-4eec-b065-6229485534cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:06.668470 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5c98bb-01a6-4eec-b065-6229485534cd admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:06.674506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febf988-9113-4491-9305-d477fb6ca60e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:06.680216 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e398993-d1d2-4476-ab9b-1d5d55699f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:06.680404 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 790/1594] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:06.680799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e398993-d1d2-4476-ab9b-1d5d55699f43 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:06.681111 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e398993-d1d2-4476-ab9b-1d5d55699f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:06.681302 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c98bb-01a6-4eec-b065-6229485534cd admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:06.681429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e398993-d1d2-4476-ab9b-1d5d55699f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:06.682099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e398993-d1d2-4476-ab9b-1d5d55699f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:06.683906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e398993-d1d2-4476-ab9b-1d5d55699f43 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:06.692997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c98bb-01a6-4eec-b065-6229485534cd admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:06.697063 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 805/1595] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:06.697906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e398993-d1d2-4476-ab9b-1d5d55699f43 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:06.699024 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04e3d0-c92f-4f86-8a4d-81bdb512dd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:06.699938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04e3d0-c92f-4f86-8a4d-81bdb512dd51 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:06.700063 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04e3d0-c92f-4f86-8a4d-81bdb512dd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:06.700286 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04e3d0-c92f-4f86-8a4d-81bdb512dd51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:06.701078 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04e3d0-c92f-4f86-8a4d-81bdb512dd51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:06.703222 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04e3d0-c92f-4f86-8a4d-81bdb512dd51 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:06.709473 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e398993-d1d2-4476-ab9b-1d5d55699f43 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:06.714731 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50b661-d141-4e5b-9901-500701ad402b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:06.716455 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50b661-d141-4e5b-9901-500701ad402b admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:06.716455 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50b661-d141-4e5b-9901-500701ad402b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:06.716696 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50b661-d141-4e5b-9901-500701ad402b admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:06.717334 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50b661-d141-4e5b-9901-500701ad402b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:06.719005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50b661-d141-4e5b-9901-500701ad402b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:06.725311 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:06.730900 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 806/1596] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:06.731835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50b661-d141-4e5b-9901-500701ad402b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:06.744603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 791/1597] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:06 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:06.744942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50b661-d141-4e5b-9901-500701ad402b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:06.746119 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04e3d0-c92f-4f86-8a4d-81bdb512dd51 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:06.811486 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:06.821772 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04e3d0-c92f-4f86-8a4d-81bdb512dd51 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:06.827202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed597487-4cd1-4f92-b29a-c324895b572b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:06.827368 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44513705-7103-468a-8eff-082359900974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:06.827828 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed597487-4cd1-4f92-b29a-c324895b572b admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:06.827934 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44513705-7103-468a-8eff-082359900974 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:06.828112 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed597487-4cd1-4f92-b29a-c324895b572b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:06.828278 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44513705-7103-468a-8eff-082359900974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:06.828585 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed597487-4cd1-4f92-b29a-c324895b572b admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:06.828688 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44513705-7103-468a-8eff-082359900974 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:06.829193 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed597487-4cd1-4f92-b29a-c324895b572b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:06.829503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44513705-7103-468a-8eff-082359900974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:06.830965 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed597487-4cd1-4f92-b29a-c324895b572b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:06.831251 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44513705-7103-468a-8eff-082359900974 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:06.843801 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 792/1599] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:06.843968 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 807/1599] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:06.844814 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed597487-4cd1-4f92-b29a-c324895b572b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:06.844947 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44513705-7103-468a-8eff-082359900974 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:06.855776 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44513705-7103-468a-8eff-082359900974 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:06.859481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed597487-4cd1-4f92-b29a-c324895b572b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:06.860854 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b43226-8f4e-47a7-a048-a84a977514ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:06.861802 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b43226-8f4e-47a7-a048-a84a977514ba admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:06.862194 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b43226-8f4e-47a7-a048-a84a977514ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:06.862479 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b43226-8f4e-47a7-a048-a84a977514ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:06.863104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b43226-8f4e-47a7-a048-a84a977514ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:06.864695 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b43226-8f4e-47a7-a048-a84a977514ba admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:06.865460 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21eb97-e0de-4930-af8a-f0ffa3be02e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:06.866202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21eb97-e0de-4930-af8a-f0ffa3be02e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:06.866541 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21eb97-e0de-4930-af8a-f0ffa3be02e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:06.866778 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21eb97-e0de-4930-af8a-f0ffa3be02e2 admin admin] PATH_INFO: `/v3/projects/b9fc274e72ca47ed92bc0f3b071fda9d/users/48f7060c469347f49bfe86c84e6d93c7/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:06.877714 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 793/1600] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:06.881659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b43226-8f4e-47a7-a048-a84a977514ba admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:06.885084 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21eb97-e0de-4930-af8a-f0ffa3be02e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9fc274e72ca47ed92bc0f3b071fda9d, user_id=48f7060c469347f49bfe86c84e6d93c7, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:06.888666 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21eb97-e0de-4930-af8a-f0ffa3be02e2 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:06.893595 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b43226-8f4e-47a7-a048-a84a977514ba admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:06.898885 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fcc63-e012-453d-b060-eaead5467cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:06.899746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fcc63-e012-453d-b060-eaead5467cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:06.899894 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fcc63-e012-453d-b060-eaead5467cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:06.900176 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fcc63-e012-453d-b060-eaead5467cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:06.900814 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40fcc63-e012-453d-b060-eaead5467cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:06.903196 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40fcc63-e012-453d-b060-eaead5467cf6 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:06.913053 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 808/1601] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:06 2022] PUT /identity/v3/projects/b9fc274e72ca47ed92bc0f3b071fda9d/users/48f7060c469347f49bfe86c84e6d93c7/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:06.913053 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21eb97-e0de-4930-af8a-f0ffa3be02e2 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:06.914990 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 794/1602] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:06.915233 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fcc63-e012-453d-b060-eaead5467cf6 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:06.925115 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fcc63-e012-453d-b060-eaead5467cf6 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:06.999894 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a05b18-8f6a-4d50-9017-9ea82bb7056f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:07.000531 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a05b18-8f6a-4d50-9017-9ea82bb7056f admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:07.000809 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a05b18-8f6a-4d50-9017-9ea82bb7056f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:07.001124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a05b18-8f6a-4d50-9017-9ea82bb7056f admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:07.001790 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a05b18-8f6a-4d50-9017-9ea82bb7056f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:07.003936 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a05b18-8f6a-4d50-9017-9ea82bb7056f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:07.007020 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21eb97-e0de-4930-af8a-f0ffa3be02e2 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:07.014044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a740faf-de2b-4cec-a1f2-99747e4fdab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:07.016064 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a740faf-de2b-4cec-a1f2-99747e4fdab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:07.016429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a740faf-de2b-4cec-a1f2-99747e4fdab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:07.017601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a740faf-de2b-4cec-a1f2-99747e4fdab1 admin admin] PATH_INFO: `/v3/projects/fdfc9c3aed6744b6b5d36879079acf3f/users/dde28f90b51a424299a9786d407baa72/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:07.033525 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 795/1603] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:06 2022] POST /identity/v3/users => generated 292 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:07.034615 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a05b18-8f6a-4d50-9017-9ea82bb7056f admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:07.036320 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a740faf-de2b-4cec-a1f2-99747e4fdab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdfc9c3aed6744b6b5d36879079acf3f, user_id=dde28f90b51a424299a9786d407baa72, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:07.039636 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a740faf-de2b-4cec-a1f2-99747e4fdab1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:07.045578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a05b18-8f6a-4d50-9017-9ea82bb7056f admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:07.051891 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52641fbe-ec61-4b36-a494-2ec53c7894ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:07.052960 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52641fbe-ec61-4b36-a494-2ec53c7894ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:07.053216 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52641fbe-ec61-4b36-a494-2ec53c7894ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:07.053486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52641fbe-ec61-4b36-a494-2ec53c7894ec admin admin] PATH_INFO: `/v3/projects/de8b40a31f43457f813fa2437c96ac0b/users/06434efdc06940999ec26d455836d0b3/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:07.059277 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 809/1604] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:06 2022] PUT /identity/v3/projects/fdfc9c3aed6744b6b5d36879079acf3f/users/dde28f90b51a424299a9786d407baa72/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:07.060860 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a740faf-de2b-4cec-a1f2-99747e4fdab1 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:07.071250 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52641fbe-ec61-4b36-a494-2ec53c7894ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=de8b40a31f43457f813fa2437c96ac0b, user_id=06434efdc06940999ec26d455836d0b3, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:07.075326 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52641fbe-ec61-4b36-a494-2ec53c7894ec admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:07.092335 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 796/1605] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:07 2022] PUT /identity/v3/projects/de8b40a31f43457f813fa2437c96ac0b/users/06434efdc06940999ec26d455836d0b3/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:07.093904 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52641fbe-ec61-4b36-a494-2ec53c7894ec admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:07.138888 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:07.139538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a740faf-de2b-4cec-a1f2-99747e4fdab1 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:07.171421 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52641fbe-ec61-4b36-a494-2ec53c7894ec admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:07.180125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91bc36-be97-4c19-9f6c-2ae886ad9af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:07.180826 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91bc36-be97-4c19-9f6c-2ae886ad9af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:07.181272 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91bc36-be97-4c19-9f6c-2ae886ad9af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:07.181550 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91bc36-be97-4c19-9f6c-2ae886ad9af6 admin admin] PATH_INFO: `/v3/projects/2766f448e89b42d7b5fbd4b79b1a65e4/users/9678f17580cc478c9c7aa7c0d1855aaa/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:07.194117 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:07.199519 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91bc36-be97-4c19-9f6c-2ae886ad9af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2766f448e89b42d7b5fbd4b79b1a65e4, user_id=9678f17580cc478c9c7aa7c0d1855aaa, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:07.203082 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91bc36-be97-4c19-9f6c-2ae886ad9af6 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:07.208498 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a49641-8bcd-4ede-b4c8-5734d8db75ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:07.209478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a49641-8bcd-4ede-b4c8-5734d8db75ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:07.209756 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a49641-8bcd-4ede-b4c8-5734d8db75ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:07.210032 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a49641-8bcd-4ede-b4c8-5734d8db75ba admin admin] PATH_INFO: `/v3/projects/42954936b14c4efbb981cb4bced6fbe4/users/0b20525bc3124888bbb1decbae15d3c2/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:07.219689 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 797/1606] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:07 2022] PUT /identity/v3/projects/2766f448e89b42d7b5fbd4b79b1a65e4/users/9678f17580cc478c9c7aa7c0d1855aaa/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:07.226250 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a49641-8bcd-4ede-b4c8-5734d8db75ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=42954936b14c4efbb981cb4bced6fbe4, user_id=0b20525bc3124888bbb1decbae15d3c2, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:07.228949 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a49641-8bcd-4ede-b4c8-5734d8db75ba admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:07.231820 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdd959-1670-4047-9d77-4d72be516099 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:07.232113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdd959-1670-4047-9d77-4d72be516099 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:07.232671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdd959-1670-4047-9d77-4d72be516099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:07.248334 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 810/1607] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:07 2022] PUT /identity/v3/projects/42954936b14c4efbb981cb4bced6fbe4/users/0b20525bc3124888bbb1decbae15d3c2/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:07.249731 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a49641-8bcd-4ede-b4c8-5734d8db75ba admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:07.270796 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-d7fdd959-1670-4047-9d77-4d72be516099 None None] MFA Rules not processed for user `48f7060c469347f49bfe86c84e6d93c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:07.272278 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d7fdd959-1670-4047-9d77-4d72be516099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:07.340493 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a49641-8bcd-4ede-b4c8-5734d8db75ba admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:07.345941 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503cdec-f96c-4ea8-8d3c-29e79bddbc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:07.346779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503cdec-f96c-4ea8-8d3c-29e79bddbc64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:07.347062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503cdec-f96c-4ea8-8d3c-29e79bddbc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:07.347340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503cdec-f96c-4ea8-8d3c-29e79bddbc64 admin admin] PATH_INFO: `/v3/projects/08f21e666aca41eba8d9161b57a14e36/users/74066ca220c8440c820728722f979f88/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:07.373146 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503cdec-f96c-4ea8-8d3c-29e79bddbc64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08f21e666aca41eba8d9161b57a14e36, user_id=74066ca220c8440c820728722f979f88, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:07.376935 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503cdec-f96c-4ea8-8d3c-29e79bddbc64 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:07.377124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 798/1608] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:07.379667 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdd959-1670-4047-9d77-4d72be516099 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:07.392253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdd959-1670-4047-9d77-4d72be516099 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:07.399226 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 811/1609] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:07 2022] PUT /identity/v3/projects/08f21e666aca41eba8d9161b57a14e36/users/74066ca220c8440c820728722f979f88/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:07.400991 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0a075-0478-4ff5-81e7-310add39c68a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:07.401617 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0a075-0478-4ff5-81e7-310add39c68a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:07.402178 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0a075-0478-4ff5-81e7-310add39c68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:07.438042 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-1bd0a075-0478-4ff5-81e7-310add39c68a None None] MFA Rules not processed for user `dde28f90b51a424299a9786d407baa72`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:07.440181 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1bd0a075-0478-4ff5-81e7-310add39c68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:07.462726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673f659-1470-4730-b7d1-a729980da99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:07.463447 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673f659-1470-4730-b7d1-a729980da99a admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:07.463794 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673f659-1470-4730-b7d1-a729980da99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:07.464144 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673f659-1470-4730-b7d1-a729980da99a admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:07.464865 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673f659-1470-4730-b7d1-a729980da99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:07.466968 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673f659-1470-4730-b7d1-a729980da99a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:07.478033 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 799/1610] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:07.479959 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374aecc7-56ab-41ec-aa8e-55568f8c8d81 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:07.480308 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374aecc7-56ab-41ec-aa8e-55568f8c8d81 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:07.480659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374aecc7-56ab-41ec-aa8e-55568f8c8d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:07.512658 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-374aecc7-56ab-41ec-aa8e-55568f8c8d81 None None] MFA Rules not processed for user `06434efdc06940999ec26d455836d0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:07.514079 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-374aecc7-56ab-41ec-aa8e-55568f8c8d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:07.518604 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 812/1611] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:07.519726 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ecd02-19fe-48f6-b925-f0a1f03f7f15 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:07.520007 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ecd02-19fe-48f6-b925-f0a1f03f7f15 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:07.520279 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ecd02-19fe-48f6-b925-f0a1f03f7f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:07.548729 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2f7ecd02-19fe-48f6-b925-f0a1f03f7f15 None None] MFA Rules not processed for user `9678f17580cc478c9c7aa7c0d1855aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:07.550236 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2f7ecd02-19fe-48f6-b925-f0a1f03f7f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:07.556895 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:07.588025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:07.618040 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 800/1612] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:07.619617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6746f0a-72c6-4e6a-823c-82c8337608a9 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:07.619905 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6746f0a-72c6-4e6a-823c-82c8337608a9 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:07.620737 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6746f0a-72c6-4e6a-823c-82c8337608a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:07.631014 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 813/1613] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:07.632048 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ecd02-19fe-48f6-b925-f0a1f03f7f15 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:07.645446 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ecd02-19fe-48f6-b925-f0a1f03f7f15 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:07.653920 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-b6746f0a-72c6-4e6a-823c-82c8337608a9 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:07.655109 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b6746f0a-72c6-4e6a-823c-82c8337608a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:07.657332 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09791e17-f642-4cfd-9509-4e8431518ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:07.657912 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09791e17-f642-4cfd-9509-4e8431518ada admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:07.658357 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09791e17-f642-4cfd-9509-4e8431518ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:07.658811 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09791e17-f642-4cfd-9509-4e8431518ada admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:07.660188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09791e17-f642-4cfd-9509-4e8431518ada admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:07.662198 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09791e17-f642-4cfd-9509-4e8431518ada admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:07.664887 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 801/1614] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:07.667334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42872de-5252-4d2b-9b87-be919421611d None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:07.667800 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42872de-5252-4d2b-9b87-be919421611d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:07.668083 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42872de-5252-4d2b-9b87-be919421611d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:07.688910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c42872de-5252-4d2b-9b87-be919421611d None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:07.690362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c42872de-5252-4d2b-9b87-be919421611d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:07.702825 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 802/1615] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:07.703777 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42872de-5252-4d2b-9b87-be919421611d None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:07.715446 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42872de-5252-4d2b-9b87-be919421611d None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:07.720413 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57582a-5cd0-42f5-9237-9e64247ac99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:07.720795 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 814/1616] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:07 2022] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:07.722320 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09791e17-f642-4cfd-9509-4e8431518ada admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:07.724594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57582a-5cd0-42f5-9237-9e64247ac99f admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:07.724940 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57582a-5cd0-42f5-9237-9e64247ac99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:07.725466 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57582a-5cd0-42f5-9237-9e64247ac99f admin admin] PATH_INFO: `/v3/projects/ff9d69a58d7040429244b54deebdbb6a/users/4c4b6f4cc252404ba17c5429edf2479c/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:07.749740 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57582a-5cd0-42f5-9237-9e64247ac99f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff9d69a58d7040429244b54deebdbb6a, user_id=4c4b6f4cc252404ba17c5429edf2479c, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:07.753434 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57582a-5cd0-42f5-9237-9e64247ac99f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:07.775016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 803/1617] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:07 2022] PUT /identity/v3/projects/ff9d69a58d7040429244b54deebdbb6a/users/4c4b6f4cc252404ba17c5429edf2479c/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:07.776019 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57582a-5cd0-42f5-9237-9e64247ac99f admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:07.805964 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09791e17-f642-4cfd-9509-4e8431518ada admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:07.859756 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57582a-5cd0-42f5-9237-9e64247ac99f admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:07.865066 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff8893-e31d-43e4-b82a-a747d13b0f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:07.866138 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff8893-e31d-43e4-b82a-a747d13b0f17 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:07.866500 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff8893-e31d-43e4-b82a-a747d13b0f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:07.866851 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff8893-e31d-43e4-b82a-a747d13b0f17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:07.867611 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff8893-e31d-43e4-b82a-a747d13b0f17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:07.870072 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff8893-e31d-43e4-b82a-a747d13b0f17 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:07.894816 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ab978-a15e-4893-8517-17a03d00d38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:07.895430 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ab978-a15e-4893-8517-17a03d00d38a admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:07.895713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ab978-a15e-4893-8517-17a03d00d38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:07.896025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ab978-a15e-4893-8517-17a03d00d38a admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:07.896661 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ab978-a15e-4893-8517-17a03d00d38a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:07.898714 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ab978-a15e-4893-8517-17a03d00d38a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:07.905401 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 804/1618] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:07 2022] POST /identity/v3/projects => generated 357 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:07.906751 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b43d5-b1ee-4c81-97bd-3b2959258d8b None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:07.907091 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b43d5-b1ee-4c81-97bd-3b2959258d8b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:07.907375 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b43d5-b1ee-4c81-97bd-3b2959258d8b None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:07.909784 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 805/1619] 10.222.0.16 () {54 vars in 962 bytes} [Tue Aug 9 02:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:30:07.910471 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b43d5-b1ee-4c81-97bd-3b2959258d8b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:07.919101 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5d2b43d5-b1ee-4c81-97bd-3b2959258d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:07.952239 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 815/1620] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:07 2022] POST /identity/v3/projects => generated 369 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:07.954330 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ab978-a15e-4893-8517-17a03d00d38a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:07.957523 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-766ab978-a15e-4893-8517-17a03d00d38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:08.016829 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b43d5-b1ee-4c81-97bd-3b2959258d8b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:08.043004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:08.049949 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ab978-a15e-4893-8517-17a03d00d38a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:08.054978 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:08.058196 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76bf9f3-135c-4277-91f8-8a004914ff20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:08.059290 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bf9f3-135c-4277-91f8-8a004914ff20 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:08.059766 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bf9f3-135c-4277-91f8-8a004914ff20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:08.060779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bf9f3-135c-4277-91f8-8a004914ff20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:08.077394 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d337a-67bf-4713-bc6b-85e836c0a70c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:08.078015 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d337a-67bf-4713-bc6b-85e836c0a70c service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:08.078352 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d337a-67bf-4713-bc6b-85e836c0a70c service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:08.078629 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d337a-67bf-4713-bc6b-85e836c0a70c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:08.154488 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76bf9f3-135c-4277-91f8-8a004914ff20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:08.156040 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76bf9f3-135c-4277-91f8-8a004914ff20 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:08.157862 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d337a-67bf-4713-bc6b-85e836c0a70c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:08.159390 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d337a-67bf-4713-bc6b-85e836c0a70c service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:08.176291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 806/1621] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:08.176987 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d337a-67bf-4713-bc6b-85e836c0a70c service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:08.180091 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 816/1622] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:08.181967 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76bf9f3-135c-4277-91f8-8a004914ff20 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:08.192693 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d337a-67bf-4713-bc6b-85e836c0a70c service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:08.201960 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76bf9f3-135c-4277-91f8-8a004914ff20 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:08.203420 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5aa68-97ed-478b-9ffb-609e70db7638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:08.204058 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5aa68-97ed-478b-9ffb-609e70db7638 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:08.206123 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5aa68-97ed-478b-9ffb-609e70db7638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:08.206409 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5aa68-97ed-478b-9ffb-609e70db7638 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:08.209604 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5aa68-97ed-478b-9ffb-609e70db7638 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:08.218979 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5aa68-97ed-478b-9ffb-609e70db7638 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:08.308759 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d60b39-e1c2-47d7-a570-40224a719679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:08.308759 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d60b39-e1c2-47d7-a570-40224a719679 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:08.308759 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d60b39-e1c2-47d7-a570-40224a719679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:08.308759 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d60b39-e1c2-47d7-a570-40224a719679 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:08.309943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d60b39-e1c2-47d7-a570-40224a719679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:08.309943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d60b39-e1c2-47d7-a570-40224a719679 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:08.309943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 817/1623] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:08.309943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d60b39-e1c2-47d7-a570-40224a719679 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:08.310546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 807/1624] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:08 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:08.310546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dda4e-7ea3-4289-a1f3-5e84ab0d659a None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:08.310546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dda4e-7ea3-4289-a1f3-5e84ab0d659a None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:08.310546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dda4e-7ea3-4289-a1f3-5e84ab0d659a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:08.310934 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d60b39-e1c2-47d7-a570-40224a719679 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:08.310934 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9597d-219c-4017-a2b4-3166f6350c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:08.310934 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9597d-219c-4017-a2b4-3166f6350c4c admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:08.310934 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9597d-219c-4017-a2b4-3166f6350c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:08.311612 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9597d-219c-4017-a2b4-3166f6350c4c admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:08.311612 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9597d-219c-4017-a2b4-3166f6350c4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:08.311612 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e9597d-219c-4017-a2b4-3166f6350c4c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:08.327571 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 818/1625] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:08 2022] POST /identity/v3/users => generated 285 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:08.328729 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9597d-219c-4017-a2b4-3166f6350c4c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:08.352457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e9597d-219c-4017-a2b4-3166f6350c4c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:08.363116 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a660d-857b-4a4f-a2c1-e9ff1fb35efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:08.363744 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a660d-857b-4a4f-a2c1-e9ff1fb35efa admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:08.364023 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a660d-857b-4a4f-a2c1-e9ff1fb35efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:08.364293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a660d-857b-4a4f-a2c1-e9ff1fb35efa admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:08.364929 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a660d-857b-4a4f-a2c1-e9ff1fb35efa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:08.366869 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-e66dda4e-7ea3-4289-a1f3-5e84ab0d659a None None] MFA Rules not processed for user `78fff294b9794a26aa1bbc231fa1133c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:08.367175 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e66dda4e-7ea3-4289-a1f3-5e84ab0d659a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:08.371742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a660d-857b-4a4f-a2c1-e9ff1fb35efa admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:08.426802 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 819/1626] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:08 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:08.426802 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a660d-857b-4a4f-a2c1-e9ff1fb35efa admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:08.449052 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a660d-857b-4a4f-a2c1-e9ff1fb35efa admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:08.470066 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f4192-d584-4bcf-acbd-5c8de4a41f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:08.474404 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f4192-d584-4bcf-acbd-5c8de4a41f4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:08.475071 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f4192-d584-4bcf-acbd-5c8de4a41f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:08.475570 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f4192-d584-4bcf-acbd-5c8de4a41f4f admin admin] PATH_INFO: `/v3/projects/ff9d69a58d7040429244b54deebdbb6a/users/4c4b6f4cc252404ba17c5429edf2479c/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:08.478336 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f4192-d584-4bcf-acbd-5c8de4a41f4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff9d69a58d7040429244b54deebdbb6a, user_id=4c4b6f4cc252404ba17c5429edf2479c, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:08.484479 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f4192-d584-4bcf-acbd-5c8de4a41f4f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:08.505108 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 820/1627] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:08 2022] PUT /identity/v3/projects/ff9d69a58d7040429244b54deebdbb6a/users/4c4b6f4cc252404ba17c5429edf2479c/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:08.509615 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f4192-d584-4bcf-acbd-5c8de4a41f4f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:08.563709 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 808/1628] 10.222.0.16 () {58 vars in 1059 bytes} [Tue Aug 9 02:30:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:08.566154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66dda4e-7ea3-4289-a1f3-5e84ab0d659a None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:08.607153 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66dda4e-7ea3-4289-a1f3-5e84ab0d659a None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:08.719985 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:08.737161 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f4192-d584-4bcf-acbd-5c8de4a41f4f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:08.772713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd0e18-7dd5-4e3e-88bd-5afae474cfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:08.773993 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd0e18-7dd5-4e3e-88bd-5afae474cfa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:08.774275 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd0e18-7dd5-4e3e-88bd-5afae474cfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:08.774547 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd0e18-7dd5-4e3e-88bd-5afae474cfa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:08.775205 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd0e18-7dd5-4e3e-88bd-5afae474cfa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:08.783296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd0e18-7dd5-4e3e-88bd-5afae474cfa0 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:08.787139 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f276e12-902e-4299-8f67-3cf6c4bfe154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:08.788152 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f276e12-902e-4299-8f67-3cf6c4bfe154 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:08.788436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f276e12-902e-4299-8f67-3cf6c4bfe154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:08.788705 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f276e12-902e-4299-8f67-3cf6c4bfe154 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:08.789402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f276e12-902e-4299-8f67-3cf6c4bfe154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:08.791380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f276e12-902e-4299-8f67-3cf6c4bfe154 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:08.799697 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 821/1629] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:08.802951 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd0e18-7dd5-4e3e-88bd-5afae474cfa0 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:08.817236 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 809/1630] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:08.817236 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86658c-af32-458e-86d3-824853dbdeb9 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:08.817236 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86658c-af32-458e-86d3-824853dbdeb9 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:08.817236 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86658c-af32-458e-86d3-824853dbdeb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:08.819097 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd0e18-7dd5-4e3e-88bd-5afae474cfa0 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:08.826146 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3802f-05cb-4a49-9acc-b6e09ea6916e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:08.828435 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3802f-05cb-4a49-9acc-b6e09ea6916e admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:08.828797 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3802f-05cb-4a49-9acc-b6e09ea6916e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:08.830853 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3802f-05cb-4a49-9acc-b6e09ea6916e admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:08.831605 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3802f-05cb-4a49-9acc-b6e09ea6916e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:08.833618 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3802f-05cb-4a49-9acc-b6e09ea6916e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:08.860246 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 822/1631] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:08.861899 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3802f-05cb-4a49-9acc-b6e09ea6916e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:08.863908 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-8b86658c-af32-458e-86d3-824853dbdeb9 None None] MFA Rules not processed for user `4c4b6f4cc252404ba17c5429edf2479c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:08.866043 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8b86658c-af32-458e-86d3-824853dbdeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:08.923680 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:09.003870 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 810/1632] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:09.004763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86658c-af32-458e-86d3-824853dbdeb9 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:09.024299 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86658c-af32-458e-86d3-824853dbdeb9 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:09.035705 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e857e63-b951-4cc0-a552-4bed95815b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:09.036933 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e857e63-b951-4cc0-a552-4bed95815b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:09.037703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e857e63-b951-4cc0-a552-4bed95815b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:09.038178 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e857e63-b951-4cc0-a552-4bed95815b36 admin admin] PATH_INFO: `/v3/projects/4f1980e5cfa1465cb9effcbcfbaf3554/users/01b42cfe21ce4329bd6e5b29ea3c096a/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:09.061844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3802f-05cb-4a49-9acc-b6e09ea6916e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:09.067017 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e857e63-b951-4cc0-a552-4bed95815b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1980e5cfa1465cb9effcbcfbaf3554, user_id=01b42cfe21ce4329bd6e5b29ea3c096a, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:09.070755 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e857e63-b951-4cc0-a552-4bed95815b36 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:09.078757 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092c8a5-31a6-4bf3-963c-2400f34de6c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:09.079496 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092c8a5-31a6-4bf3-963c-2400f34de6c4 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:09.079803 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092c8a5-31a6-4bf3-963c-2400f34de6c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:09.080044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092c8a5-31a6-4bf3-963c-2400f34de6c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:09.092527 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 811/1633] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:09 2022] PUT /identity/v3/projects/4f1980e5cfa1465cb9effcbcfbaf3554/users/01b42cfe21ce4329bd6e5b29ea3c096a/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:09.092527 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e857e63-b951-4cc0-a552-4bed95815b36 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:09.192361 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092c8a5-31a6-4bf3-963c-2400f34de6c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:09.194588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092c8a5-31a6-4bf3-963c-2400f34de6c4 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:09.212994 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 823/1634] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:09.214276 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092c8a5-31a6-4bf3-963c-2400f34de6c4 service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:09.242685 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092c8a5-31a6-4bf3-963c-2400f34de6c4 service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:09.250645 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a882fec-b005-4e7c-ba89-82ea49f3d0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:09.251630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a882fec-b005-4e7c-ba89-82ea49f3d0a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:09.252278 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a882fec-b005-4e7c-ba89-82ea49f3d0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:09.252772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a882fec-b005-4e7c-ba89-82ea49f3d0a8 admin admin] PATH_INFO: `/v3/projects/35b326a31f09492ea5af27014c8e9704/users/238d3b9e18e1498e840480a70b103681/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:09.254519 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e857e63-b951-4cc0-a552-4bed95815b36 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:09.266526 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d60ff-9569-42b2-b77f-87667e7bdccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:09.267219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d60ff-9569-42b2-b77f-87667e7bdccc admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:09.275828 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a882fec-b005-4e7c-ba89-82ea49f3d0a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b326a31f09492ea5af27014c8e9704, user_id=238d3b9e18e1498e840480a70b103681, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:09.278228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d60ff-9569-42b2-b77f-87667e7bdccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:09.278790 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d60ff-9569-42b2-b77f-87667e7bdccc admin admin] PATH_INFO: `/v3/projects/fc07bf2c662949489a4e14676cabff98/users/570d6f91f1734e4293a4eb38d4fe4ba8/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:09.285370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a882fec-b005-4e7c-ba89-82ea49f3d0a8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:09.310978 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d60ff-9569-42b2-b77f-87667e7bdccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc07bf2c662949489a4e14676cabff98, user_id=570d6f91f1734e4293a4eb38d4fe4ba8, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:09.314850 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d60ff-9569-42b2-b77f-87667e7bdccc admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:09.318643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 824/1635] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:09 2022] PUT /identity/v3/projects/35b326a31f09492ea5af27014c8e9704/users/238d3b9e18e1498e840480a70b103681/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:09.319867 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a882fec-b005-4e7c-ba89-82ea49f3d0a8 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:09.338128 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 812/1636] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:09 2022] PUT /identity/v3/projects/fc07bf2c662949489a4e14676cabff98/users/570d6f91f1734e4293a4eb38d4fe4ba8/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:09.341306 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d60ff-9569-42b2-b77f-87667e7bdccc admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:09.414979 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a882fec-b005-4e7c-ba89-82ea49f3d0a8 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:09.418398 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:09.492124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d60ff-9569-42b2-b77f-87667e7bdccc admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:09.507258 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dc8e7-0202-45b1-8c09-e3b8e9eac1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:09.508172 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dc8e7-0202-45b1-8c09-e3b8e9eac1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:09.508861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dc8e7-0202-45b1-8c09-e3b8e9eac1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:09.509274 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dc8e7-0202-45b1-8c09-e3b8e9eac1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:09.510063 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4dc8e7-0202-45b1-8c09-e3b8e9eac1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:09.512211 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4dc8e7-0202-45b1-8c09-e3b8e9eac1e0 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:09.527085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c42b1-c9bf-4a3e-99b5-eacaa9c3600f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:09.528106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c42b1-c9bf-4a3e-99b5-eacaa9c3600f service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:09.528396 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c42b1-c9bf-4a3e-99b5-eacaa9c3600f service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:09.528673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c42b1-c9bf-4a3e-99b5-eacaa9c3600f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:09.537307 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:09.537850 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 813/1637] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:09.539101 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dc8e7-0202-45b1-8c09-e3b8e9eac1e0 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:09.555382 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dc8e7-0202-45b1-8c09-e3b8e9eac1e0 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:09.574858 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a0bfa-2331-4116-bf44-232fc1141877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:09.576163 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a0bfa-2331-4116-bf44-232fc1141877 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:09.577327 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a0bfa-2331-4116-bf44-232fc1141877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:09.577705 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a0bfa-2331-4116-bf44-232fc1141877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:09.578534 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a0bfa-2331-4116-bf44-232fc1141877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:09.580886 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a0bfa-2331-4116-bf44-232fc1141877 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:09.596034 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 814/1638] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:09.597097 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a0bfa-2331-4116-bf44-232fc1141877 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:09.610086 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a0bfa-2331-4116-bf44-232fc1141877 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:09.616136 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363b757-69d8-435f-b9af-5d8e726ad282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:09.616976 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363b757-69d8-435f-b9af-5d8e726ad282 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:09.617601 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363b757-69d8-435f-b9af-5d8e726ad282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:09.617960 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363b757-69d8-435f-b9af-5d8e726ad282 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:09.618720 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363b757-69d8-435f-b9af-5d8e726ad282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:09.621217 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363b757-69d8-435f-b9af-5d8e726ad282 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:09.634866 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 815/1639] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:09.636862 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363b757-69d8-435f-b9af-5d8e726ad282 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:09.655510 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363b757-69d8-435f-b9af-5d8e726ad282 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:09.662612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82302269-084f-4608-83eb-4118ddf7fca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:09.663724 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82302269-084f-4608-83eb-4118ddf7fca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:09.664625 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82302269-084f-4608-83eb-4118ddf7fca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:09.665198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82302269-084f-4608-83eb-4118ddf7fca7 admin admin] PATH_INFO: `/v3/projects/4f1980e5cfa1465cb9effcbcfbaf3554/users/01b42cfe21ce4329bd6e5b29ea3c096a/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:09.667664 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82302269-084f-4608-83eb-4118ddf7fca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1980e5cfa1465cb9effcbcfbaf3554, user_id=01b42cfe21ce4329bd6e5b29ea3c096a, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:09.673836 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c42b1-c9bf-4a3e-99b5-eacaa9c3600f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:09.674300 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82302269-084f-4608-83eb-4118ddf7fca7 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:09.674393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c42b1-c9bf-4a3e-99b5-eacaa9c3600f service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:09.701990 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 825/1640] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:09.703556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d14f4-a53e-45ee-aff8-7268a4a590fb None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:09.705877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d14f4-a53e-45ee-aff8-7268a4a590fb None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:09.706255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d14f4-a53e-45ee-aff8-7268a4a590fb None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:09.710976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 826/1641] 10.222.0.16 () {54 vars in 912 bytes} [Tue Aug 9 02:30:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:30:09.712609 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d14f4-a53e-45ee-aff8-7268a4a590fb None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:09.722464 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 816/1642] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:09 2022] PUT /identity/v3/projects/4f1980e5cfa1465cb9effcbcfbaf3554/users/01b42cfe21ce4329bd6e5b29ea3c096a/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:09.733116 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82302269-084f-4608-83eb-4118ddf7fca7 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:09.885641 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d14f4-a53e-45ee-aff8-7268a4a590fb None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:09.897720 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9224a-597b-456c-a260-a97ca875f7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:09.898568 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9224a-597b-456c-a260-a97ca875f7d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:09.899004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9224a-597b-456c-a260-a97ca875f7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:09.900283 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9224a-597b-456c-a260-a97ca875f7d7 admin admin] PATH_INFO: `/v3/projects/35b326a31f09492ea5af27014c8e9704/users/238d3b9e18e1498e840480a70b103681/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:09.904485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9224a-597b-456c-a260-a97ca875f7d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b326a31f09492ea5af27014c8e9704, user_id=238d3b9e18e1498e840480a70b103681, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:09.908556 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82302269-084f-4608-83eb-4118ddf7fca7 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:09.910276 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9224a-597b-456c-a260-a97ca875f7d7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:09.919632 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa336a-4dff-4883-9123-a4d4d1ad0513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:09.921290 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa336a-4dff-4883-9123-a4d4d1ad0513 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:09.921703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa336a-4dff-4883-9123-a4d4d1ad0513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:09.922619 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa336a-4dff-4883-9123-a4d4d1ad0513 admin admin] PATH_INFO: `/v3/projects/fc07bf2c662949489a4e14676cabff98/users/570d6f91f1734e4293a4eb38d4fe4ba8/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:09.928484 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa336a-4dff-4883-9123-a4d4d1ad0513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc07bf2c662949489a4e14676cabff98, user_id=570d6f91f1734e4293a4eb38d4fe4ba8, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:09.934012 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa336a-4dff-4883-9123-a4d4d1ad0513 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:09.948762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 827/1643] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:09 2022] PUT /identity/v3/projects/35b326a31f09492ea5af27014c8e9704/users/238d3b9e18e1498e840480a70b103681/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:09.948762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2d798-8483-4161-b156-24637a27dfea None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:09.948762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2d798-8483-4161-b156-24637a27dfea None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:09.948762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2d798-8483-4161-b156-24637a27dfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:09.964813 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 817/1644] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:09 2022] PUT /identity/v3/projects/fc07bf2c662949489a4e14676cabff98/users/570d6f91f1734e4293a4eb38d4fe4ba8/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:09.978910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e767ed-ef26-4f30-bcc2-b5e806f85c21 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:09.980027 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e767ed-ef26-4f30-bcc2-b5e806f85c21 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:09.981367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e767ed-ef26-4f30-bcc2-b5e806f85c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:09.987730 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-41e2d798-8483-4161-b156-24637a27dfea None None] MFA Rules not processed for user `78fff294b9794a26aa1bbc231fa1133c`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:09.990048 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-41e2d798-8483-4161-b156-24637a27dfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:10.047149 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-16e767ed-ef26-4f30-bcc2-b5e806f85c21 None None] MFA Rules not processed for user `01b42cfe21ce4329bd6e5b29ea3c096a`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:10.048726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-16e767ed-ef26-4f30-bcc2-b5e806f85c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:10.139497 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 828/1645] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 9 02:30:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:10.141074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedd423-a64e-424a-92f7-fa0af7e8fd71 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:10.141488 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedd423-a64e-424a-92f7-fa0af7e8fd71 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:10.142057 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cedd423-a64e-424a-92f7-fa0af7e8fd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:10.198456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-0cedd423-a64e-424a-92f7-fa0af7e8fd71 None None] MFA Rules not processed for user `238d3b9e18e1498e840480a70b103681`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:10.204961 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 818/1646] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:10.206715 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8f4c7-66e1-4d8f-a5d6-ff2c149c34e4 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:10.207116 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8f4c7-66e1-4d8f-a5d6-ff2c149c34e4 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:10.207511 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8f4c7-66e1-4d8f-a5d6-ff2c149c34e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:10.209846 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0cedd423-a64e-424a-92f7-fa0af7e8fd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:10.223171 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:10.251002 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:10.259006 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-54d8f4c7-66e1-4d8f-a5d6-ff2c149c34e4 None None] MFA Rules not processed for user `570d6f91f1734e4293a4eb38d4fe4ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:10.261759 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-54d8f4c7-66e1-4d8f-a5d6-ff2c149c34e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:10.377993 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 819/1647] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:10 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:10.379631 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8f4c7-66e1-4d8f-a5d6-ff2c149c34e4 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:10.384708 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 829/1648] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:10 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:10.384708 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedd423-a64e-424a-92f7-fa0af7e8fd71 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:10.480726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8f4c7-66e1-4d8f-a5d6-ff2c149c34e4 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:10.487756 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2f8de-a9b9-485f-8e4f-a84f1a529a36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:10.488497 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2f8de-a9b9-485f-8e4f-a84f1a529a36 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:10.489127 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2f8de-a9b9-485f-8e4f-a84f1a529a36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:10.490673 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2f8de-a9b9-485f-8e4f-a84f1a529a36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:10.511067 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cedd423-a64e-424a-92f7-fa0af7e8fd71 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:10.516998 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2f8de-a9b9-485f-8e4f-a84f1a529a36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:10.518778 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2f8de-a9b9-485f-8e4f-a84f1a529a36 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:10.520319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f924b54-6dc6-49b5-8833-db4e455969b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:10.520944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f924b54-6dc6-49b5-8833-db4e455969b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:10.521756 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f924b54-6dc6-49b5-8833-db4e455969b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:10.522052 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f924b54-6dc6-49b5-8833-db4e455969b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:10.544761 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 820/1649] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:10.673225 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f924b54-6dc6-49b5-8833-db4e455969b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:10.675089 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f924b54-6dc6-49b5-8833-db4e455969b8 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:10.689942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 830/1650] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:11.623634 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2f8de-a9b9-485f-8e4f-a84f1a529a36 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:11.633752 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2f8de-a9b9-485f-8e4f-a84f1a529a36 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:11.642214 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80309ef6-e88a-468c-9898-f17436d294c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:11.643612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80309ef6-e88a-468c-9898-f17436d294c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:11.644009 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80309ef6-e88a-468c-9898-f17436d294c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:11.645415 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80309ef6-e88a-468c-9898-f17436d294c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:11.672373 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80309ef6-e88a-468c-9898-f17436d294c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:11.674172 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80309ef6-e88a-468c-9898-f17436d294c9 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:11.700710 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 821/1651] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:11 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:30:11.744256 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f924b54-6dc6-49b5-8833-db4e455969b8 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:11.763471 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f924b54-6dc6-49b5-8833-db4e455969b8 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:11.778026 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ce7c6-c430-4c4a-b2ec-0c57f94c4dd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:11.782629 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ce7c6-c430-4c4a-b2ec-0c57f94c4dd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:11.788821 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ce7c6-c430-4c4a-b2ec-0c57f94c4dd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:11.789903 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ce7c6-c430-4c4a-b2ec-0c57f94c4dd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:11.827020 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ce7c6-c430-4c4a-b2ec-0c57f94c4dd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:11.828740 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ce7c6-c430-4c4a-b2ec-0c57f94c4dd3 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:11.862934 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 831/1652] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:11 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:12.133304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80309ef6-e88a-468c-9898-f17436d294c9 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:12.147156 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80309ef6-e88a-468c-9898-f17436d294c9 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:12.152997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acd257-7dcd-4a98-9a19-8889a9aad473 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:12.154403 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acd257-7dcd-4a98-9a19-8889a9aad473 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:12.154983 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acd257-7dcd-4a98-9a19-8889a9aad473 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:12.156146 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acd257-7dcd-4a98-9a19-8889a9aad473 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:12.285324 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acd257-7dcd-4a98-9a19-8889a9aad473 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:12.288249 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acd257-7dcd-4a98-9a19-8889a9aad473 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:12.319835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 822/1653] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:12 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:12.472753 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ce7c6-c430-4c4a-b2ec-0c57f94c4dd3 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:12.688426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:12.726444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ce7c6-c430-4c4a-b2ec-0c57f94c4dd3 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:12.750782 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e957041-4e02-40ab-87b5-365ff97fcfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:12.752232 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e957041-4e02-40ab-87b5-365ff97fcfb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:12.752705 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e957041-4e02-40ab-87b5-365ff97fcfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:12.753247 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e957041-4e02-40ab-87b5-365ff97fcfb7 admin admin] PATH_INFO: `/v3/users/a41212fc006c4b26b151ae200632a0ff` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:12.756646 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e957041-4e02-40ab-87b5-365ff97fcfb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a41212fc006c4b26b151ae200632a0ff)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:12.763122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e957041-4e02-40ab-87b5-365ff97fcfb7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:12.782018 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f4b4d-a588-4848-bd31-514e0e99253b None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:12.782620 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f4b4d-a588-4848-bd31-514e0e99253b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:12.782620 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f4b4d-a588-4848-bd31-514e0e99253b None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:12.784788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 823/1654] 10.222.0.16 () {54 vars in 962 bytes} [Tue Aug 9 02:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:30:12.823279 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83108b-8aa0-4ef1-b17f-66288ebee269 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:12.823826 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83108b-8aa0-4ef1-b17f-66288ebee269 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:12.824225 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83108b-8aa0-4ef1-b17f-66288ebee269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:12.895280 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-bf83108b-8aa0-4ef1-b17f-66288ebee269 None None] MFA Rules not processed for user `78fff294b9794a26aa1bbc231fa1133c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:12.900435 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-bf83108b-8aa0-4ef1-b17f-66288ebee269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:12.915734 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9e957041-4e02-40ab-87b5-365ff97fcfb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a41212fc006c4b26b151ae200632a0ff'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:12.937271 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 824/1655] 10.222.0.16 () {58 vars in 1059 bytes} [Tue Aug 9 02:30:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:12.939761 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9e957041-4e02-40ab-87b5-365ff97fcfb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a41212fc006c4b26b151ae200632a0ff'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:12.940890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9e957041-4e02-40ab-87b5-365ff97fcfb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a41212fc006c4b26b151ae200632a0ff'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:12.943125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ab582-e4bf-46cc-9129-d62e890e9baa None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:12.943628 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ab582-e4bf-46cc-9129-d62e890e9baa None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:12.944666 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ab582-e4bf-46cc-9129-d62e890e9baa None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:12.958137 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 825/1656] 10.222.0.16 () {54 vars in 912 bytes} [Tue Aug 9 02:30:12 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:30:12.959607 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695b558-74a7-4723-8edf-c39fae0f9436 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:12.964127 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695b558-74a7-4723-8edf-c39fae0f9436 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:12.965331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695b558-74a7-4723-8edf-c39fae0f9436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:12.980479 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9e957041-4e02-40ab-87b5-365ff97fcfb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a41212fc006c4b26b151ae200632a0ff'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:12.997852 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9e957041-4e02-40ab-87b5-365ff97fcfb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a41212fc006c4b26b151ae200632a0ff'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:13.014311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 832/1657] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:30:12 2022] DELETE /identity/v3/users/a41212fc006c4b26b151ae200632a0ff => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:13.060694 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518820d0-cf04-44ae-9875-200d2929782a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:13.060694 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518820d0-cf04-44ae-9875-200d2929782a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:13.060694 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518820d0-cf04-44ae-9875-200d2929782a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:13.060926 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-2695b558-74a7-4723-8edf-c39fae0f9436 None None] MFA Rules not processed for user `78fff294b9794a26aa1bbc231fa1133c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:13.060926 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2695b558-74a7-4723-8edf-c39fae0f9436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:13.060926 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:13.108136 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-518820d0-cf04-44ae-9875-200d2929782a None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:13.111722 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-518820d0-cf04-44ae-9875-200d2929782a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:13.215893 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 826/1658] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 9 02:30:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:13.241915 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695b558-74a7-4723-8edf-c39fae0f9436 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:13.244231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2695b558-74a7-4723-8edf-c39fae0f9436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:13.254543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 833/1659] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:13.346795 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518820d0-cf04-44ae-9875-200d2929782a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:13.359443 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-518820d0-cf04-44ae-9875-200d2929782a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:13.384820 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695b558-74a7-4723-8edf-c39fae0f9436 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:13.393385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d89f0-ce38-4677-bfeb-11457bcc0ad4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:13.404867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d89f0-ce38-4677-bfeb-11457bcc0ad4 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:13.405581 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d89f0-ce38-4677-bfeb-11457bcc0ad4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:13.406017 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d89f0-ce38-4677-bfeb-11457bcc0ad4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:13.433269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d89f0-ce38-4677-bfeb-11457bcc0ad4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:13.436923 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d89f0-ce38-4677-bfeb-11457bcc0ad4 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:13.503790 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 827/1660] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:30:13.571715 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518820d0-cf04-44ae-9875-200d2929782a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:13.587213 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7ed2c-8009-400c-8792-43cdf283149b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:13.588977 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7ed2c-8009-400c-8792-43cdf283149b service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:13.589283 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7ed2c-8009-400c-8792-43cdf283149b service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:13.589764 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7ed2c-8009-400c-8792-43cdf283149b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:13.637705 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7ed2c-8009-400c-8792-43cdf283149b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:13.640201 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7ed2c-8009-400c-8792-43cdf283149b service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:13.664243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 834/1661] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:30:14.374098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d89f0-ce38-4677-bfeb-11457bcc0ad4 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:14.384541 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d89f0-ce38-4677-bfeb-11457bcc0ad4 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:14.396220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26487b27-f0cd-4926-b68d-5e785f5139cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:14.396897 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26487b27-f0cd-4926-b68d-5e785f5139cf service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:14.397379 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26487b27-f0cd-4926-b68d-5e785f5139cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:14.398358 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26487b27-f0cd-4926-b68d-5e785f5139cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:14.403582 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-26487b27-f0cd-4926-b68d-5e785f5139cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:14.647796 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26487b27-f0cd-4926-b68d-5e785f5139cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:14.655928 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26487b27-f0cd-4926-b68d-5e785f5139cf service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:14.715393 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 828/1662] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:17.407539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7ed2c-8009-400c-8792-43cdf283149b service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:17.409697 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-eae7ed2c-8009-400c-8792-43cdf283149b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:17.445181 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7ed2c-8009-400c-8792-43cdf283149b service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:17.458812 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e3d4a-2f39-43a0-bfb8-297143cc1f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:17.466987 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e3d4a-2f39-43a0-bfb8-297143cc1f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:17.467433 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e3d4a-2f39-43a0-bfb8-297143cc1f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:17.467849 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e3d4a-2f39-43a0-bfb8-297143cc1f24 admin admin] PATH_INFO: `/v3/projects/5ee35d91f4494672b97f0b6404fcecfe` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:17.469371 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e3d4a-2f39-43a0-bfb8-297143cc1f24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ee35d91f4494672b97f0b6404fcecfe)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:17.471833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: WARNING py.warnings [None req-985e3d4a-2f39-43a0-bfb8-297143cc1f24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 02:30:17.471833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: warnings.warn(msg) Aug 09 02:30:17.471833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: Aug 09 02:30:17.474105 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e3d4a-2f39-43a0-bfb8-297143cc1f24 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:17.508959 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:17.649954 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-985e3d4a-2f39-43a0-bfb8-297143cc1f24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ee35d91f4494672b97f0b6404fcecfe', 'request_id': 'req-985e3d4a-2f39-43a0-bfb8-297143cc1f24'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:17.668689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-985e3d4a-2f39-43a0-bfb8-297143cc1f24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ee35d91f4494672b97f0b6404fcecfe', 'request_id': 'req-985e3d4a-2f39-43a0-bfb8-297143cc1f24'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:17.711531 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-985e3d4a-2f39-43a0-bfb8-297143cc1f24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ee35d91f4494672b97f0b6404fcecfe', 'request_id': 'req-985e3d4a-2f39-43a0-bfb8-297143cc1f24'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:17.765813 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-985e3d4a-2f39-43a0-bfb8-297143cc1f24 admin admin] The token cache is being invalidate because project 5ee35d91f4494672b97f0b6404fcecfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:30:17.766218 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-985e3d4a-2f39-43a0-bfb8-297143cc1f24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:17.769390 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-985e3d4a-2f39-43a0-bfb8-297143cc1f24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:17.776863 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 835/1663] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:30:17 2022] DELETE /identity/v3/projects/5ee35d91f4494672b97f0b6404fcecfe => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:17.777697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26487b27-f0cd-4926-b68d-5e785f5139cf service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:17.806177 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26487b27-f0cd-4926-b68d-5e785f5139cf service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:17.983827 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:18.006023 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71d43b-c7d6-4785-814e-eb78d5b98c55 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:18.006519 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71d43b-c7d6-4785-814e-eb78d5b98c55 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:18.006915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71d43b-c7d6-4785-814e-eb78d5b98c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:18.080650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604d3bc-8298-4950-ad69-24a22a62a032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:18.082042 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604d3bc-8298-4950-ad69-24a22a62a032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:18.086651 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604d3bc-8298-4950-ad69-24a22a62a032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:18.090787 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604d3bc-8298-4950-ad69-24a22a62a032 admin admin] PATH_INFO: `/v3/users/4c4b6f4cc252404ba17c5429edf2479c` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:18.093397 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604d3bc-8298-4950-ad69-24a22a62a032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c4b6f4cc252404ba17c5429edf2479c)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:18.096611 dv-cinder-852461-1-smb devstack@keystone.service[80286]: WARNING py.warnings [None req-f604d3bc-8298-4950-ad69-24a22a62a032 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 02:30:18.096611 dv-cinder-852461-1-smb devstack@keystone.service[80286]: warnings.warn(msg) Aug 09 02:30:18.096611 dv-cinder-852461-1-smb devstack@keystone.service[80286]: Aug 09 02:30:18.101271 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604d3bc-8298-4950-ad69-24a22a62a032 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:18.145613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ce71d43b-c7d6-4785-814e-eb78d5b98c55 None None] MFA Rules not processed for user `f3e3f74a4757432da1bb1e5f3a7685dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:18.146852 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ce71d43b-c7d6-4785-814e-eb78d5b98c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:18.348275 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f604d3bc-8298-4950-ad69-24a22a62a032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c4b6f4cc252404ba17c5429edf2479c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:18.389509 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f604d3bc-8298-4950-ad69-24a22a62a032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c4b6f4cc252404ba17c5429edf2479c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:18.422516 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 836/1664] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:18.432401 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71d43b-c7d6-4785-814e-eb78d5b98c55 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:18.434121 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ce71d43b-c7d6-4785-814e-eb78d5b98c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:18.435458 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f604d3bc-8298-4950-ad69-24a22a62a032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c4b6f4cc252404ba17c5429edf2479c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:18.436551 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f604d3bc-8298-4950-ad69-24a22a62a032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c4b6f4cc252404ba17c5429edf2479c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:18.496164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f604d3bc-8298-4950-ad69-24a22a62a032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c4b6f4cc252404ba17c5429edf2479c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:18.519531 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 829/1665] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:30:17 2022] DELETE /identity/v3/users/4c4b6f4cc252404ba17c5429edf2479c => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:18.543902 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604d3bc-8298-4950-ad69-24a22a62a032 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:18.544062 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f604d3bc-8298-4950-ad69-24a22a62a032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:18.716031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604d3bc-8298-4950-ad69-24a22a62a032 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:18.734378 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71d43b-c7d6-4785-814e-eb78d5b98c55 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:18.741427 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eba39e-10aa-4063-ba17-0e7b04241a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:18.742292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eba39e-10aa-4063-ba17-0e7b04241a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:18.742726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eba39e-10aa-4063-ba17-0e7b04241a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:18.743157 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eba39e-10aa-4063-ba17-0e7b04241a46 admin admin] PATH_INFO: `/v3/users/06434efdc06940999ec26d455836d0b3` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:18.745253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eba39e-10aa-4063-ba17-0e7b04241a46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06434efdc06940999ec26d455836d0b3)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:18.747381 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eba39e-10aa-4063-ba17-0e7b04241a46 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:18.820997 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:18.877051 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-52eba39e-10aa-4063-ba17-0e7b04241a46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06434efdc06940999ec26d455836d0b3'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:18.891027 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-52eba39e-10aa-4063-ba17-0e7b04241a46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06434efdc06940999ec26d455836d0b3'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:18.920412 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-52eba39e-10aa-4063-ba17-0e7b04241a46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06434efdc06940999ec26d455836d0b3'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:18.921146 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-52eba39e-10aa-4063-ba17-0e7b04241a46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06434efdc06940999ec26d455836d0b3'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:18.922616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:18.956163 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-52eba39e-10aa-4063-ba17-0e7b04241a46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06434efdc06940999ec26d455836d0b3'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:18.989991 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 830/1666] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:30:18 2022] DELETE /identity/v3/users/06434efdc06940999ec26d455836d0b3 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:18.990092 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4beec2-2d16-4ac3-86a8-a2990fe267ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:18.990092 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4beec2-2d16-4ac3-86a8-a2990fe267ed service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:18.990092 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4beec2-2d16-4ac3-86a8-a2990fe267ed service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:18.990092 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4beec2-2d16-4ac3-86a8-a2990fe267ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:18.991068 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a08c1-4167-4148-9d64-ed9a720f6793 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:18.991068 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a08c1-4167-4148-9d64-ed9a720f6793 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:18.991202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a08c1-4167-4148-9d64-ed9a720f6793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:18.998020 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3f4beec2-2d16-4ac3-86a8-a2990fe267ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:19.068469 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-6d4a08c1-4167-4148-9d64-ed9a720f6793 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:19.069742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6d4a08c1-4167-4148-9d64-ed9a720f6793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:19.233002 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4beec2-2d16-4ac3-86a8-a2990fe267ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:19.237514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4beec2-2d16-4ac3-86a8-a2990fe267ed service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:19.258920 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 837/1667] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 828 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:19.377841 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 831/1668] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:19.510805 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4beec2-2d16-4ac3-86a8-a2990fe267ed service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:19.514484 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3f4beec2-2d16-4ac3-86a8-a2990fe267ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:19.594098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4beec2-2d16-4ac3-86a8-a2990fe267ed service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:19.617340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded65586-0079-47d4-85c8-890b4b48e3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:19.618004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded65586-0079-47d4-85c8-890b4b48e3d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:19.618288 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded65586-0079-47d4-85c8-890b4b48e3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:19.618564 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded65586-0079-47d4-85c8-890b4b48e3d2 admin admin] PATH_INFO: `/v3/users/dde28f90b51a424299a9786d407baa72` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:19.619902 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded65586-0079-47d4-85c8-890b4b48e3d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dde28f90b51a424299a9786d407baa72)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:19.622033 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded65586-0079-47d4-85c8-890b4b48e3d2 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:19.749875 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a08c1-4167-4148-9d64-ed9a720f6793 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:19.751355 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6d4a08c1-4167-4148-9d64-ed9a720f6793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:19.798839 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ded65586-0079-47d4-85c8-890b4b48e3d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dde28f90b51a424299a9786d407baa72'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:19.831881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ded65586-0079-47d4-85c8-890b4b48e3d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dde28f90b51a424299a9786d407baa72'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:19.834893 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ded65586-0079-47d4-85c8-890b4b48e3d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dde28f90b51a424299a9786d407baa72'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:19.874863 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ded65586-0079-47d4-85c8-890b4b48e3d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dde28f90b51a424299a9786d407baa72'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:19.923335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ded65586-0079-47d4-85c8-890b4b48e3d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dde28f90b51a424299a9786d407baa72'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:19.938940 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 838/1669] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:30:19 2022] DELETE /identity/v3/users/dde28f90b51a424299a9786d407baa72 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:19.943093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd08ba-401d-44f2-aef7-c2dcdb448597 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:19.943717 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd08ba-401d-44f2-aef7-c2dcdb448597 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:19.944425 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd08ba-401d-44f2-aef7-c2dcdb448597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:19.962316 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a08c1-4167-4148-9d64-ed9a720f6793 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:20.036542 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-32fd08ba-401d-44f2-aef7-c2dcdb448597 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:20.048371 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-32fd08ba-401d-44f2-aef7-c2dcdb448597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:20.139431 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a4621-5d94-4698-9c68-1cc1750c6902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:20.141107 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a4621-5d94-4698-9c68-1cc1750c6902 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:20.141557 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a4621-5d94-4698-9c68-1cc1750c6902 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:20.143260 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a4621-5d94-4698-9c68-1cc1750c6902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:20.147574 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-180a4621-5d94-4698-9c68-1cc1750c6902 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:20.202657 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:20.284802 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 839/1670] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:20.285869 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd08ba-401d-44f2-aef7-c2dcdb448597 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:20.287183 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-32fd08ba-401d-44f2-aef7-c2dcdb448597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:20.326090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd08ba-401d-44f2-aef7-c2dcdb448597 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:20.335537 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a1669-03da-4034-acaa-4ab4a04c5072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:20.336183 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a1669-03da-4034-acaa-4ab4a04c5072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:20.336530 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a1669-03da-4034-acaa-4ab4a04c5072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:20.336811 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a1669-03da-4034-acaa-4ab4a04c5072 admin admin] PATH_INFO: `/v3/projects/ff9d69a58d7040429244b54deebdbb6a` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:20.338665 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a1669-03da-4034-acaa-4ab4a04c5072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff9d69a58d7040429244b54deebdbb6a)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:20.341324 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a1669-03da-4034-acaa-4ab4a04c5072 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:20.414060 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dc1a1669-03da-4034-acaa-4ab4a04c5072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff9d69a58d7040429244b54deebdbb6a', 'request_id': 'req-dc1a1669-03da-4034-acaa-4ab4a04c5072'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:20.426493 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:20.428525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dc1a1669-03da-4034-acaa-4ab4a04c5072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff9d69a58d7040429244b54deebdbb6a', 'request_id': 'req-dc1a1669-03da-4034-acaa-4ab4a04c5072'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:20.436880 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dc1a1669-03da-4034-acaa-4ab4a04c5072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff9d69a58d7040429244b54deebdbb6a', 'request_id': 'req-dc1a1669-03da-4034-acaa-4ab4a04c5072'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:20.474575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dc1a1669-03da-4034-acaa-4ab4a04c5072 admin admin] The token cache is being invalidate because project ff9d69a58d7040429244b54deebdbb6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:30:20.474575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dc1a1669-03da-4034-acaa-4ab4a04c5072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:20.474575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dc1a1669-03da-4034-acaa-4ab4a04c5072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:20.474575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 840/1671] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:30:20 2022] DELETE /identity/v3/projects/ff9d69a58d7040429244b54deebdbb6a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:20.474575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a1669-03da-4034-acaa-4ab4a04c5072 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:20.476890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-dc1a1669-03da-4034-acaa-4ab4a04c5072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:20.565686 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a4621-5d94-4698-9c68-1cc1750c6902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:20.574674 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a4621-5d94-4698-9c68-1cc1750c6902 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:20.615318 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 832/1672] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 866 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:20.616638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a76164-62bc-4d86-940d-9fce3e04bd09 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:20.616923 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a76164-62bc-4d86-940d-9fce3e04bd09 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:20.617241 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a76164-62bc-4d86-940d-9fce3e04bd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:20.672969 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-63a76164-62bc-4d86-940d-9fce3e04bd09 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:20.673804 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a1669-03da-4034-acaa-4ab4a04c5072 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:20.676494 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-63a76164-62bc-4d86-940d-9fce3e04bd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:20.689958 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a203e9-92c9-45c6-9215-8cd21a243eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:20.693728 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a203e9-92c9-45c6-9215-8cd21a243eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:20.695211 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a203e9-92c9-45c6-9215-8cd21a243eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:20.695211 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a203e9-92c9-45c6-9215-8cd21a243eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:20.714078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a5a203e9-92c9-45c6-9215-8cd21a243eb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:20.908746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 833/1673] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:20.910501 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15ff3c-6090-49ca-90b4-682b27092c51 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:20.910949 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15ff3c-6090-49ca-90b4-682b27092c51 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:20.911373 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b15ff3c-6090-49ca-90b4-682b27092c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:20.928450 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a203e9-92c9-45c6-9215-8cd21a243eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:20.939843 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a203e9-92c9-45c6-9215-8cd21a243eb3 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:20.996437 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 841/1674] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:20.997809 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2a9d1-5976-4b6f-a307-bd8c2df14570 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:20.998092 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2a9d1-5976-4b6f-a307-bd8c2df14570 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:20.998364 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2a9d1-5976-4b6f-a307-bd8c2df14570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:21.004403 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-3b15ff3c-6090-49ca-90b4-682b27092c51 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:21.010658 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3b15ff3c-6090-49ca-90b4-682b27092c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:21.052081 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 834/1675] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:21.058939 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15ff3c-6090-49ca-90b4-682b27092c51 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:21.087125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b15ff3c-6090-49ca-90b4-682b27092c51 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:21.092372 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:21.107329 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de466172-afc5-4e04-964d-38a0885a9a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:21.109773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de466172-afc5-4e04-964d-38a0885a9a92 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:21.111294 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de466172-afc5-4e04-964d-38a0885a9a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:21.113602 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de466172-afc5-4e04-964d-38a0885a9a92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:21.117331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de466172-afc5-4e04-964d-38a0885a9a92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:30:21.118353 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de466172-afc5-4e04-964d-38a0885a9a92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:21.122139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-58c2a9d1-5976-4b6f-a307-bd8c2df14570 None None] MFA Rules not processed for user `74066ca220c8440c820728722f979f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:21.123520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de466172-afc5-4e04-964d-38a0885a9a92 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:21.124118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-58c2a9d1-5976-4b6f-a307-bd8c2df14570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:21.172208 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 835/1676] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:30:21.179445 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de466172-afc5-4e04-964d-38a0885a9a92 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:21.212558 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de466172-afc5-4e04-964d-38a0885a9a92 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:21.245908 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf93599-9308-4d26-9156-1e530c03b826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:21.247135 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf93599-9308-4d26-9156-1e530c03b826 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:21.247679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf93599-9308-4d26-9156-1e530c03b826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:21.248178 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf93599-9308-4d26-9156-1e530c03b826 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:21.249495 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf93599-9308-4d26-9156-1e530c03b826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:21.256612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf93599-9308-4d26-9156-1e530c03b826 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:21.348745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 836/1677] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:21 2022] POST /identity/v3/projects => generated 363 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:30:21.349472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf93599-9308-4d26-9156-1e530c03b826 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:21.375325 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 842/1678] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:21.386062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6cb82-64ca-48cb-a6d6-522525ae7042 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:21.386697 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6cb82-64ca-48cb-a6d6-522525ae7042 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:21.386818 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6cb82-64ca-48cb-a6d6-522525ae7042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:21.441560 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b5e6cb82-64ca-48cb-a6d6-522525ae7042 None None] MFA Rules not processed for user `74066ca220c8440c820728722f979f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:21.452011 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b5e6cb82-64ca-48cb-a6d6-522525ae7042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:21.476423 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf93599-9308-4d26-9156-1e530c03b826 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:21.495146 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fd56e-2974-4d26-ad87-cbe79906e144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:21.495570 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fd56e-2974-4d26-ad87-cbe79906e144 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:21.495860 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fd56e-2974-4d26-ad87-cbe79906e144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:21.496137 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17fd56e-2974-4d26-ad87-cbe79906e144 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:21.496780 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17fd56e-2974-4d26-ad87-cbe79906e144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:21.498948 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17fd56e-2974-4d26-ad87-cbe79906e144 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:21.538810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 843/1679] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:30:21.558125 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6cb82-64ca-48cb-a6d6-522525ae7042 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:21.560823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b5e6cb82-64ca-48cb-a6d6-522525ae7042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:21.564506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 837/1680] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:21 2022] POST /identity/v3/users => generated 282 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:21.565451 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fd56e-2974-4d26-ad87-cbe79906e144 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:21.589607 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17fd56e-2974-4d26-ad87-cbe79906e144 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:21.605681 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e5e01-75cd-4b04-9c1f-72d0b31daebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:21.607064 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e5e01-75cd-4b04-9c1f-72d0b31daebd admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:21.607804 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e5e01-75cd-4b04-9c1f-72d0b31daebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:21.608225 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e5e01-75cd-4b04-9c1f-72d0b31daebd admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:21.609187 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e5e01-75cd-4b04-9c1f-72d0b31daebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:21.618968 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e5e01-75cd-4b04-9c1f-72d0b31daebd admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:21.644813 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 838/1681] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:21.645943 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e5e01-75cd-4b04-9c1f-72d0b31daebd admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:21.674589 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e5e01-75cd-4b04-9c1f-72d0b31daebd admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:21.693333 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ddc0b-c819-4b3c-aa2b-8fe272ae6500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:21.701078 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ddc0b-c819-4b3c-aa2b-8fe272ae6500 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:21.701707 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ddc0b-c819-4b3c-aa2b-8fe272ae6500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:21.704674 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ddc0b-c819-4b3c-aa2b-8fe272ae6500 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:21.707804 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ddc0b-c819-4b3c-aa2b-8fe272ae6500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:21.710709 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ddc0b-c819-4b3c-aa2b-8fe272ae6500 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:21.760937 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 839/1682] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:21.770322 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ddc0b-c819-4b3c-aa2b-8fe272ae6500 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:21.795958 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ddc0b-c819-4b3c-aa2b-8fe272ae6500 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:21.803989 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6cb82-64ca-48cb-a6d6-522525ae7042 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:21.808451 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f8e262-fb30-4743-adbc-6d893142a40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:21.809538 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8e262-fb30-4743-adbc-6d893142a40a admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:21.810186 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8e262-fb30-4743-adbc-6d893142a40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:21.810470 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f8e262-fb30-4743-adbc-6d893142a40a admin admin] PATH_INFO: `/v3/projects/6cdef5f1275546b38daca2761787a8a7/users/78d2eb105c3c4c29ab6d4187d5b4cf02/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:21.814693 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205f2b4-ba9c-4f2f-bf32-1e292227abd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:21.815304 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205f2b4-ba9c-4f2f-bf32-1e292227abd7 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:21.816101 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205f2b4-ba9c-4f2f-bf32-1e292227abd7 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:21.816901 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205f2b4-ba9c-4f2f-bf32-1e292227abd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:21.824510 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:21.832998 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205f2b4-ba9c-4f2f-bf32-1e292227abd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:21.837226 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205f2b4-ba9c-4f2f-bf32-1e292227abd7 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:21.840408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8e262-fb30-4743-adbc-6d893142a40a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cdef5f1275546b38daca2761787a8a7, user_id=78d2eb105c3c4c29ab6d4187d5b4cf02, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:21.843398 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f8e262-fb30-4743-adbc-6d893142a40a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:21.855120 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 844/1683] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:30:21.856344 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205f2b4-ba9c-4f2f-bf32-1e292227abd7 service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:21.858502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d205f2b4-ba9c-4f2f-bf32-1e292227abd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:21.866649 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 840/1684] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:21 2022] PUT /identity/v3/projects/6cdef5f1275546b38daca2761787a8a7/users/78d2eb105c3c4c29ab6d4187d5b4cf02/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:21.877218 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47700e-6c07-437b-844b-ce9cf30f9ffe None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:21.877558 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205f2b4-ba9c-4f2f-bf32-1e292227abd7 service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:21.878041 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47700e-6c07-437b-844b-ce9cf30f9ffe None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:21.878613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47700e-6c07-437b-844b-ce9cf30f9ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:21.914605 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:21.941221 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-ac47700e-6c07-437b-844b-ce9cf30f9ffe None None] MFA Rules not processed for user `78d2eb105c3c4c29ab6d4187d5b4cf02`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:21.943089 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ac47700e-6c07-437b-844b-ce9cf30f9ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:22.000978 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef342a-cd15-4e8b-859c-c2300f06acaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:22.012470 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef342a-cd15-4e8b-859c-c2300f06acaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:22.012752 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef342a-cd15-4e8b-859c-c2300f06acaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:22.013059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef342a-cd15-4e8b-859c-c2300f06acaa admin admin] PATH_INFO: `/v3/projects/fdfc9c3aed6744b6b5d36879079acf3f` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:22.016517 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef342a-cd15-4e8b-859c-c2300f06acaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdfc9c3aed6744b6b5d36879079acf3f)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:22.021959 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef342a-cd15-4e8b-859c-c2300f06acaa admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:22.165194 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 841/1685] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:30:22.167243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47700e-6c07-437b-844b-ce9cf30f9ffe None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:22.177957 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c9ef342a-cd15-4e8b-859c-c2300f06acaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdfc9c3aed6744b6b5d36879079acf3f', 'request_id': 'req-c9ef342a-cd15-4e8b-859c-c2300f06acaa'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:22.185675 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47700e-6c07-437b-844b-ce9cf30f9ffe None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:22.191447 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c9ef342a-cd15-4e8b-859c-c2300f06acaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdfc9c3aed6744b6b5d36879079acf3f', 'request_id': 'req-c9ef342a-cd15-4e8b-859c-c2300f06acaa'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:22.203234 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c9ef342a-cd15-4e8b-859c-c2300f06acaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdfc9c3aed6744b6b5d36879079acf3f', 'request_id': 'req-c9ef342a-cd15-4e8b-859c-c2300f06acaa'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:22.236640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c9ef342a-cd15-4e8b-859c-c2300f06acaa admin admin] The token cache is being invalidate because project fdfc9c3aed6744b6b5d36879079acf3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:30:22.237297 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c9ef342a-cd15-4e8b-859c-c2300f06acaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:22.241327 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c9ef342a-cd15-4e8b-859c-c2300f06acaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:22.247308 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 845/1686] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:30:21 2022] DELETE /identity/v3/projects/fdfc9c3aed6744b6b5d36879079acf3f => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:22.248375 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef342a-cd15-4e8b-859c-c2300f06acaa admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:22.252037 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c9ef342a-cd15-4e8b-859c-c2300f06acaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:22.343412 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08e364-37f7-4ad9-80c0-1e08cf84c220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:22.345121 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08e364-37f7-4ad9-80c0-1e08cf84c220 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:22.348145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08e364-37f7-4ad9-80c0-1e08cf84c220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:22.348454 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08e364-37f7-4ad9-80c0-1e08cf84c220 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:22.349209 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08e364-37f7-4ad9-80c0-1e08cf84c220 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:22.354557 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08e364-37f7-4ad9-80c0-1e08cf84c220 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:22.449425 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef342a-cd15-4e8b-859c-c2300f06acaa admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:22.451273 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 842/1687] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:22 2022] POST /identity/v3/projects => generated 365 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:30:22.454865 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08e364-37f7-4ad9-80c0-1e08cf84c220 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:22.458625 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-fb08e364-37f7-4ad9-80c0-1e08cf84c220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:22.596270 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03bda9-c9fb-477a-9caf-dcd744fd4cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:22.596944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03bda9-c9fb-477a-9caf-dcd744fd4cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:22.597287 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03bda9-c9fb-477a-9caf-dcd744fd4cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:22.597569 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03bda9-c9fb-477a-9caf-dcd744fd4cc4 admin admin] PATH_INFO: `/v3/users/238d3b9e18e1498e840480a70b103681` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:22.598087 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08e364-37f7-4ad9-80c0-1e08cf84c220 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:22.604270 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03bda9-c9fb-477a-9caf-dcd744fd4cc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=238d3b9e18e1498e840480a70b103681)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:22.610149 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95d2d0-bcb9-44ce-b783-cd6a7ed1694e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:22.613612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95d2d0-bcb9-44ce-b783-cd6a7ed1694e admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:22.613901 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95d2d0-bcb9-44ce-b783-cd6a7ed1694e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:22.616266 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95d2d0-bcb9-44ce-b783-cd6a7ed1694e admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:22.618631 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95d2d0-bcb9-44ce-b783-cd6a7ed1694e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:22.622083 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03bda9-c9fb-477a-9caf-dcd744fd4cc4 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:22.623036 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95d2d0-bcb9-44ce-b783-cd6a7ed1694e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:22.636778 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:22.657386 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:22.695991 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 843/1688] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:22 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:30:22.700818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95d2d0-bcb9-44ce-b783-cd6a7ed1694e admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:22.727332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95d2d0-bcb9-44ce-b783-cd6a7ed1694e admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:22.738875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ee03bda9-c9fb-477a-9caf-dcd744fd4cc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '238d3b9e18e1498e840480a70b103681'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:22.745289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db28ef2-a90c-43fe-b778-247954f3f82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:22.745941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db28ef2-a90c-43fe-b778-247954f3f82e admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:22.746232 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db28ef2-a90c-43fe-b778-247954f3f82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:22.746513 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db28ef2-a90c-43fe-b778-247954f3f82e admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:22.747496 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db28ef2-a90c-43fe-b778-247954f3f82e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:22.762695 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db28ef2-a90c-43fe-b778-247954f3f82e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:22.771563 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ee03bda9-c9fb-477a-9caf-dcd744fd4cc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '238d3b9e18e1498e840480a70b103681'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:22.772357 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ee03bda9-c9fb-477a-9caf-dcd744fd4cc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '238d3b9e18e1498e840480a70b103681'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:22.790346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 844/1689] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:22.794076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ee03bda9-c9fb-477a-9caf-dcd744fd4cc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '238d3b9e18e1498e840480a70b103681'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:22.797621 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db28ef2-a90c-43fe-b778-247954f3f82e admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:22.802346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8db28ef2-a90c-43fe-b778-247954f3f82e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:22.807400 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ee03bda9-c9fb-477a-9caf-dcd744fd4cc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '238d3b9e18e1498e840480a70b103681'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:22.815469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 846/1690] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:30:22 2022] DELETE /identity/v3/users/238d3b9e18e1498e840480a70b103681 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:22.829132 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db28ef2-a90c-43fe-b778-247954f3f82e admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:22.927662 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612b891-05be-4349-a099-f90a146064fb None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:22.927963 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612b891-05be-4349-a099-f90a146064fb None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:22.928249 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612b891-05be-4349-a099-f90a146064fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:23.026644 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f49a81-5233-48e9-8315-112e193297aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:23.027814 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f49a81-5233-48e9-8315-112e193297aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:23.028104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f49a81-5233-48e9-8315-112e193297aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:23.028394 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f49a81-5233-48e9-8315-112e193297aa admin admin] PATH_INFO: `/v3/projects/b92a5b8ec6c944b7b79d8951d447e5dd/users/4337345a95ff4f759c824865a1f223db/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:23.041860 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9612b891-05be-4349-a099-f90a146064fb None None] MFA Rules not processed for user `0b20525bc3124888bbb1decbae15d3c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:23.045286 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9612b891-05be-4349-a099-f90a146064fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:23.064611 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f49a81-5233-48e9-8315-112e193297aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b92a5b8ec6c944b7b79d8951d447e5dd, user_id=4337345a95ff4f759c824865a1f223db, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:23.068805 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f49a81-5233-48e9-8315-112e193297aa admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:23.094760 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 845/1691] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:22 2022] PUT /identity/v3/projects/b92a5b8ec6c944b7b79d8951d447e5dd/users/4337345a95ff4f759c824865a1f223db/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:23.098767 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f49a81-5233-48e9-8315-112e193297aa admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:23.190675 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 847/1692] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:23.197479 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612b891-05be-4349-a099-f90a146064fb None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:23.201382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9612b891-05be-4349-a099-f90a146064fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:23.326220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f49a81-5233-48e9-8315-112e193297aa admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:23.337359 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f4fb4-cc02-476b-9060-35862df7ac4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:23.339276 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f4fb4-cc02-476b-9060-35862df7ac4e admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:23.340575 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f4fb4-cc02-476b-9060-35862df7ac4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:23.340575 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f4fb4-cc02-476b-9060-35862df7ac4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:23.347107 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f4fb4-cc02-476b-9060-35862df7ac4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:23.356197 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f4fb4-cc02-476b-9060-35862df7ac4e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:23.401450 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 846/1693] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:23.405333 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e771e-e8cd-4a22-8e44-4f78c2ce8265 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:23.406122 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e771e-e8cd-4a22-8e44-4f78c2ce8265 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:23.406433 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e771e-e8cd-4a22-8e44-4f78c2ce8265 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:23.417698 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 847/1694] 10.222.0.16 () {54 vars in 912 bytes} [Tue Aug 9 02:30:23 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:30:23.421161 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e771e-e8cd-4a22-8e44-4f78c2ce8265 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:23.457988 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e771e-e8cd-4a22-8e44-4f78c2ce8265 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:23.474814 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c06c3-5a73-42e2-8c05-386ba3c9297d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:23.475648 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c06c3-5a73-42e2-8c05-386ba3c9297d admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:23.475944 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c06c3-5a73-42e2-8c05-386ba3c9297d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:23.476220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c06c3-5a73-42e2-8c05-386ba3c9297d admin admin] PATH_INFO: `/v3/projects/b92a5b8ec6c944b7b79d8951d447e5dd/users/4337345a95ff4f759c824865a1f223db/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:23.480296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c06c3-5a73-42e2-8c05-386ba3c9297d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b92a5b8ec6c944b7b79d8951d447e5dd, user_id=4337345a95ff4f759c824865a1f223db, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:23.484044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612b891-05be-4349-a099-f90a146064fb None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:23.487275 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c06c3-5a73-42e2-8c05-386ba3c9297d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:23.519055 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:23.554327 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 848/1695] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:23 2022] PUT /identity/v3/projects/b92a5b8ec6c944b7b79d8951d447e5dd/users/4337345a95ff4f759c824865a1f223db/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:23.558745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb501fe-4efb-40c2-815e-f54ba3c02917 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:23.560336 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb501fe-4efb-40c2-815e-f54ba3c02917 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:23.560688 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb501fe-4efb-40c2-815e-f54ba3c02917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:23.665819 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-dbb501fe-4efb-40c2-815e-f54ba3c02917 None None] MFA Rules not processed for user `d608fede6f5e4b339f8de0354cc0562b`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:23.667225 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-dbb501fe-4efb-40c2-815e-f54ba3c02917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:23.695433 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f026dd-75e5-4df1-a488-4e2ed25d73ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:23.699160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f026dd-75e5-4df1-a488-4e2ed25d73ac service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:23.699498 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f026dd-75e5-4df1-a488-4e2ed25d73ac service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:23.703613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f026dd-75e5-4df1-a488-4e2ed25d73ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:23.743419 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:23.800255 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 849/1696] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 9 02:30:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:23.803477 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb501fe-4efb-40c2-815e-f54ba3c02917 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:23.829152 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-dbb501fe-4efb-40c2-815e-f54ba3c02917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:23.843749 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f026dd-75e5-4df1-a488-4e2ed25d73ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:23.849583 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f026dd-75e5-4df1-a488-4e2ed25d73ac service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:23.881144 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 848/1697] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:23.894649 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f026dd-75e5-4df1-a488-4e2ed25d73ac service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:23.897533 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a3f026dd-75e5-4df1-a488-4e2ed25d73ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:23.952110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f026dd-75e5-4df1-a488-4e2ed25d73ac service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:24.108416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb501fe-4efb-40c2-815e-f54ba3c02917 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:24.138020 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe697634-8607-4d9b-b833-816f82f39468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:24.138699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe697634-8607-4d9b-b833-816f82f39468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:24.139081 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe697634-8607-4d9b-b833-816f82f39468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:24.139481 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe697634-8607-4d9b-b833-816f82f39468 admin admin] PATH_INFO: `/v3/projects/de8b40a31f43457f813fa2437c96ac0b` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:24.144639 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe697634-8607-4d9b-b833-816f82f39468 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de8b40a31f43457f813fa2437c96ac0b)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:24.148033 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe697634-8607-4d9b-b833-816f82f39468 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:24.238690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669401b-51c7-4bc8-b9ae-63a1fc1bba0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:24.242100 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669401b-51c7-4bc8-b9ae-63a1fc1bba0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:24.244616 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669401b-51c7-4bc8-b9ae-63a1fc1bba0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:24.250033 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669401b-51c7-4bc8-b9ae-63a1fc1bba0f admin admin] PATH_INFO: `/v3/projects/35b326a31f09492ea5af27014c8e9704` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:24.255172 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669401b-51c7-4bc8-b9ae-63a1fc1bba0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=35b326a31f09492ea5af27014c8e9704)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:24.268612 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669401b-51c7-4bc8-b9ae-63a1fc1bba0f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:24.338802 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-fe697634-8607-4d9b-b833-816f82f39468 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de8b40a31f43457f813fa2437c96ac0b', 'request_id': 'req-fe697634-8607-4d9b-b833-816f82f39468'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:24.361702 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-fe697634-8607-4d9b-b833-816f82f39468 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de8b40a31f43457f813fa2437c96ac0b', 'request_id': 'req-fe697634-8607-4d9b-b833-816f82f39468'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:24.386585 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-fe697634-8607-4d9b-b833-816f82f39468 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de8b40a31f43457f813fa2437c96ac0b', 'request_id': 'req-fe697634-8607-4d9b-b833-816f82f39468'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:24.430868 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-fe697634-8607-4d9b-b833-816f82f39468 admin admin] The token cache is being invalidate because project de8b40a31f43457f813fa2437c96ac0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:30:24.434214 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-fe697634-8607-4d9b-b833-816f82f39468 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:24.437358 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-fe697634-8607-4d9b-b833-816f82f39468 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:24.443850 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 850/1698] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:30:23 2022] DELETE /identity/v3/projects/de8b40a31f43457f813fa2437c96ac0b => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:24.453248 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10119bef-d36d-4629-ae75-0b3cf0d1dc8f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:24.453403 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10119bef-d36d-4629-ae75-0b3cf0d1dc8f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:24.453683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10119bef-d36d-4629-ae75-0b3cf0d1dc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:24.480887 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8669401b-51c7-4bc8-b9ae-63a1fc1bba0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35b326a31f09492ea5af27014c8e9704', 'request_id': 'req-8669401b-51c7-4bc8-b9ae-63a1fc1bba0f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:24.492478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:24.504655 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8669401b-51c7-4bc8-b9ae-63a1fc1bba0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35b326a31f09492ea5af27014c8e9704', 'request_id': 'req-8669401b-51c7-4bc8-b9ae-63a1fc1bba0f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:24.517399 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8669401b-51c7-4bc8-b9ae-63a1fc1bba0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35b326a31f09492ea5af27014c8e9704', 'request_id': 'req-8669401b-51c7-4bc8-b9ae-63a1fc1bba0f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:24.540791 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8669401b-51c7-4bc8-b9ae-63a1fc1bba0f admin admin] The token cache is being invalidate because project 35b326a31f09492ea5af27014c8e9704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:30:24.541579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8669401b-51c7-4bc8-b9ae-63a1fc1bba0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:24.542858 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8669401b-51c7-4bc8-b9ae-63a1fc1bba0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:24.551532 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-10119bef-d36d-4629-ae75-0b3cf0d1dc8f None None] MFA Rules not processed for user `4337345a95ff4f759c824865a1f223db`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:24.553067 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-10119bef-d36d-4629-ae75-0b3cf0d1dc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:24.562043 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 849/1699] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:30:23 2022] DELETE /identity/v3/projects/35b326a31f09492ea5af27014c8e9704 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:24.574393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669401b-51c7-4bc8-b9ae-63a1fc1bba0f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:24.576042 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8669401b-51c7-4bc8-b9ae-63a1fc1bba0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:24.685450 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669401b-51c7-4bc8-b9ae-63a1fc1bba0f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:24.690315 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e5ca0-dfeb-4497-bc27-ad02198cf3af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:24.690944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e5ca0-dfeb-4497-bc27-ad02198cf3af service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:24.691230 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e5ca0-dfeb-4497-bc27-ad02198cf3af service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:24.691508 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e5ca0-dfeb-4497-bc27-ad02198cf3af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:24.693563 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8b9e5ca0-dfeb-4497-bc27-ad02198cf3af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:24.711689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e5ca0-dfeb-4497-bc27-ad02198cf3af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:24.713571 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e5ca0-dfeb-4497-bc27-ad02198cf3af service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:24.731743 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 850/1700] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:24.733172 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421c6dc-874b-4133-863a-57113273d319 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:24.733463 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421c6dc-874b-4133-863a-57113273d319 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:24.733789 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421c6dc-874b-4133-863a-57113273d319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:24.785244 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d421c6dc-874b-4133-863a-57113273d319 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:24.791661 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d421c6dc-874b-4133-863a-57113273d319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:24.875383 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:24.886726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 851/1701] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:24.888464 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed238660-3827-4f77-a82f-4c230feb8b67 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:24.888918 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed238660-3827-4f77-a82f-4c230feb8b67 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:24.890056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed238660-3827-4f77-a82f-4c230feb8b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:24.934012 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-ed238660-3827-4f77-a82f-4c230feb8b67 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:24.938108 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ed238660-3827-4f77-a82f-4c230feb8b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:24.968015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 851/1702] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:24.970550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421c6dc-874b-4133-863a-57113273d319 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:24.979638 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d421c6dc-874b-4133-863a-57113273d319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:25.089934 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421c6dc-874b-4133-863a-57113273d319 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:25.102335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe07b2b-dbf4-431c-ae6a-fb6edc004b82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:25.102987 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe07b2b-dbf4-431c-ae6a-fb6edc004b82 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:25.106747 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe07b2b-dbf4-431c-ae6a-fb6edc004b82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:25.106919 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe07b2b-dbf4-431c-ae6a-fb6edc004b82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:25.132936 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 852/1703] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:25.136716 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c946d89-31c8-4e97-9a9a-2ff70dcc1761 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:25.137313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c946d89-31c8-4e97-9a9a-2ff70dcc1761 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:25.139518 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c946d89-31c8-4e97-9a9a-2ff70dcc1761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:25.148472 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe07b2b-dbf4-431c-ae6a-fb6edc004b82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:25.186117 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-4c946d89-31c8-4e97-9a9a-2ff70dcc1761 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:25.192110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe07b2b-dbf4-431c-ae6a-fb6edc004b82 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:25.192930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4c946d89-31c8-4e97-9a9a-2ff70dcc1761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:25.213202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 853/1704] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:25.213202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5baa8b-870e-4140-9310-cced056b8f2f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:25.213202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5baa8b-870e-4140-9310-cced056b8f2f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:25.213202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5baa8b-870e-4140-9310-cced056b8f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:25.218778 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 852/1705] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:25.221794 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe07b2b-dbf4-431c-ae6a-fb6edc004b82 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:25.253812 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe07b2b-dbf4-431c-ae6a-fb6edc004b82 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:25.266198 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08e093-1c40-4b7d-9baa-e32e77e24646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:25.266848 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08e093-1c40-4b7d-9baa-e32e77e24646 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:25.267130 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08e093-1c40-4b7d-9baa-e32e77e24646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:25.267516 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08e093-1c40-4b7d-9baa-e32e77e24646 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:25.268082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08e093-1c40-4b7d-9baa-e32e77e24646 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:30:25.268394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08e093-1c40-4b7d-9baa-e32e77e24646 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:25.271487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08e093-1c40-4b7d-9baa-e32e77e24646 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:25.272453 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-6e5baa8b-870e-4140-9310-cced056b8f2f None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:25.273759 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6e5baa8b-870e-4140-9310-cced056b8f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:25.311647 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 853/1706] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:30:25.311647 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08e093-1c40-4b7d-9baa-e32e77e24646 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:25.312317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 854/1707] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:25.313471 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5baa8b-870e-4140-9310-cced056b8f2f None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:25.338556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08e093-1c40-4b7d-9baa-e32e77e24646 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:25.344178 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5433fb-ca94-4ed0-a8cd-2878b06f3781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:25.344813 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5433fb-ca94-4ed0-a8cd-2878b06f3781 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:25.345197 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5433fb-ca94-4ed0-a8cd-2878b06f3781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:25.345472 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5433fb-ca94-4ed0-a8cd-2878b06f3781 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:25.346136 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5433fb-ca94-4ed0-a8cd-2878b06f3781 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:30:25.346439 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5433fb-ca94-4ed0-a8cd-2878b06f3781 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:25.348061 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5433fb-ca94-4ed0-a8cd-2878b06f3781 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:25.348678 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5baa8b-870e-4140-9310-cced056b8f2f None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:25.361418 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:25.364014 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 854/1708] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:30:25.368583 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5433fb-ca94-4ed0-a8cd-2878b06f3781 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:25.370841 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccec29-2a4b-4faf-9948-5d03fb7573ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:25.372512 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccec29-2a4b-4faf-9948-5d03fb7573ef admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:25.377072 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccec29-2a4b-4faf-9948-5d03fb7573ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:25.377694 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccec29-2a4b-4faf-9948-5d03fb7573ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:25.378820 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccec29-2a4b-4faf-9948-5d03fb7573ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:25.381042 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccec29-2a4b-4faf-9948-5d03fb7573ef admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:25.396898 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5433fb-ca94-4ed0-a8cd-2878b06f3781 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:25.421780 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3ecac-b0a7-4547-9281-fce55293aa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:25.425903 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3ecac-b0a7-4547-9281-fce55293aa26 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:25.426231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3ecac-b0a7-4547-9281-fce55293aa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:25.426515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3ecac-b0a7-4547-9281-fce55293aa26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:25.427191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3ecac-b0a7-4547-9281-fce55293aa26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:25.444411 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3ecac-b0a7-4547-9281-fce55293aa26 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:25.501964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 855/1709] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:25 2022] POST /identity/v3/projects => generated 373 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:25.507576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccec29-2a4b-4faf-9948-5d03fb7573ef admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:25.561187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 855/1710] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:25 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:30:25.568487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3ecac-b0a7-4547-9281-fce55293aa26 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:25.766999 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccec29-2a4b-4faf-9948-5d03fb7573ef admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:25.861055 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3ecac-b0a7-4547-9281-fce55293aa26 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:25.884656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed079bd5-7feb-443e-b992-b74be639bd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:25.885330 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed079bd5-7feb-443e-b992-b74be639bd5a admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:25.885607 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed079bd5-7feb-443e-b992-b74be639bd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:25.885875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed079bd5-7feb-443e-b992-b74be639bd5a admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:25.886515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed079bd5-7feb-443e-b992-b74be639bd5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:25.888457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed079bd5-7feb-443e-b992-b74be639bd5a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:25.909864 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dfd47-5747-4356-a691-62cf0f7cc99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:25.912504 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dfd47-5747-4356-a691-62cf0f7cc99e admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:25.912797 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dfd47-5747-4356-a691-62cf0f7cc99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:25.913933 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dfd47-5747-4356-a691-62cf0f7cc99e admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:25.915435 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815dfd47-5747-4356-a691-62cf0f7cc99e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:25.921551 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815dfd47-5747-4356-a691-62cf0f7cc99e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:25.960857 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 856/1711] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:25 2022] POST /identity/v3/users => generated 289 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:25.970234 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed079bd5-7feb-443e-b992-b74be639bd5a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:26.000915 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 856/1712] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:25 2022] POST /identity/v3/users => generated 287 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:26.006588 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dfd47-5747-4356-a691-62cf0f7cc99e admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:26.021820 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:26.024917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed079bd5-7feb-443e-b992-b74be639bd5a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:26.040568 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dfd47-5747-4356-a691-62cf0f7cc99e admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:26.053033 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1115e-721b-4725-b7da-bfef1b3105fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:26.053695 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1115e-721b-4725-b7da-bfef1b3105fd admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:26.054043 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1115e-721b-4725-b7da-bfef1b3105fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:26.054316 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1115e-721b-4725-b7da-bfef1b3105fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:26.054976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b1115e-721b-4725-b7da-bfef1b3105fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:26.056628 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b1115e-721b-4725-b7da-bfef1b3105fd admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:26.062502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86feff57-d7d4-4af9-9ba4-d96a56910a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:26.064529 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86feff57-d7d4-4af9-9ba4-d96a56910a41 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:26.064810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86feff57-d7d4-4af9-9ba4-d96a56910a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:26.081795 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86feff57-d7d4-4af9-9ba4-d96a56910a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:26.089196 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 857/1713] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:26.090113 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1115e-721b-4725-b7da-bfef1b3105fd admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:26.094258 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86feff57-d7d4-4af9-9ba4-d96a56910a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:26.104442 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86feff57-d7d4-4af9-9ba4-d96a56910a41 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:26.133142 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1115e-721b-4725-b7da-bfef1b3105fd admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:26.140629 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 857/1714] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:26.149706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86feff57-d7d4-4af9-9ba4-d96a56910a41 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:26.151016 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499e9d1-31a4-4809-97ee-fc3f21857ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:26.152692 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499e9d1-31a4-4809-97ee-fc3f21857ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:26.153214 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499e9d1-31a4-4809-97ee-fc3f21857ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:26.153706 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499e9d1-31a4-4809-97ee-fc3f21857ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:26.154786 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499e9d1-31a4-4809-97ee-fc3f21857ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:26.156939 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c499e9d1-31a4-4809-97ee-fc3f21857ff3 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:26.174794 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 858/1715] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:26.181490 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499e9d1-31a4-4809-97ee-fc3f21857ff3 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:26.215869 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86feff57-d7d4-4af9-9ba4-d96a56910a41 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:26.246119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499e9d1-31a4-4809-97ee-fc3f21857ff3 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:26.248178 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a25d62-1114-4d45-adc5-6cfaaaa37332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:26.253768 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a25d62-1114-4d45-adc5-6cfaaaa37332 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:26.254246 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a25d62-1114-4d45-adc5-6cfaaaa37332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:26.257977 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a25d62-1114-4d45-adc5-6cfaaaa37332 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:26.259212 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a25d62-1114-4d45-adc5-6cfaaaa37332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:26.261335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a64bc3-da02-41d6-9049-f98bfbe1eb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:26.262594 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a64bc3-da02-41d6-9049-f98bfbe1eb95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:26.264849 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a64bc3-da02-41d6-9049-f98bfbe1eb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:26.265335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a64bc3-da02-41d6-9049-f98bfbe1eb95 admin admin] PATH_INFO: `/v3/projects/06eac34c232944fe858088a5b95a5637/users/9e23dce45a764f99895008dda2da9949/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:26.270880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a25d62-1114-4d45-adc5-6cfaaaa37332 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:26.322976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a64bc3-da02-41d6-9049-f98bfbe1eb95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06eac34c232944fe858088a5b95a5637, user_id=9e23dce45a764f99895008dda2da9949, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:26.327375 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a64bc3-da02-41d6-9049-f98bfbe1eb95 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:26.343277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 858/1716] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:26.357970 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6eb320-64f1-4778-8d3a-670a62e059bf None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:26.358529 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6eb320-64f1-4778-8d3a-670a62e059bf None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:26.358529 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6eb320-64f1-4778-8d3a-670a62e059bf None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:26.361656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 859/1717] 10.222.0.16 () {54 vars in 961 bytes} [Tue Aug 9 02:30:26 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:30:26.369135 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6eb320-64f1-4778-8d3a-670a62e059bf None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:26.409715 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 859/1718] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:26 2022] PUT /identity/v3/projects/06eac34c232944fe858088a5b95a5637/users/9e23dce45a764f99895008dda2da9949/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:26.414844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6ee4f-71eb-4ec7-9608-e63823c7ea3e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:26.421398 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6ee4f-71eb-4ec7-9608-e63823c7ea3e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:26.423100 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6ee4f-71eb-4ec7-9608-e63823c7ea3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:26.486358 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d5b6ee4f-71eb-4ec7-9608-e63823c7ea3e None None] MFA Rules not processed for user `f3e3f74a4757432da1bb1e5f3a7685dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:26.488687 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d5b6ee4f-71eb-4ec7-9608-e63823c7ea3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:26.606912 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6eb320-64f1-4778-8d3a-670a62e059bf None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:26.636687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e88f7-19f0-4d9b-ac0b-9eff82ead661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:26.640833 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e88f7-19f0-4d9b-ac0b-9eff82ead661 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:26.641648 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e88f7-19f0-4d9b-ac0b-9eff82ead661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:26.642086 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e88f7-19f0-4d9b-ac0b-9eff82ead661 admin admin] PATH_INFO: `/v3/projects/1524a3c2f9f441279b5e23af91df25a3/users/97d64817ea3440338164439afafd86c2/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:26.687147 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e88f7-19f0-4d9b-ac0b-9eff82ead661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1524a3c2f9f441279b5e23af91df25a3, user_id=97d64817ea3440338164439afafd86c2, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:26.691852 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e88f7-19f0-4d9b-ac0b-9eff82ead661 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:26.727618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 860/1719] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:26 2022] PUT /identity/v3/projects/1524a3c2f9f441279b5e23af91df25a3/users/97d64817ea3440338164439afafd86c2/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:26.740537 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36b423-d090-4282-91cd-058d02359b0c None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:26.741209 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36b423-d090-4282-91cd-058d02359b0c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:26.741209 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36b423-d090-4282-91cd-058d02359b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:26.744558 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 860/1720] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:26.753394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9f63a-a700-4f60-bd6e-d604e49833da None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:26.753995 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9f63a-a700-4f60-bd6e-d604e49833da None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:26.754832 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9f63a-a700-4f60-bd6e-d604e49833da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:26.821444 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-fe36b423-d090-4282-91cd-058d02359b0c None None] MFA Rules not processed for user `5fe21d9a65a34abeae7329df924d7998`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:26.824854 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-fe36b423-d090-4282-91cd-058d02359b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:26.899053 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e0b9f63a-a700-4f60-bd6e-d604e49833da None None] MFA Rules not processed for user `9e23dce45a764f99895008dda2da9949`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:26.906972 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e0b9f63a-a700-4f60-bd6e-d604e49833da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:26.986394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:27.061876 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 861/1721] 10.222.0.16 () {58 vars in 1058 bytes} [Tue Aug 9 02:30:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:27.063368 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4941510-39d0-4dd9-8db2-df3789f9a8fa None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:27.063665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4941510-39d0-4dd9-8db2-df3789f9a8fa None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:27.063943 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4941510-39d0-4dd9-8db2-df3789f9a8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:27.141487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-f4941510-39d0-4dd9-8db2-df3789f9a8fa None None] MFA Rules not processed for user `97d64817ea3440338164439afafd86c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:27.145352 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 861/1722] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:27.151067 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9f63a-a700-4f60-bd6e-d604e49833da None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:27.152464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e0b9f63a-a700-4f60-bd6e-d604e49833da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:27.153162 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f4941510-39d0-4dd9-8db2-df3789f9a8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:27.261197 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:27.308963 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 862/1723] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:27.311071 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4941510-39d0-4dd9-8db2-df3789f9a8fa None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:27.336058 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4941510-39d0-4dd9-8db2-df3789f9a8fa None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:27.339266 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b25b49-4ff5-4f10-b372-a7906c8f8d3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fe21d9a65a34abeae7329df924d7998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:27.340722 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b25b49-4ff5-4f10-b372-a7906c8f8d3e service placement] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:27.341010 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b25b49-4ff5-4f10-b372-a7906c8f8d3e service placement] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:27.341356 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b25b49-4ff5-4f10-b372-a7906c8f8d3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:27.344746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-72b25b49-4ff5-4f10-b372-a7906c8f8d3e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:27.352744 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9f63a-a700-4f60-bd6e-d604e49833da None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:27.358752 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f3130-1a2f-4144-bd13-4ffbacdadafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:27.359280 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b25b49-4ff5-4f10-b372-a7906c8f8d3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:27.359787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f3130-1a2f-4144-bd13-4ffbacdadafb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:27.359787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f3130-1a2f-4144-bd13-4ffbacdadafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:27.359929 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f3130-1a2f-4144-bd13-4ffbacdadafb admin admin] PATH_INFO: `/v3/users/78d2eb105c3c4c29ab6d4187d5b4cf02` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:27.361282 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b25b49-4ff5-4f10-b372-a7906c8f8d3e service placement] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:27.361819 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f3130-1a2f-4144-bd13-4ffbacdadafb admin admin] RBAC: Authorizing `identity:delete_user(user_id=78d2eb105c3c4c29ab6d4187d5b4cf02)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:27.364242 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f3130-1a2f-4144-bd13-4ffbacdadafb admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:27.401539 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 863/1724] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:27.403658 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b25b49-4ff5-4f10-b372-a7906c8f8d3e service placement] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:27.417569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b25b49-4ff5-4f10-b372-a7906c8f8d3e service placement] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:27.425500 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039134f-b589-4f82-aa00-0290cf564064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:27.426259 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039134f-b589-4f82-aa00-0290cf564064 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:27.426682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039134f-b589-4f82-aa00-0290cf564064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:27.427056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039134f-b589-4f82-aa00-0290cf564064 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:27.427803 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039134f-b589-4f82-aa00-0290cf564064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:27.430318 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039134f-b589-4f82-aa00-0290cf564064 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:27.498528 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-485f3130-1a2f-4144-bd13-4ffbacdadafb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78d2eb105c3c4c29ab6d4187d5b4cf02'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:27.526822 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-485f3130-1a2f-4144-bd13-4ffbacdadafb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78d2eb105c3c4c29ab6d4187d5b4cf02'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:27.530010 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-485f3130-1a2f-4144-bd13-4ffbacdadafb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78d2eb105c3c4c29ab6d4187d5b4cf02'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:27.532505 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 864/1725] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:27 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:27.533626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039134f-b589-4f82-aa00-0290cf564064 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:27.538323 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a039134f-b589-4f82-aa00-0290cf564064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:27.552145 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-485f3130-1a2f-4144-bd13-4ffbacdadafb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78d2eb105c3c4c29ab6d4187d5b4cf02'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:27.569897 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-485f3130-1a2f-4144-bd13-4ffbacdadafb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78d2eb105c3c4c29ab6d4187d5b4cf02'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:27.588242 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 862/1726] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:30:27 2022] DELETE /identity/v3/users/78d2eb105c3c4c29ab6d4187d5b4cf02 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:27.589518 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f3130-1a2f-4144-bd13-4ffbacdadafb admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:27.602408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-485f3130-1a2f-4144-bd13-4ffbacdadafb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:27.653914 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039134f-b589-4f82-aa00-0290cf564064 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:27.697775 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:27.753505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f3130-1a2f-4144-bd13-4ffbacdadafb admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:27.769950 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d612e96-fa56-4a62-b63c-77d6faecc3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:27.770586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d612e96-fa56-4a62-b63c-77d6faecc3e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:27.770968 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d612e96-fa56-4a62-b63c-77d6faecc3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:27.771132 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d612e96-fa56-4a62-b63c-77d6faecc3e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:27.771772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d612e96-fa56-4a62-b63c-77d6faecc3e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:27.773767 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d612e96-fa56-4a62-b63c-77d6faecc3e8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:27.834944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 863/1727] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:27 2022] POST /identity/v3/users => generated 296 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:27.836223 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06898bd-f4ba-457d-b8fc-f7a8b5272855 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:27.836515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06898bd-f4ba-457d-b8fc-f7a8b5272855 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:27.836794 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06898bd-f4ba-457d-b8fc-f7a8b5272855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:27.878136 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a06898bd-f4ba-457d-b8fc-f7a8b5272855 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:27.879302 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a06898bd-f4ba-457d-b8fc-f7a8b5272855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:27.899062 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b603d4-cfee-42a6-9a12-0e0269590268 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:27.899457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 864/1728] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:27.900883 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06898bd-f4ba-457d-b8fc-f7a8b5272855 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:27.908582 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b603d4-cfee-42a6-9a12-0e0269590268 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:27.908885 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b603d4-cfee-42a6-9a12-0e0269590268 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:27.910507 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b603d4-cfee-42a6-9a12-0e0269590268 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:27.921282 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a5b603d4-cfee-42a6-9a12-0e0269590268 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:27.926575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06898bd-f4ba-457d-b8fc-f7a8b5272855 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:27.945148 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc5cb4-1f10-4d80-b224-c4fc9568283f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:27.945832 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc5cb4-1f10-4d80-b224-c4fc9568283f admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:27.946049 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc5cb4-1f10-4d80-b224-c4fc9568283f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:27.946321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc5cb4-1f10-4d80-b224-c4fc9568283f admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:27.947523 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc5cb4-1f10-4d80-b224-c4fc9568283f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:27.949188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc5cb4-1f10-4d80-b224-c4fc9568283f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:27.992615 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 865/1729] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:27.995008 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc5cb4-1f10-4d80-b224-c4fc9568283f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:27.997551 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-21dc5cb4-1f10-4d80-b224-c4fc9568283f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:28.105403 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:28.136530 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b603d4-cfee-42a6-9a12-0e0269590268 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:28.138248 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b603d4-cfee-42a6-9a12-0e0269590268 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:28.157536 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc5cb4-1f10-4d80-b224-c4fc9568283f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:28.163544 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff067695-3a65-4589-a87b-76fbaaa53ac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:28.164369 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff067695-3a65-4589-a87b-76fbaaa53ac6 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:28.165007 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff067695-3a65-4589-a87b-76fbaaa53ac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:28.165413 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff067695-3a65-4589-a87b-76fbaaa53ac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:28.171008 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 865/1730] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:28.184111 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff067695-3a65-4589-a87b-76fbaaa53ac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:28.185256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b603d4-cfee-42a6-9a12-0e0269590268 service nova] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:28.190741 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff067695-3a65-4589-a87b-76fbaaa53ac6 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:28.237185 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 866/1731] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:28.246517 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b603d4-cfee-42a6-9a12-0e0269590268 service nova] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:28.277698 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83266a-4128-4c14-b22c-5b49b2d34f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:28.278400 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83266a-4128-4c14-b22c-5b49b2d34f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:28.278709 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83266a-4128-4c14-b22c-5b49b2d34f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:28.279502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83266a-4128-4c14-b22c-5b49b2d34f22 admin admin] PATH_INFO: `/v3/projects/8d64c6b7f4ce4277b5e021a40d167482/users/9e6de279cf0e4a25bb428f1401469f36/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:28.367081 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83266a-4128-4c14-b22c-5b49b2d34f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d64c6b7f4ce4277b5e021a40d167482, user_id=9e6de279cf0e4a25bb428f1401469f36, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:28.370420 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83266a-4128-4c14-b22c-5b49b2d34f22 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:28.415349 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff067695-3a65-4589-a87b-76fbaaa53ac6 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:28.415520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 866/1732] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:28 2022] PUT /identity/v3/projects/8d64c6b7f4ce4277b5e021a40d167482/users/9e6de279cf0e4a25bb428f1401469f36/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:28.428837 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff067695-3a65-4589-a87b-76fbaaa53ac6 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:28.593179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488ee11-c105-4e7d-88af-eff198257802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:28.594082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488ee11-c105-4e7d-88af-eff198257802 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:28.594575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488ee11-c105-4e7d-88af-eff198257802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:28.594949 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488ee11-c105-4e7d-88af-eff198257802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:28.595747 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488ee11-c105-4e7d-88af-eff198257802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:28.597600 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488ee11-c105-4e7d-88af-eff198257802 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:28.617133 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83266a-4128-4c14-b22c-5b49b2d34f22 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:28.630326 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 867/1733] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:28.636128 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83266a-4128-4c14-b22c-5b49b2d34f22 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:28.657496 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbeadbf-44d2-4af2-8e88-8a73c13c51d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:28.658272 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbeadbf-44d2-4af2-8e88-8a73c13c51d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:28.658588 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbeadbf-44d2-4af2-8e88-8a73c13c51d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:28.658833 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbeadbf-44d2-4af2-8e88-8a73c13c51d1 admin admin] PATH_INFO: `/v3/projects/8d64c6b7f4ce4277b5e021a40d167482/users/9e6de279cf0e4a25bb428f1401469f36/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:28.667372 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbeadbf-44d2-4af2-8e88-8a73c13c51d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d64c6b7f4ce4277b5e021a40d167482, user_id=9e6de279cf0e4a25bb428f1401469f36, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:28.671693 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbeadbf-44d2-4af2-8e88-8a73c13c51d1 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:28.693937 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 867/1734] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:28 2022] PUT /identity/v3/projects/8d64c6b7f4ce4277b5e021a40d167482/users/9e6de279cf0e4a25bb428f1401469f36/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:30:28.704334 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada3d1d-dccc-476a-8dce-f1a5f0470741 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:28.704774 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada3d1d-dccc-476a-8dce-f1a5f0470741 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:28.705158 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada3d1d-dccc-476a-8dce-f1a5f0470741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:28.773357 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9ada3d1d-dccc-476a-8dce-f1a5f0470741 None None] MFA Rules not processed for user `9e6de279cf0e4a25bb428f1401469f36`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:28.774746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9ada3d1d-dccc-476a-8dce-f1a5f0470741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:28.875396 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:28.929728 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbeadbf-44d2-4af2-8e88-8a73c13c51d1 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:28.931626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-7cbeadbf-44d2-4af2-8e88-8a73c13c51d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:29.005827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 868/1735] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:29.021486 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada3d1d-dccc-476a-8dce-f1a5f0470741 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:29.023130 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9ada3d1d-dccc-476a-8dce-f1a5f0470741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:29.158898 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada3d1d-dccc-476a-8dce-f1a5f0470741 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:29.182033 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb664478-3199-4ba4-b904-43ae81c655c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:29.188633 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb664478-3199-4ba4-b904-43ae81c655c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:29.189001 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb664478-3199-4ba4-b904-43ae81c655c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:29.190459 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb664478-3199-4ba4-b904-43ae81c655c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:29.198880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbeadbf-44d2-4af2-8e88-8a73c13c51d1 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:29.200422 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cb664478-3199-4ba4-b904-43ae81c655c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:29.233134 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae6b97-b019-4f09-a782-0ba6ae97bae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:29.234457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae6b97-b019-4f09-a782-0ba6ae97bae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:29.234744 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae6b97-b019-4f09-a782-0ba6ae97bae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:29.235093 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae6b97-b019-4f09-a782-0ba6ae97bae6 admin admin] PATH_INFO: `/v3/projects/6cdef5f1275546b38daca2761787a8a7` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:29.244513 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae6b97-b019-4f09-a782-0ba6ae97bae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cdef5f1275546b38daca2761787a8a7)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:29.246608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae6b97-b019-4f09-a782-0ba6ae97bae6 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:29.401785 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-54ae6b97-b019-4f09-a782-0ba6ae97bae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cdef5f1275546b38daca2761787a8a7', 'request_id': 'req-54ae6b97-b019-4f09-a782-0ba6ae97bae6'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:29.403646 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb664478-3199-4ba4-b904-43ae81c655c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:29.409801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb664478-3199-4ba4-b904-43ae81c655c8 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:29.417619 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-54ae6b97-b019-4f09-a782-0ba6ae97bae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cdef5f1275546b38daca2761787a8a7', 'request_id': 'req-54ae6b97-b019-4f09-a782-0ba6ae97bae6'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:29.431393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 869/1736] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:29.444451 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-54ae6b97-b019-4f09-a782-0ba6ae97bae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cdef5f1275546b38daca2761787a8a7', 'request_id': 'req-54ae6b97-b019-4f09-a782-0ba6ae97bae6'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:29.473835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-54ae6b97-b019-4f09-a782-0ba6ae97bae6 admin admin] The token cache is being invalidate because project 6cdef5f1275546b38daca2761787a8a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:30:29.474210 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-54ae6b97-b019-4f09-a782-0ba6ae97bae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:29.476744 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-54ae6b97-b019-4f09-a782-0ba6ae97bae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:29.480947 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 868/1737] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:30:28 2022] DELETE /identity/v3/projects/6cdef5f1275546b38daca2761787a8a7 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:29.485013 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb664478-3199-4ba4-b904-43ae81c655c8 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:29.501982 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb664478-3199-4ba4-b904-43ae81c655c8 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:29.708758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee0dd2-f7ab-4886-aab3-b1f3344192d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:29.710345 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee0dd2-f7ab-4886-aab3-b1f3344192d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:29.713468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee0dd2-f7ab-4886-aab3-b1f3344192d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:29.714433 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee0dd2-f7ab-4886-aab3-b1f3344192d8 admin admin] PATH_INFO: `/v3/users/4337345a95ff4f759c824865a1f223db` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:29.716295 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee0dd2-f7ab-4886-aab3-b1f3344192d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4337345a95ff4f759c824865a1f223db)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:29.720892 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee0dd2-f7ab-4886-aab3-b1f3344192d8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:29.770779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:29.836363 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f469223-7372-4d3e-bd81-2188c33031ec None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:29.836847 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f469223-7372-4d3e-bd81-2188c33031ec None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:29.837356 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f469223-7372-4d3e-bd81-2188c33031ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:29.858470 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6fee0dd2-f7ab-4886-aab3-b1f3344192d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4337345a95ff4f759c824865a1f223db'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:29.873762 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-0f469223-7372-4d3e-bd81-2188c33031ec None None] MFA Rules not processed for user `0b20525bc3124888bbb1decbae15d3c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:29.874943 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0f469223-7372-4d3e-bd81-2188c33031ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:29.877155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6fee0dd2-f7ab-4886-aab3-b1f3344192d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4337345a95ff4f759c824865a1f223db'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:29.877794 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6fee0dd2-f7ab-4886-aab3-b1f3344192d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4337345a95ff4f759c824865a1f223db'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:29.897134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6fee0dd2-f7ab-4886-aab3-b1f3344192d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4337345a95ff4f759c824865a1f223db'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:29.918350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6fee0dd2-f7ab-4886-aab3-b1f3344192d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4337345a95ff4f759c824865a1f223db'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:29.934763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 870/1738] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:30:29 2022] DELETE /identity/v3/users/4337345a95ff4f759c824865a1f223db => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:30.022728 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:30.063240 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 869/1739] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:30:30.582812 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee0dd2-f7ab-4886-aab3-b1f3344192d8 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:30.585064 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6fee0dd2-f7ab-4886-aab3-b1f3344192d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:30.766315 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee0dd2-f7ab-4886-aab3-b1f3344192d8 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:30.781508 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00dc932-d215-42c7-a1b8-d44b9b5686d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:30.782175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00dc932-d215-42c7-a1b8-d44b9b5686d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:30.785477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00dc932-d215-42c7-a1b8-d44b9b5686d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:30.785785 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00dc932-d215-42c7-a1b8-d44b9b5686d4 admin admin] PATH_INFO: `/v3/projects/b92a5b8ec6c944b7b79d8951d447e5dd` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:30.788017 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00dc932-d215-42c7-a1b8-d44b9b5686d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b92a5b8ec6c944b7b79d8951d447e5dd)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:30.791116 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00dc932-d215-42c7-a1b8-d44b9b5686d4 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:30.988095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e00dc932-d215-42c7-a1b8-d44b9b5686d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b92a5b8ec6c944b7b79d8951d447e5dd', 'request_id': 'req-e00dc932-d215-42c7-a1b8-d44b9b5686d4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:31.003285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e00dc932-d215-42c7-a1b8-d44b9b5686d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b92a5b8ec6c944b7b79d8951d447e5dd', 'request_id': 'req-e00dc932-d215-42c7-a1b8-d44b9b5686d4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:31.023766 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e00dc932-d215-42c7-a1b8-d44b9b5686d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b92a5b8ec6c944b7b79d8951d447e5dd', 'request_id': 'req-e00dc932-d215-42c7-a1b8-d44b9b5686d4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:31.049684 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e00dc932-d215-42c7-a1b8-d44b9b5686d4 admin admin] The token cache is being invalidate because project b92a5b8ec6c944b7b79d8951d447e5dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:30:31.051532 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e00dc932-d215-42c7-a1b8-d44b9b5686d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:31.053189 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e00dc932-d215-42c7-a1b8-d44b9b5686d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:31.056899 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 871/1740] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:30:30 2022] DELETE /identity/v3/projects/b92a5b8ec6c944b7b79d8951d447e5dd => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:31.065257 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6d153-45d9-4339-87dd-9b4ea0a069b7 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:31.066367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6d153-45d9-4339-87dd-9b4ea0a069b7 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:31.066831 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6d153-45d9-4339-87dd-9b4ea0a069b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:31.126526 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-3bd6d153-45d9-4339-87dd-9b4ea0a069b7 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:31.134964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3bd6d153-45d9-4339-87dd-9b4ea0a069b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:31.284162 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 870/1741] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:31.288537 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001fdc1-94b9-4c26-bbb0-8d2dd97ce6bf None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:31.288851 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001fdc1-94b9-4c26-bbb0-8d2dd97ce6bf None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:31.289159 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001fdc1-94b9-4c26-bbb0-8d2dd97ce6bf None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:31.291204 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 872/1742] 10.222.0.16 () {54 vars in 912 bytes} [Tue Aug 9 02:30:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:30:31.292824 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec385a-779e-4086-a458-f05e26661a6b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:31.293144 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec385a-779e-4086-a458-f05e26661a6b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:31.293431 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec385a-779e-4086-a458-f05e26661a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:31.311822 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d55fa-ef03-4f10-abff-d15723a560e5 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:31.312103 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d55fa-ef03-4f10-abff-d15723a560e5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:31.312476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d55fa-ef03-4f10-abff-d15723a560e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:31.359672 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-749d55fa-ef03-4f10-abff-d15723a560e5 None None] MFA Rules not processed for user `d608fede6f5e4b339f8de0354cc0562b`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:31.361765 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-749d55fa-ef03-4f10-abff-d15723a560e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:31.367786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-f0ec385a-779e-4086-a458-f05e26661a6b None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:31.369537 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f0ec385a-779e-4086-a458-f05e26661a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:31.395962 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 871/1743] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:31.397547 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3ddcf-a362-4589-b5ee-572421368a22 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:31.397835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3ddcf-a362-4589-b5ee-572421368a22 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:31.398112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3ddcf-a362-4589-b5ee-572421368a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:31.441086 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:31.470915 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a6c3ddcf-a362-4589-b5ee-572421368a22 None None] MFA Rules not processed for user `07041df2276d4dd58fb0e49417a26e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:31.472353 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a6c3ddcf-a362-4589-b5ee-572421368a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:31.479476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 873/1744] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 9 02:30:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:30:31.485762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d55fa-ef03-4f10-abff-d15723a560e5 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:31.499665 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d55fa-ef03-4f10-abff-d15723a560e5 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:31.512093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfabc5b-9b4c-4e33-97e7-3bcd644a2872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:31.513002 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfabc5b-9b4c-4e33-97e7-3bcd644a2872 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:31.513002 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfabc5b-9b4c-4e33-97e7-3bcd644a2872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:31.514037 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfabc5b-9b4c-4e33-97e7-3bcd644a2872 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:31.514160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfabc5b-9b4c-4e33-97e7-3bcd644a2872 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:30:31.514369 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfabc5b-9b4c-4e33-97e7-3bcd644a2872 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:31.516076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfabc5b-9b4c-4e33-97e7-3bcd644a2872 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:31.543007 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 874/1745] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:30:31.543007 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfabc5b-9b4c-4e33-97e7-3bcd644a2872 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:31.545881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fcfabc5b-9b4c-4e33-97e7-3bcd644a2872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:31.564779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfabc5b-9b4c-4e33-97e7-3bcd644a2872 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:31.569254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6b964-af4b-4f81-8696-5338830b2fdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:31.569997 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6b964-af4b-4f81-8696-5338830b2fdc service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:31.570287 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6b964-af4b-4f81-8696-5338830b2fdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:31.570560 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6b964-af4b-4f81-8696-5338830b2fdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:31.580001 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6b964-af4b-4f81-8696-5338830b2fdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:31.581813 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6b964-af4b-4f81-8696-5338830b2fdc service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:31.591292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 872/1746] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 9 02:30:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:31.592139 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3ddcf-a362-4589-b5ee-572421368a22 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:31.596437 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 875/1747] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:31.597362 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6b964-af4b-4f81-8696-5338830b2fdc service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:31.599156 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6be6b964-af4b-4f81-8696-5338830b2fdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:31.606238 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3ddcf-a362-4589-b5ee-572421368a22 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:31.618073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a92130-7e0b-43af-b188-b0847cbe4cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:31.619646 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a92130-7e0b-43af-b188-b0847cbe4cca admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:31.619978 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a92130-7e0b-43af-b188-b0847cbe4cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:31.620316 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a92130-7e0b-43af-b188-b0847cbe4cca admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:31.621136 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a92130-7e0b-43af-b188-b0847cbe4cca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:31.623865 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a92130-7e0b-43af-b188-b0847cbe4cca admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:31.690090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6b964-af4b-4f81-8696-5338830b2fdc service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:31.694692 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764c76e-e916-48fd-87bc-252eb3179ba0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:31.695597 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764c76e-e916-48fd-87bc-252eb3179ba0 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:31.695941 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764c76e-e916-48fd-87bc-252eb3179ba0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:31.696231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 873/1748] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:31 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:31.696331 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764c76e-e916-48fd-87bc-252eb3179ba0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:31.701237 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d764c76e-e916-48fd-87bc-252eb3179ba0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:31.702290 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a92130-7e0b-43af-b188-b0847cbe4cca admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:31.793111 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:31.857562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764c76e-e916-48fd-87bc-252eb3179ba0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:31.861250 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764c76e-e916-48fd-87bc-252eb3179ba0 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:31.900117 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 876/1749] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:31 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:31.903128 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764c76e-e916-48fd-87bc-252eb3179ba0 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:31.907599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d764c76e-e916-48fd-87bc-252eb3179ba0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:31.965235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a92130-7e0b-43af-b188-b0847cbe4cca admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:31.993296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b530556-fed1-4503-8b90-fd2f0c974054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:31.998103 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b530556-fed1-4503-8b90-fd2f0c974054 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:31.998447 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b530556-fed1-4503-8b90-fd2f0c974054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:31.998841 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b530556-fed1-4503-8b90-fd2f0c974054 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:32.000256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b530556-fed1-4503-8b90-fd2f0c974054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:32.009611 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b530556-fed1-4503-8b90-fd2f0c974054 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:32.075376 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 874/1750] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:31 2022] POST /identity/v3/users => generated 283 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:32.077471 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b530556-fed1-4503-8b90-fd2f0c974054 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:32.103477 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b530556-fed1-4503-8b90-fd2f0c974054 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:32.114594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d396a2-bfc9-4724-86bf-9d053f4f94c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:32.115310 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d396a2-bfc9-4724-86bf-9d053f4f94c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:32.115598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d396a2-bfc9-4724-86bf-9d053f4f94c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:32.115928 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d396a2-bfc9-4724-86bf-9d053f4f94c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:32.120383 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d396a2-bfc9-4724-86bf-9d053f4f94c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:32.126690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d396a2-bfc9-4724-86bf-9d053f4f94c4 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:32.157064 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 875/1751] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:32.160924 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d396a2-bfc9-4724-86bf-9d053f4f94c4 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:32.188973 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d396a2-bfc9-4724-86bf-9d053f4f94c4 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:32.208509 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c7e80-cec4-43cd-8026-01e9a3b2cb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:32.212999 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c7e80-cec4-43cd-8026-01e9a3b2cb9e admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:32.213377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c7e80-cec4-43cd-8026-01e9a3b2cb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:32.218123 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c7e80-cec4-43cd-8026-01e9a3b2cb9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:32.218955 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c7e80-cec4-43cd-8026-01e9a3b2cb9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:32.224475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:32.224815 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c7e80-cec4-43cd-8026-01e9a3b2cb9e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:32.265919 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 876/1752] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:32.273400 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c7e80-cec4-43cd-8026-01e9a3b2cb9e admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:32.309586 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c7e80-cec4-43cd-8026-01e9a3b2cb9e admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:32.322965 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889011b2-0347-4bf5-ada8-03447f003622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:32.323805 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889011b2-0347-4bf5-ada8-03447f003622 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:32.324086 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889011b2-0347-4bf5-ada8-03447f003622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:32.324544 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889011b2-0347-4bf5-ada8-03447f003622 admin admin] PATH_INFO: `/v3/projects/de9fed28b20045649bff2e56e4fa05f3/users/6c2396d6d2534969a5ad4a9df2cb1efd/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:32.326883 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764c76e-e916-48fd-87bc-252eb3179ba0 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:32.355700 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889011b2-0347-4bf5-ada8-03447f003622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de9fed28b20045649bff2e56e4fa05f3, user_id=6c2396d6d2534969a5ad4a9df2cb1efd, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:32.362220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889011b2-0347-4bf5-ada8-03447f003622 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:32.411344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 877/1753] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:32 2022] PUT /identity/v3/projects/de9fed28b20045649bff2e56e4fa05f3/users/6c2396d6d2534969a5ad4a9df2cb1efd/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:32.424721 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26908d7d-97fd-475e-8463-b3e8cf6c7cb6 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:32.425329 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26908d7d-97fd-475e-8463-b3e8cf6c7cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:32.425814 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26908d7d-97fd-475e-8463-b3e8cf6c7cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:32.473422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-26908d7d-97fd-475e-8463-b3e8cf6c7cb6 None None] MFA Rules not processed for user `6c2396d6d2534969a5ad4a9df2cb1efd`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:32.474740 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-26908d7d-97fd-475e-8463-b3e8cf6c7cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:32.509728 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5de8f-2208-4c8f-891d-f7da269c5170 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9151f210d29542dcb41ea3bc03390350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:32.511497 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5de8f-2208-4c8f-891d-f7da269c5170 service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:32.512652 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5de8f-2208-4c8f-891d-f7da269c5170 service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:32.515406 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5de8f-2208-4c8f-891d-f7da269c5170 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:32.630118 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 878/1754] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:30:32.635354 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26908d7d-97fd-475e-8463-b3e8cf6c7cb6 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:32.694420 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5de8f-2208-4c8f-891d-f7da269c5170 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:32.696069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5de8f-2208-4c8f-891d-f7da269c5170 service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:32.709814 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 877/1755] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 9 02:30:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 809 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 02:30:32.772210 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26908d7d-97fd-475e-8463-b3e8cf6c7cb6 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:32.786065 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7747864-ae03-4b17-9244-2cc1037081e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:32.786689 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7747864-ae03-4b17-9244-2cc1037081e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:32.787040 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7747864-ae03-4b17-9244-2cc1037081e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:32.787477 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7747864-ae03-4b17-9244-2cc1037081e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:32.788228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7747864-ae03-4b17-9244-2cc1037081e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:32.790810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7747864-ae03-4b17-9244-2cc1037081e8 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:32.829854 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:32.878660 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 879/1756] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:32 2022] POST /identity/v3/projects => generated 365 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:32.883050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5de8f-2208-4c8f-891d-f7da269c5170 service swift] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:32.896226 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5de8f-2208-4c8f-891d-f7da269c5170 service swift] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:33.045725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7747864-ae03-4b17-9244-2cc1037081e8 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:33.047691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e7747864-ae03-4b17-9244-2cc1037081e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:33.049753 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d233b-2985-45ae-bbf4-35a1662e2412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:33.050788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d233b-2985-45ae-bbf4-35a1662e2412 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:33.051750 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d233b-2985-45ae-bbf4-35a1662e2412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:33.052201 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d233b-2985-45ae-bbf4-35a1662e2412 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:33.057119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d233b-2985-45ae-bbf4-35a1662e2412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:33.059666 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d233b-2985-45ae-bbf4-35a1662e2412 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:33.070183 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7747864-ae03-4b17-9244-2cc1037081e8 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:33.081346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90acc1d8-d013-4c48-ac9a-9d766d7efbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:33.082044 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acc1d8-d013-4c48-ac9a-9d766d7efbd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:33.082325 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acc1d8-d013-4c48-ac9a-9d766d7efbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:33.082846 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90acc1d8-d013-4c48-ac9a-9d766d7efbd1 admin admin] PATH_INFO: `/v3/users/97d64817ea3440338164439afafd86c2` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:33.087745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90acc1d8-d013-4c48-ac9a-9d766d7efbd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97d64817ea3440338164439afafd86c2)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:33.091066 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90acc1d8-d013-4c48-ac9a-9d766d7efbd1 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:33.136547 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 878/1757] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:32 2022] POST /identity/v3/users => generated 289 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:30:33.141467 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d233b-2985-45ae-bbf4-35a1662e2412 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:33.164307 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d233b-2985-45ae-bbf4-35a1662e2412 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:33.188297 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960f45e-d2bf-4f21-b6ba-8cd001fd1783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:33.189827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960f45e-d2bf-4f21-b6ba-8cd001fd1783 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:33.191059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960f45e-d2bf-4f21-b6ba-8cd001fd1783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:33.191599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960f45e-d2bf-4f21-b6ba-8cd001fd1783 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:33.192383 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960f45e-d2bf-4f21-b6ba-8cd001fd1783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:33.194328 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960f45e-d2bf-4f21-b6ba-8cd001fd1783 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:33.213479 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 879/1758] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:33.217423 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960f45e-d2bf-4f21-b6ba-8cd001fd1783 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:33.258754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960f45e-d2bf-4f21-b6ba-8cd001fd1783 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:33.268240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5485a-9216-4a04-86fe-b46c16d5d6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:33.268924 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5485a-9216-4a04-86fe-b46c16d5d6cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:33.269237 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5485a-9216-4a04-86fe-b46c16d5d6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:33.269574 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5485a-9216-4a04-86fe-b46c16d5d6cb admin admin] PATH_INFO: `/v3/projects/8f3e384e4c8a4ec091dbb3d5119f765a/users/f1136aba12994c0fb4dc9594217d7314/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:33.286304 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:33.306609 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5485a-9216-4a04-86fe-b46c16d5d6cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3e384e4c8a4ec091dbb3d5119f765a, user_id=f1136aba12994c0fb4dc9594217d7314, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:33.311151 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5485a-9216-4a04-86fe-b46c16d5d6cb admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:33.332297 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-90acc1d8-d013-4c48-ac9a-9d766d7efbd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97d64817ea3440338164439afafd86c2'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:33.352132 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 880/1759] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:33 2022] PUT /identity/v3/projects/8f3e384e4c8a4ec091dbb3d5119f765a/users/f1136aba12994c0fb4dc9594217d7314/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:33.357709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5485a-9216-4a04-86fe-b46c16d5d6cb admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:33.379537 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-90acc1d8-d013-4c48-ac9a-9d766d7efbd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97d64817ea3440338164439afafd86c2'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:33.432415 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-90acc1d8-d013-4c48-ac9a-9d766d7efbd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97d64817ea3440338164439afafd86c2'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:33.442879 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-90acc1d8-d013-4c48-ac9a-9d766d7efbd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97d64817ea3440338164439afafd86c2'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:33.539077 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-90acc1d8-d013-4c48-ac9a-9d766d7efbd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97d64817ea3440338164439afafd86c2'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:33.591005 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 880/1760] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:30:33 2022] DELETE /identity/v3/users/97d64817ea3440338164439afafd86c2 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:30:33.602181 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90acc1d8-d013-4c48-ac9a-9d766d7efbd1 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:33.613014 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-90acc1d8-d013-4c48-ac9a-9d766d7efbd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:33.673356 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5485a-9216-4a04-86fe-b46c16d5d6cb admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:34.006794 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90acc1d8-d013-4c48-ac9a-9d766d7efbd1 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:34.043128 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bf5e6-4e82-47b0-b99b-fbe8022de499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:34.044373 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fce61-32ad-4c32-a335-c4d940528e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:34.046352 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fce61-32ad-4c32-a335-c4d940528e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:34.048396 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bf5e6-4e82-47b0-b99b-fbe8022de499 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:34.048688 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bf5e6-4e82-47b0-b99b-fbe8022de499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:34.048966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bf5e6-4e82-47b0-b99b-fbe8022de499 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:34.049823 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fce61-32ad-4c32-a335-c4d940528e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:34.050071 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fce61-32ad-4c32-a335-c4d940528e4b admin admin] PATH_INFO: `/v3/users/48f7060c469347f49bfe86c84e6d93c7` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:34.057891 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3fce61-32ad-4c32-a335-c4d940528e4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=48f7060c469347f49bfe86c84e6d93c7)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:34.059140 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0bf5e6-4e82-47b0-b99b-fbe8022de499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:34.061623 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0bf5e6-4e82-47b0-b99b-fbe8022de499 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:34.069970 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3fce61-32ad-4c32-a335-c4d940528e4b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:34.082830 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 881/1761] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 727 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:30:34.085638 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe7d37-89c9-48fe-99bb-64d458d2f8e2 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:34.086527 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe7d37-89c9-48fe-99bb-64d458d2f8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:34.087690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe7d37-89c9-48fe-99bb-64d458d2f8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:34.125330 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-94fe7d37-89c9-48fe-99bb-64d458d2f8e2 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:34.127320 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-94fe7d37-89c9-48fe-99bb-64d458d2f8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:34.167050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 882/1762] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:34.170842 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe7d37-89c9-48fe-99bb-64d458d2f8e2 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:34.173250 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-94fe7d37-89c9-48fe-99bb-64d458d2f8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:34.228517 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe7d37-89c9-48fe-99bb-64d458d2f8e2 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:34.246011 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4c3fce61-32ad-4c32-a335-c4d940528e4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48f7060c469347f49bfe86c84e6d93c7'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:34.266203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba00b74-cd0a-42e6-bb47-1d41d55394ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:34.267595 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4c3fce61-32ad-4c32-a335-c4d940528e4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48f7060c469347f49bfe86c84e6d93c7'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:34.272666 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba00b74-cd0a-42e6-bb47-1d41d55394ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:34.273792 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba00b74-cd0a-42e6-bb47-1d41d55394ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:34.275844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba00b74-cd0a-42e6-bb47-1d41d55394ff admin admin] PATH_INFO: `/v3/users/9678f17580cc478c9c7aa7c0d1855aaa` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:34.282810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba00b74-cd0a-42e6-bb47-1d41d55394ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=9678f17580cc478c9c7aa7c0d1855aaa)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:34.293864 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4c3fce61-32ad-4c32-a335-c4d940528e4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48f7060c469347f49bfe86c84e6d93c7'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:34.295627 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4c3fce61-32ad-4c32-a335-c4d940528e4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48f7060c469347f49bfe86c84e6d93c7'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:34.297434 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=79,keystone:INSERT=3,keystone:DELETE=18 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:34.299434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba00b74-cd0a-42e6-bb47-1d41d55394ff admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:34.332001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4c3fce61-32ad-4c32-a335-c4d940528e4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48f7060c469347f49bfe86c84e6d93c7'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:34.401315 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 881/1763] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:30:33 2022] DELETE /identity/v3/users/48f7060c469347f49bfe86c84e6d93c7 => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:34.413102 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fce61-32ad-4c32-a335-c4d940528e4b admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:34.416617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4c3fce61-32ad-4c32-a335-c4d940528e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:34.618956 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fba00b74-cd0a-42e6-bb47-1d41d55394ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9678f17580cc478c9c7aa7c0d1855aaa'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:34.640457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fba00b74-cd0a-42e6-bb47-1d41d55394ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9678f17580cc478c9c7aa7c0d1855aaa'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:34.641479 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fce61-32ad-4c32-a335-c4d940528e4b admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:34.641962 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fba00b74-cd0a-42e6-bb47-1d41d55394ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9678f17580cc478c9c7aa7c0d1855aaa'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:34.669806 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74621e4b-bacc-4726-9b05-34ad686d64a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:34.669806 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74621e4b-bacc-4726-9b05-34ad686d64a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:34.669806 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74621e4b-bacc-4726-9b05-34ad686d64a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:34.669806 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74621e4b-bacc-4726-9b05-34ad686d64a7 admin admin] PATH_INFO: `/v3/projects/8f3e384e4c8a4ec091dbb3d5119f765a/users/f1136aba12994c0fb4dc9594217d7314/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:34.670556 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74621e4b-bacc-4726-9b05-34ad686d64a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3e384e4c8a4ec091dbb3d5119f765a, user_id=f1136aba12994c0fb4dc9594217d7314, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:34.682426 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74621e4b-bacc-4726-9b05-34ad686d64a7 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:34.685975 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fba00b74-cd0a-42e6-bb47-1d41d55394ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9678f17580cc478c9c7aa7c0d1855aaa'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:34.698797 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:34.715639 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fba00b74-cd0a-42e6-bb47-1d41d55394ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9678f17580cc478c9c7aa7c0d1855aaa'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:34.736470 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 883/1764] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:30:34 2022] DELETE /identity/v3/users/9678f17580cc478c9c7aa7c0d1855aaa => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:34.746225 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 882/1765] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:34 2022] PUT /identity/v3/projects/8f3e384e4c8a4ec091dbb3d5119f765a/users/f1136aba12994c0fb4dc9594217d7314/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:34.749462 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba00b74-cd0a-42e6-bb47-1d41d55394ff admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:34.750316 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef72db-8833-4362-8910-9fcf9b2032ec None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:34.751038 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef72db-8833-4362-8910-9fcf9b2032ec None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:34.751894 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fba00b74-cd0a-42e6-bb47-1d41d55394ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:34.752344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef72db-8833-4362-8910-9fcf9b2032ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:34.807675 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-35ef72db-8833-4362-8910-9fcf9b2032ec None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:34.813555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-35ef72db-8833-4362-8910-9fcf9b2032ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:34.921139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba00b74-cd0a-42e6-bb47-1d41d55394ff admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:34.938612 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed20ab-48b2-4586-a34d-aa8bad103968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:34.940224 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed20ab-48b2-4586-a34d-aa8bad103968 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:34.940504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed20ab-48b2-4586-a34d-aa8bad103968 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:34.943053 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed20ab-48b2-4586-a34d-aa8bad103968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:34.948424 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bbed20ab-48b2-4586-a34d-aa8bad103968 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:35.024148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 883/1766] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:35.025628 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd61aa1-1bd3-4d60-930d-82441c47b34f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:35.030229 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd61aa1-1bd3-4d60-930d-82441c47b34f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:35.031142 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd61aa1-1bd3-4d60-930d-82441c47b34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:35.071001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-2cd61aa1-1bd3-4d60-930d-82441c47b34f None None] MFA Rules not processed for user `d608fede6f5e4b339f8de0354cc0562b`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:35.072900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2cd61aa1-1bd3-4d60-930d-82441c47b34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:35.087799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 884/1767] 10.222.0.17 () {58 vars in 1015 bytes} [Tue Aug 9 02:30:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:35.090236 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1f2b3-622c-49b7-9780-f5a064732e54 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:35.090790 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1f2b3-622c-49b7-9780-f5a064732e54 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:35.091330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1f2b3-622c-49b7-9780-f5a064732e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:35.096766 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed20ab-48b2-4586-a34d-aa8bad103968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:35.098343 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed20ab-48b2-4586-a34d-aa8bad103968 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:35.121218 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 884/1768] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:35.123790 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f08c1b-6183-4ab2-a294-e7e620cc2360 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:35.124084 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f08c1b-6183-4ab2-a294-e7e620cc2360 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:35.124368 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f08c1b-6183-4ab2-a294-e7e620cc2360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:35.124478 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-4df1f2b3-622c-49b7-9780-f5a064732e54 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:35.127761 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4df1f2b3-622c-49b7-9780-f5a064732e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:35.149853 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 885/1769] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:35.150798 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1f2b3-622c-49b7-9780-f5a064732e54 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:35.170397 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d1f08c1b-6183-4ab2-a294-e7e620cc2360 None None] MFA Rules not processed for user `f1136aba12994c0fb4dc9594217d7314`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:35.170694 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1f2b3-622c-49b7-9780-f5a064732e54 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:35.171912 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d1f08c1b-6183-4ab2-a294-e7e620cc2360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:35.175137 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57babd9-477b-4dbf-93e8-6d0af7662be1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:35.175986 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57babd9-477b-4dbf-93e8-6d0af7662be1 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:35.176457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57babd9-477b-4dbf-93e8-6d0af7662be1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:35.176921 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57babd9-477b-4dbf-93e8-6d0af7662be1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:35.187995 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57babd9-477b-4dbf-93e8-6d0af7662be1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:35.189834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57babd9-477b-4dbf-93e8-6d0af7662be1 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:35.220493 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 886/1770] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:35.221521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57babd9-477b-4dbf-93e8-6d0af7662be1 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:35.232408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57babd9-477b-4dbf-93e8-6d0af7662be1 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:35.251671 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a577cf-46fc-49e7-b1e4-9f4c9c3bc7d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:35.254830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a577cf-46fc-49e7-b1e4-9f4c9c3bc7d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:35.255328 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a577cf-46fc-49e7-b1e4-9f4c9c3bc7d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:35.255761 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a577cf-46fc-49e7-b1e4-9f4c9c3bc7d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:35.292622 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a577cf-46fc-49e7-b1e4-9f4c9c3bc7d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:35.294466 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a577cf-46fc-49e7-b1e4-9f4c9c3bc7d0 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:35.335781 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 885/1771] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:35.343396 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 887/1772] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:35.348977 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f08c1b-6183-4ab2-a294-e7e620cc2360 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:35.352434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d1f08c1b-6183-4ab2-a294-e7e620cc2360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:35.470112 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:35.538530 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f08c1b-6183-4ab2-a294-e7e620cc2360 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:35.548132 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71eefe-b7ce-491a-986a-ead6b9b5038c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:35.550648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71eefe-b7ce-491a-986a-ead6b9b5038c service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:35.552419 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71eefe-b7ce-491a-986a-ead6b9b5038c service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:35.552419 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71eefe-b7ce-491a-986a-ead6b9b5038c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:35.593511 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71eefe-b7ce-491a-986a-ead6b9b5038c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:35.596999 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71eefe-b7ce-491a-986a-ead6b9b5038c service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:35.622502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a577cf-46fc-49e7-b1e4-9f4c9c3bc7d0 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:35.625645 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-63a577cf-46fc-49e7-b1e4-9f4c9c3bc7d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:35.638004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 886/1773] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:35 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:35.652106 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a577cf-46fc-49e7-b1e4-9f4c9c3bc7d0 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:35.679712 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71eefe-b7ce-491a-986a-ead6b9b5038c service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:35.690385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967f971-0d68-470c-ae29-0c5de1589923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:35.690626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967f971-0d68-470c-ae29-0c5de1589923 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:35.690959 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967f971-0d68-470c-ae29-0c5de1589923 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:35.691168 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967f971-0d68-470c-ae29-0c5de1589923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:35.701853 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71eefe-b7ce-491a-986a-ead6b9b5038c service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:35.716346 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acac98-9652-4d4b-8537-aff154082cd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:35.718690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acac98-9652-4d4b-8537-aff154082cd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:35.720754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acac98-9652-4d4b-8537-aff154082cd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:35.721263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acac98-9652-4d4b-8537-aff154082cd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:35.747931 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acac98-9652-4d4b-8537-aff154082cd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:35.752882 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967f971-0d68-470c-ae29-0c5de1589923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:35.753515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acac98-9652-4d4b-8537-aff154082cd1 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:35.755558 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967f971-0d68-470c-ae29-0c5de1589923 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:35.797920 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 887/1774] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:30:35.819814 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 888/1775] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:35.888504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acac98-9652-4d4b-8537-aff154082cd1 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:35.905443 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acac98-9652-4d4b-8537-aff154082cd1 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:35.927374 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ded07-9a42-47c4-a163-093840b9d417 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:35.928012 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ded07-9a42-47c4-a163-093840b9d417 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:35.928291 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ded07-9a42-47c4-a163-093840b9d417 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:35.928555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ded07-9a42-47c4-a163-093840b9d417 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:35.967726 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5c0ded07-9a42-47c4-a163-093840b9d417 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:36.279123 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ded07-9a42-47c4-a163-093840b9d417 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:36.292359 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ded07-9a42-47c4-a163-093840b9d417 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:36.355943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 888/1776] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:37.485898 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967f971-0d68-470c-ae29-0c5de1589923 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:37.488585 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d967f971-0d68-470c-ae29-0c5de1589923 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:37.528222 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967f971-0d68-470c-ae29-0c5de1589923 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:37.538350 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbabc5c-092c-4c5a-8aa7-17e92b2fd9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:37.539414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbabc5c-092c-4c5a-8aa7-17e92b2fd9d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:37.540474 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbabc5c-092c-4c5a-8aa7-17e92b2fd9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:37.540976 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbabc5c-092c-4c5a-8aa7-17e92b2fd9d7 admin admin] PATH_INFO: `/v3/users/9e23dce45a764f99895008dda2da9949` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:37.543062 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbabc5c-092c-4c5a-8aa7-17e92b2fd9d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e23dce45a764f99895008dda2da9949)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:37.549180 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbabc5c-092c-4c5a-8aa7-17e92b2fd9d7 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:37.591338 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:37.688323 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-bfbabc5c-092c-4c5a-8aa7-17e92b2fd9d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e23dce45a764f99895008dda2da9949'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:37.744756 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-bfbabc5c-092c-4c5a-8aa7-17e92b2fd9d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e23dce45a764f99895008dda2da9949'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:37.770726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-bfbabc5c-092c-4c5a-8aa7-17e92b2fd9d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e23dce45a764f99895008dda2da9949'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:37.774347 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-bfbabc5c-092c-4c5a-8aa7-17e92b2fd9d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e23dce45a764f99895008dda2da9949'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:37.781713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ded07-9a42-47c4-a163-093840b9d417 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:37.784558 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5c0ded07-9a42-47c4-a163-093840b9d417 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:37.810290 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-bfbabc5c-092c-4c5a-8aa7-17e92b2fd9d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e23dce45a764f99895008dda2da9949'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:37.830298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 889/1777] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:30:37 2022] DELETE /identity/v3/users/9e23dce45a764f99895008dda2da9949 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:37.835692 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fbe58-f188-43e9-9cd8-e827e4ea3bfb None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:37.836656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fbe58-f188-43e9-9cd8-e827e4ea3bfb None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:37.840891 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fbe58-f188-43e9-9cd8-e827e4ea3bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:37.858912 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ded07-9a42-47c4-a163-093840b9d417 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:37.939670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-6e2fbe58-f188-43e9-9cd8-e827e4ea3bfb None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:37.946701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6e2fbe58-f188-43e9-9cd8-e827e4ea3bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:38.133662 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098a24a-467b-455c-be38-de48c878016f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:38.134451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098a24a-467b-455c-be38-de48c878016f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:38.134741 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098a24a-467b-455c-be38-de48c878016f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:38.135056 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098a24a-467b-455c-be38-de48c878016f admin admin] PATH_INFO: `/v3/projects/b9fc274e72ca47ed92bc0f3b071fda9d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:38.139287 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098a24a-467b-455c-be38-de48c878016f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9fc274e72ca47ed92bc0f3b071fda9d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:38.141298 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098a24a-467b-455c-be38-de48c878016f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:38.160574 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 890/1778] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:30:38.244945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fbe58-f188-43e9-9cd8-e827e4ea3bfb None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:38.246746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6e2fbe58-f188-43e9-9cd8-e827e4ea3bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:38.333241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c098a24a-467b-455c-be38-de48c878016f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9fc274e72ca47ed92bc0f3b071fda9d', 'request_id': 'req-c098a24a-467b-455c-be38-de48c878016f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:38.357321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c098a24a-467b-455c-be38-de48c878016f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9fc274e72ca47ed92bc0f3b071fda9d', 'request_id': 'req-c098a24a-467b-455c-be38-de48c878016f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:38.363344 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:38.380727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c098a24a-467b-455c-be38-de48c878016f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9fc274e72ca47ed92bc0f3b071fda9d', 'request_id': 'req-c098a24a-467b-455c-be38-de48c878016f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:38.457820 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c098a24a-467b-455c-be38-de48c878016f admin admin] The token cache is being invalidate because project b9fc274e72ca47ed92bc0f3b071fda9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:30:38.462861 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c098a24a-467b-455c-be38-de48c878016f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:38.465844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c098a24a-467b-455c-be38-de48c878016f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:38.475180 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 889/1779] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:30:37 2022] DELETE /identity/v3/projects/b9fc274e72ca47ed92bc0f3b071fda9d => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:38.483981 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098a24a-467b-455c-be38-de48c878016f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:38.483981 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c098a24a-467b-455c-be38-de48c878016f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:38.501554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fbe58-f188-43e9-9cd8-e827e4ea3bfb None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:38.635050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098a24a-467b-455c-be38-de48c878016f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:38.641392 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ba49f-502d-47b0-8c14-babd828dcdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:38.642624 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ba49f-502d-47b0-8c14-babd828dcdcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:38.643403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ba49f-502d-47b0-8c14-babd828dcdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:38.645451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ba49f-502d-47b0-8c14-babd828dcdcb admin admin] PATH_INFO: `/v3/projects/1524a3c2f9f441279b5e23af91df25a3` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:38.645451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ba49f-502d-47b0-8c14-babd828dcdcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1524a3c2f9f441279b5e23af91df25a3)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:38.647332 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ba49f-502d-47b0-8c14-babd828dcdcb admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:38.655235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10230de-9a36-46a6-ae43-3f01702e05b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:38.656376 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10230de-9a36-46a6-ae43-3f01702e05b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:38.656685 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10230de-9a36-46a6-ae43-3f01702e05b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:38.657005 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10230de-9a36-46a6-ae43-3f01702e05b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:38.688770 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d10230de-9a36-46a6-ae43-3f01702e05b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:38.730780 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:38.740712 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bb2ba49f-502d-47b0-8c14-babd828dcdcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1524a3c2f9f441279b5e23af91df25a3', 'request_id': 'req-bb2ba49f-502d-47b0-8c14-babd828dcdcb'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:38.759354 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10230de-9a36-46a6-ae43-3f01702e05b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:38.770950 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10230de-9a36-46a6-ae43-3f01702e05b4 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:38.773190 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bb2ba49f-502d-47b0-8c14-babd828dcdcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1524a3c2f9f441279b5e23af91df25a3', 'request_id': 'req-bb2ba49f-502d-47b0-8c14-babd828dcdcb'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:38.804939 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bb2ba49f-502d-47b0-8c14-babd828dcdcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1524a3c2f9f441279b5e23af91df25a3', 'request_id': 'req-bb2ba49f-502d-47b0-8c14-babd828dcdcb'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:38.824857 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 891/1780] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:38.827237 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10230de-9a36-46a6-ae43-3f01702e05b4 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:38.831504 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d10230de-9a36-46a6-ae43-3f01702e05b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:38.851038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bb2ba49f-502d-47b0-8c14-babd828dcdcb admin admin] The token cache is being invalidate because project 1524a3c2f9f441279b5e23af91df25a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:30:38.853541 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bb2ba49f-502d-47b0-8c14-babd828dcdcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:38.855594 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bb2ba49f-502d-47b0-8c14-babd828dcdcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:38.863499 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 890/1781] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:30:38 2022] DELETE /identity/v3/projects/1524a3c2f9f441279b5e23af91df25a3 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:38.882862 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b70afb-2508-4c74-92aa-78cf5c7a6184 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:38.882862 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b70afb-2508-4c74-92aa-78cf5c7a6184 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:38.884215 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b70afb-2508-4c74-92aa-78cf5c7a6184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:38.910040 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10230de-9a36-46a6-ae43-3f01702e05b4 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:38.929370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a8b70afb-2508-4c74-92aa-78cf5c7a6184 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:38.931162 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a8b70afb-2508-4c74-92aa-78cf5c7a6184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:39.031434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 891/1782] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:39.040870 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28716fed-9aa5-41b9-adf4-50b42aa10c7f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:39.041497 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28716fed-9aa5-41b9-adf4-50b42aa10c7f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:39.043345 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28716fed-9aa5-41b9-adf4-50b42aa10c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:39.120929 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-28716fed-9aa5-41b9-adf4-50b42aa10c7f None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:39.126307 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-28716fed-9aa5-41b9-adf4-50b42aa10c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:39.162947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 892/1783] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:39.164345 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28716fed-9aa5-41b9-adf4-50b42aa10c7f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:39.184683 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28716fed-9aa5-41b9-adf4-50b42aa10c7f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:39.202249 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598103c3-f6e0-4eb7-8fe8-5da58c94f93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:39.203884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598103c3-f6e0-4eb7-8fe8-5da58c94f93a admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:39.204177 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598103c3-f6e0-4eb7-8fe8-5da58c94f93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:39.204494 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598103c3-f6e0-4eb7-8fe8-5da58c94f93a admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:39.207127 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598103c3-f6e0-4eb7-8fe8-5da58c94f93a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:30:39.207294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598103c3-f6e0-4eb7-8fe8-5da58c94f93a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:39.209375 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598103c3-f6e0-4eb7-8fe8-5da58c94f93a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:39.229438 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:39.257419 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 893/1784] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:30:39.261659 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598103c3-f6e0-4eb7-8fe8-5da58c94f93a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:39.273263 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193a360-17bb-473b-a37f-6a6545e06b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:39.277341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193a360-17bb-473b-a37f-6a6545e06b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:39.277885 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193a360-17bb-473b-a37f-6a6545e06b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:39.278893 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193a360-17bb-473b-a37f-6a6545e06b39 admin admin] PATH_INFO: `/v3/users/01b42cfe21ce4329bd6e5b29ea3c096a` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:39.284087 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193a360-17bb-473b-a37f-6a6545e06b39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01b42cfe21ce4329bd6e5b29ea3c096a)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:39.287682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193a360-17bb-473b-a37f-6a6545e06b39 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:39.292253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598103c3-f6e0-4eb7-8fe8-5da58c94f93a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:39.319067 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f474e08-1f65-4450-ae25-0f15f933e0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:39.329204 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f474e08-1f65-4450-ae25-0f15f933e0bc admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:39.329204 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f474e08-1f65-4450-ae25-0f15f933e0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:39.329204 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f474e08-1f65-4450-ae25-0f15f933e0bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:39.329204 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f474e08-1f65-4450-ae25-0f15f933e0bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:39.335527 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f474e08-1f65-4450-ae25-0f15f933e0bc admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:39.430462 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 894/1785] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:39 2022] POST /identity/v3/projects => generated 403 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:30:39.446673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f474e08-1f65-4450-ae25-0f15f933e0bc admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:39.454174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-1193a360-17bb-473b-a37f-6a6545e06b39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01b42cfe21ce4329bd6e5b29ea3c096a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:39.479851 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-1193a360-17bb-473b-a37f-6a6545e06b39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01b42cfe21ce4329bd6e5b29ea3c096a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:39.496847 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-1193a360-17bb-473b-a37f-6a6545e06b39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01b42cfe21ce4329bd6e5b29ea3c096a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:39.501598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-1193a360-17bb-473b-a37f-6a6545e06b39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01b42cfe21ce4329bd6e5b29ea3c096a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:39.548504 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-1193a360-17bb-473b-a37f-6a6545e06b39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01b42cfe21ce4329bd6e5b29ea3c096a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:39.582127 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 892/1786] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:30:38 2022] DELETE /identity/v3/users/01b42cfe21ce4329bd6e5b29ea3c096a => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:39.583955 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674c819-c720-4a73-9678-f557df8c5481 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:39.587364 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674c819-c720-4a73-9678-f557df8c5481 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:39.587945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674c819-c720-4a73-9678-f557df8c5481 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:39.591963 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 893/1787] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 9 02:30:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:30:39.641734 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f474e08-1f65-4450-ae25-0f15f933e0bc admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:39.692587 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5782ab-71fe-4d66-9651-0c4aa1cbe35b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:39.693098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5782ab-71fe-4d66-9651-0c4aa1cbe35b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:39.693535 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5782ab-71fe-4d66-9651-0c4aa1cbe35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:39.749513 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-ab5782ab-71fe-4d66-9651-0c4aa1cbe35b None None] MFA Rules not processed for user `78fff294b9794a26aa1bbc231fa1133c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:39.750753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ab5782ab-71fe-4d66-9651-0c4aa1cbe35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:39.820401 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65581bf-980c-4ba5-8917-2a44f68868c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:39.825479 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65581bf-980c-4ba5-8917-2a44f68868c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:39.826589 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65581bf-980c-4ba5-8917-2a44f68868c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:39.829407 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65581bf-980c-4ba5-8917-2a44f68868c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:39.830394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65581bf-980c-4ba5-8917-2a44f68868c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:39.836231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65581bf-980c-4ba5-8917-2a44f68868c2 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:39.886058 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 895/1788] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:39 2022] POST /identity/v3/users => generated 302 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:39.886970 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65581bf-980c-4ba5-8917-2a44f68868c2 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:39.892430 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a65581bf-980c-4ba5-8917-2a44f68868c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:39.923938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 894/1789] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 9 02:30:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:39.924840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5782ab-71fe-4d66-9651-0c4aa1cbe35b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:39.926299 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ab5782ab-71fe-4d66-9651-0c4aa1cbe35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:39.927419 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65581bf-980c-4ba5-8917-2a44f68868c2 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:39.942191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f66048-c011-48cb-8c3c-9def543ac6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:39.942920 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f66048-c011-48cb-8c3c-9def543ac6cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:39.943133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f66048-c011-48cb-8c3c-9def543ac6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:39.943411 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f66048-c011-48cb-8c3c-9def543ac6cb admin admin] PATH_INFO: `/v3/projects/2766f448e89b42d7b5fbd4b79b1a65e4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:39.944788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f66048-c011-48cb-8c3c-9def543ac6cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2766f448e89b42d7b5fbd4b79b1a65e4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:39.950847 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f66048-c011-48cb-8c3c-9def543ac6cb admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:39.953343 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:39.966321 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5782ab-71fe-4d66-9651-0c4aa1cbe35b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:39.986825 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8385f-6a41-4684-b8c3-c1e41a11f115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:39.987468 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8385f-6a41-4684-b8c3-c1e41a11f115 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:39.987768 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8385f-6a41-4684-b8c3-c1e41a11f115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:39.988014 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8385f-6a41-4684-b8c3-c1e41a11f115 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:39.988734 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8385f-6a41-4684-b8c3-c1e41a11f115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:39.992561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8385f-6a41-4684-b8c3-c1e41a11f115 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:40.027344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 895/1790] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:40.028880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8385f-6a41-4684-b8c3-c1e41a11f115 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:40.062597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8385f-6a41-4684-b8c3-c1e41a11f115 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:40.080179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-22f66048-c011-48cb-8c3c-9def543ac6cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2766f448e89b42d7b5fbd4b79b1a65e4', 'request_id': 'req-22f66048-c011-48cb-8c3c-9def543ac6cb'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:40.088213 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-22f66048-c011-48cb-8c3c-9def543ac6cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2766f448e89b42d7b5fbd4b79b1a65e4', 'request_id': 'req-22f66048-c011-48cb-8c3c-9def543ac6cb'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:40.096210 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-22f66048-c011-48cb-8c3c-9def543ac6cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2766f448e89b42d7b5fbd4b79b1a65e4', 'request_id': 'req-22f66048-c011-48cb-8c3c-9def543ac6cb'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:40.107049 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:40.115075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-22f66048-c011-48cb-8c3c-9def543ac6cb admin admin] The token cache is being invalidate because project 2766f448e89b42d7b5fbd4b79b1a65e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:30:40.115075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-22f66048-c011-48cb-8c3c-9def543ac6cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:40.117172 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-22f66048-c011-48cb-8c3c-9def543ac6cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:40.132480 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 896/1791] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:30:39 2022] DELETE /identity/v3/projects/2766f448e89b42d7b5fbd4b79b1a65e4 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:40.132480 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f66048-c011-48cb-8c3c-9def543ac6cb admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:40.132480 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-22f66048-c011-48cb-8c3c-9def543ac6cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:40.221080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f66048-c011-48cb-8c3c-9def543ac6cb admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:40.229722 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10cdc5e-76b1-41e2-a083-1c3946aaebe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:40.230260 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cdc5e-76b1-41e2-a083-1c3946aaebe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:40.230537 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cdc5e-76b1-41e2-a083-1c3946aaebe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:40.230812 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cdc5e-76b1-41e2-a083-1c3946aaebe0 admin admin] PATH_INFO: `/v3/users/570d6f91f1734e4293a4eb38d4fe4ba8` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:40.232940 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10cdc5e-76b1-41e2-a083-1c3946aaebe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=570d6f91f1734e4293a4eb38d4fe4ba8)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:40.237539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10cdc5e-76b1-41e2-a083-1c3946aaebe0 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:40.246998 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7360df-e54d-47ca-b33e-940c4a7c4051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:40.247640 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7360df-e54d-47ca-b33e-940c4a7c4051 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:40.247923 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7360df-e54d-47ca-b33e-940c4a7c4051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:40.252645 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7360df-e54d-47ca-b33e-940c4a7c4051 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:40.253428 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7360df-e54d-47ca-b33e-940c4a7c4051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:40.255865 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7360df-e54d-47ca-b33e-940c4a7c4051 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:40.294328 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 896/1792] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:40.298395 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7360df-e54d-47ca-b33e-940c4a7c4051 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:40.301920 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-fb7360df-e54d-47ca-b33e-940c4a7c4051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:40.334774 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7360df-e54d-47ca-b33e-940c4a7c4051 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:40.358884 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb4c55-5484-4ed3-b4b1-13d9f2a571bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:40.359645 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb4c55-5484-4ed3-b4b1-13d9f2a571bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:40.360199 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb4c55-5484-4ed3-b4b1-13d9f2a571bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:40.360477 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb4c55-5484-4ed3-b4b1-13d9f2a571bb admin admin] PATH_INFO: `/v3/projects/c39c7d1ca99d4a878450f5ea733086ac/users/589fc45f2ad54cfc8fed48d26b0bf5fa/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:40.387430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb4c55-5484-4ed3-b4b1-13d9f2a571bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c39c7d1ca99d4a878450f5ea733086ac, user_id=589fc45f2ad54cfc8fed48d26b0bf5fa, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:40.391192 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb4c55-5484-4ed3-b4b1-13d9f2a571bb admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:40.401279 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d10cdc5e-76b1-41e2-a083-1c3946aaebe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '570d6f91f1734e4293a4eb38d4fe4ba8'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:40.422080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d10cdc5e-76b1-41e2-a083-1c3946aaebe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '570d6f91f1734e4293a4eb38d4fe4ba8'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:40.422975 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d10cdc5e-76b1-41e2-a083-1c3946aaebe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '570d6f91f1734e4293a4eb38d4fe4ba8'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:40.430970 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 897/1793] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:40 2022] PUT /identity/v3/projects/c39c7d1ca99d4a878450f5ea733086ac/users/589fc45f2ad54cfc8fed48d26b0bf5fa/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:40.438116 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c000c4a-5d08-46bf-8f09-7bae3add9566 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:40.438412 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c000c4a-5d08-46bf-8f09-7bae3add9566 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:40.438755 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c000c4a-5d08-46bf-8f09-7bae3add9566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:40.473153 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d10cdc5e-76b1-41e2-a083-1c3946aaebe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '570d6f91f1734e4293a4eb38d4fe4ba8'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:40.499006 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d10cdc5e-76b1-41e2-a083-1c3946aaebe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '570d6f91f1734e4293a4eb38d4fe4ba8'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:40.499997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-6c000c4a-5d08-46bf-8f09-7bae3add9566 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:40.503878 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6c000c4a-5d08-46bf-8f09-7bae3add9566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:40.513989 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 897/1794] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:30:40 2022] DELETE /identity/v3/users/570d6f91f1734e4293a4eb38d4fe4ba8 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:40.672973 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10cdc5e-76b1-41e2-a083-1c3946aaebe0 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:40.675994 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d10cdc5e-76b1-41e2-a083-1c3946aaebe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:40.774815 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 898/1795] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:40.776379 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c000c4a-5d08-46bf-8f09-7bae3add9566 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:40.780055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6c000c4a-5d08-46bf-8f09-7bae3add9566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:40.869359 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10cdc5e-76b1-41e2-a083-1c3946aaebe0 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:40.883261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5e7c7-16e9-4e3f-8217-976f4d2d351b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:40.884193 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5e7c7-16e9-4e3f-8217-976f4d2d351b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:40.884571 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5e7c7-16e9-4e3f-8217-976f4d2d351b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:40.884940 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5e7c7-16e9-4e3f-8217-976f4d2d351b admin admin] PATH_INFO: `/v3/users/6c2396d6d2534969a5ad4a9df2cb1efd` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:40.886572 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5e7c7-16e9-4e3f-8217-976f4d2d351b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c2396d6d2534969a5ad4a9df2cb1efd)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:40.894454 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5e7c7-16e9-4e3f-8217-976f4d2d351b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:40.962306 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:41.017194 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:41.033373 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c000c4a-5d08-46bf-8f09-7bae3add9566 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:41.056993 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f505c-c557-4324-bf03-48a24161b8a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:41.057902 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f505c-c557-4324-bf03-48a24161b8a7 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:41.058598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f505c-c557-4324-bf03-48a24161b8a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:41.058951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f505c-c557-4324-bf03-48a24161b8a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:41.063995 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-df7f505c-c557-4324-bf03-48a24161b8a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:41.110588 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f505c-c557-4324-bf03-48a24161b8a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:41.112372 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f505c-c557-4324-bf03-48a24161b8a7 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:41.119112 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d4c5e7c7-16e9-4e3f-8217-976f4d2d351b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c2396d6d2534969a5ad4a9df2cb1efd'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:41.155535 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d4c5e7c7-16e9-4e3f-8217-976f4d2d351b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c2396d6d2534969a5ad4a9df2cb1efd'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:41.165548 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d4c5e7c7-16e9-4e3f-8217-976f4d2d351b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c2396d6d2534969a5ad4a9df2cb1efd'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:41.174347 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 899/1796] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:41.175330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f505c-c557-4324-bf03-48a24161b8a7 service nova] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:41.177878 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-df7f505c-c557-4324-bf03-48a24161b8a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:41.189255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d4c5e7c7-16e9-4e3f-8217-976f4d2d351b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c2396d6d2534969a5ad4a9df2cb1efd'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:41.211314 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-d4c5e7c7-16e9-4e3f-8217-976f4d2d351b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c2396d6d2534969a5ad4a9df2cb1efd'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:41.236897 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 898/1797] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:30:40 2022] DELETE /identity/v3/users/6c2396d6d2534969a5ad4a9df2cb1efd => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:41.246256 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad02fe-701e-4982-8b7d-4926b37cfe99 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:41.246911 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad02fe-701e-4982-8b7d-4926b37cfe99 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:41.246911 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad02fe-701e-4982-8b7d-4926b37cfe99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:41.318912 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-3dad02fe-701e-4982-8b7d-4926b37cfe99 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:41.320143 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3dad02fe-701e-4982-8b7d-4926b37cfe99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:41.422114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f505c-c557-4324-bf03-48a24161b8a7 service nova] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:41.599350 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f2478-77db-4dd0-a9b4-79ebba56a365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:41.613507 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f2478-77db-4dd0-a9b4-79ebba56a365 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:41.614197 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f2478-77db-4dd0-a9b4-79ebba56a365 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:41.614661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f2478-77db-4dd0-a9b4-79ebba56a365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:41.624627 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d25f2478-77db-4dd0-a9b4-79ebba56a365 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:41.724098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 899/1798] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:41.731206 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00341fd-2790-4240-bc3c-6c13a3d3e65d None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:41.737515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00341fd-2790-4240-bc3c-6c13a3d3e65d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:41.738136 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00341fd-2790-4240-bc3c-6c13a3d3e65d None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:41.742506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 900/1799] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 9 02:30:41 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:30:41.779096 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00341fd-2790-4240-bc3c-6c13a3d3e65d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:41.782508 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b00341fd-2790-4240-bc3c-6c13a3d3e65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:41.843843 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00341fd-2790-4240-bc3c-6c13a3d3e65d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:41.858835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ca670-8dc6-4c00-a06d-273e4370def5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:41.860493 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ca670-8dc6-4c00-a06d-273e4370def5 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:41.861454 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ca670-8dc6-4c00-a06d-273e4370def5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:41.864167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ca670-8dc6-4c00-a06d-273e4370def5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:41.928959 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ca670-8dc6-4c00-a06d-273e4370def5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:41.928959 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ca670-8dc6-4c00-a06d-273e4370def5 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:41.990733 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f2478-77db-4dd0-a9b4-79ebba56a365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:42.003479 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 901/1800] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:42.009083 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f2478-77db-4dd0-a9b4-79ebba56a365 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:42.010517 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb90d12-491f-43cd-a2b1-af0012b989cf None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:42.015159 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb90d12-491f-43cd-a2b1-af0012b989cf None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:42.017640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb90d12-491f-43cd-a2b1-af0012b989cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:42.087611 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8bb90d12-491f-43cd-a2b1-af0012b989cf None None] MFA Rules not processed for user `78fff294b9794a26aa1bbc231fa1133c`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:42.090249 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8bb90d12-491f-43cd-a2b1-af0012b989cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:42.099561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 900/1801] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 925 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:42.250214 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 902/1802] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 9 02:30:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:42.670928 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f2478-77db-4dd0-a9b4-79ebba56a365 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:42.670928 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d25f2478-77db-4dd0-a9b4-79ebba56a365 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:42.737561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f2478-77db-4dd0-a9b4-79ebba56a365 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:42.750248 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e18c4-45b8-40d9-bd82-533470692b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:42.751711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e18c4-45b8-40d9-bd82-533470692b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:42.752157 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e18c4-45b8-40d9-bd82-533470692b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:42.752676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e18c4-45b8-40d9-bd82-533470692b57 admin admin] PATH_INFO: `/v3/projects/06eac34c232944fe858088a5b95a5637` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:42.755014 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e18c4-45b8-40d9-bd82-533470692b57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06eac34c232944fe858088a5b95a5637)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:42.759700 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e18c4-45b8-40d9-bd82-533470692b57 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:42.900283 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6f4e18c4-45b8-40d9-bd82-533470692b57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06eac34c232944fe858088a5b95a5637', 'request_id': 'req-6f4e18c4-45b8-40d9-bd82-533470692b57'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:42.908341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:42.910487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6f4e18c4-45b8-40d9-bd82-533470692b57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06eac34c232944fe858088a5b95a5637', 'request_id': 'req-6f4e18c4-45b8-40d9-bd82-533470692b57'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:42.934506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6f4e18c4-45b8-40d9-bd82-533470692b57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06eac34c232944fe858088a5b95a5637', 'request_id': 'req-6f4e18c4-45b8-40d9-bd82-533470692b57'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:42.966969 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6f4e18c4-45b8-40d9-bd82-533470692b57 admin admin] The token cache is being invalidate because project 06eac34c232944fe858088a5b95a5637 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:30:42.967278 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6f4e18c4-45b8-40d9-bd82-533470692b57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:42.970518 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6f4e18c4-45b8-40d9-bd82-533470692b57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:42.979801 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 901/1803] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:30:42 2022] DELETE /identity/v3/projects/06eac34c232944fe858088a5b95a5637 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:42.993320 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb90d12-491f-43cd-a2b1-af0012b989cf None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:43.005155 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e18c4-45b8-40d9-bd82-533470692b57 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:43.006839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6f4e18c4-45b8-40d9-bd82-533470692b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:43.013669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb90d12-491f-43cd-a2b1-af0012b989cf None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:43.054003 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:43.155110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e18c4-45b8-40d9-bd82-533470692b57 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:43.167033 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29858c8e-37bc-4c4c-8c72-8a3cf136f6dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:43.167741 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29858c8e-37bc-4c4c-8c72-8a3cf136f6dc service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:43.168035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29858c8e-37bc-4c4c-8c72-8a3cf136f6dc service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:43.168447 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29858c8e-37bc-4c4c-8c72-8a3cf136f6dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:43.170550 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-29858c8e-37bc-4c4c-8c72-8a3cf136f6dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:43.194494 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29858c8e-37bc-4c4c-8c72-8a3cf136f6dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:43.200232 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29858c8e-37bc-4c4c-8c72-8a3cf136f6dc service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:43.238779 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 902/1804] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:30:43.242574 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9db3d4-0be4-4bda-99ef-92a97352f27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:43.243390 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9db3d4-0be4-4bda-99ef-92a97352f27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:43.243875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9db3d4-0be4-4bda-99ef-92a97352f27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:43.244150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9db3d4-0be4-4bda-99ef-92a97352f27b admin admin] PATH_INFO: `/v3/users/9e6de279cf0e4a25bb428f1401469f36` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:43.246567 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9db3d4-0be4-4bda-99ef-92a97352f27b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e6de279cf0e4a25bb428f1401469f36)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:43.248577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9db3d4-0be4-4bda-99ef-92a97352f27b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:43.436797 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7c9db3d4-0be4-4bda-99ef-92a97352f27b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e6de279cf0e4a25bb428f1401469f36'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:43.463990 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7c9db3d4-0be4-4bda-99ef-92a97352f27b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e6de279cf0e4a25bb428f1401469f36'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:43.464875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7c9db3d4-0be4-4bda-99ef-92a97352f27b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e6de279cf0e4a25bb428f1401469f36'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:43.483649 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29858c8e-37bc-4c4c-8c72-8a3cf136f6dc service nova] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:43.486543 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-29858c8e-37bc-4c4c-8c72-8a3cf136f6dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:43.506080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7c9db3d4-0be4-4bda-99ef-92a97352f27b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e6de279cf0e4a25bb428f1401469f36'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:43.521189 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29858c8e-37bc-4c4c-8c72-8a3cf136f6dc service nova] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:43.529456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7c9db3d4-0be4-4bda-99ef-92a97352f27b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e6de279cf0e4a25bb428f1401469f36'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:43.535636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea5ee4-8957-421e-ac60-d5e8dc2a74ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:43.536269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea5ee4-8957-421e-ac60-d5e8dc2a74ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:43.536612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea5ee4-8957-421e-ac60-d5e8dc2a74ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:43.536818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea5ee4-8957-421e-ac60-d5e8dc2a74ae admin admin] PATH_INFO: `/v3/projects/4f1980e5cfa1465cb9effcbcfbaf3554` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:43.542684 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea5ee4-8957-421e-ac60-d5e8dc2a74ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f1980e5cfa1465cb9effcbcfbaf3554)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:43.544554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea5ee4-8957-421e-ac60-d5e8dc2a74ae admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:43.548966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 903/1805] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:30:42 2022] DELETE /identity/v3/users/9e6de279cf0e4a25bb428f1401469f36 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:43.731662 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-daea5ee4-8957-421e-ac60-d5e8dc2a74ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f1980e5cfa1465cb9effcbcfbaf3554', 'request_id': 'req-daea5ee4-8957-421e-ac60-d5e8dc2a74ae'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:43.748121 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-daea5ee4-8957-421e-ac60-d5e8dc2a74ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f1980e5cfa1465cb9effcbcfbaf3554', 'request_id': 'req-daea5ee4-8957-421e-ac60-d5e8dc2a74ae'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:43.768726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-daea5ee4-8957-421e-ac60-d5e8dc2a74ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f1980e5cfa1465cb9effcbcfbaf3554', 'request_id': 'req-daea5ee4-8957-421e-ac60-d5e8dc2a74ae'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:43.801911 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-daea5ee4-8957-421e-ac60-d5e8dc2a74ae admin admin] The token cache is being invalidate because project 4f1980e5cfa1465cb9effcbcfbaf3554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:30:43.802367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-daea5ee4-8957-421e-ac60-d5e8dc2a74ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:43.803172 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-daea5ee4-8957-421e-ac60-d5e8dc2a74ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:43.808680 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 903/1806] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:30:43 2022] DELETE /identity/v3/projects/4f1980e5cfa1465cb9effcbcfbaf3554 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:30:43.810579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0196f-4c35-49e8-996d-538d0a68676b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:43.810897 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0196f-4c35-49e8-996d-538d0a68676b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:43.811178 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0196f-4c35-49e8-996d-538d0a68676b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:43.868037 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-90f0196f-4c35-49e8-996d-538d0a68676b None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:43.878241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-90f0196f-4c35-49e8-996d-538d0a68676b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:43.901095 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea5ee4-8957-421e-ac60-d5e8dc2a74ae admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:43.901095 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-daea5ee4-8957-421e-ac60-d5e8dc2a74ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:44.013809 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 904/1807] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:44.023379 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:44.031848 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbb001-ac7d-4aa4-a650-a7c64c6e1f00 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:44.032130 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbb001-ac7d-4aa4-a650-a7c64c6e1f00 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:44.032402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbb001-ac7d-4aa4-a650-a7c64c6e1f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:44.098019 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea5ee4-8957-421e-ac60-d5e8dc2a74ae admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:44.102050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-20dbb001-ac7d-4aa4-a650-a7c64c6e1f00 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:44.104939 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-20dbb001-ac7d-4aa4-a650-a7c64c6e1f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:44.129815 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 905/1808] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:44.134144 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbb001-ac7d-4aa4-a650-a7c64c6e1f00 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:44.139688 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb1381-7436-4e33-b806-a6f9645c0488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:44.139688 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb1381-7436-4e33-b806-a6f9645c0488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:44.139688 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb1381-7436-4e33-b806-a6f9645c0488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:44.146367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb1381-7436-4e33-b806-a6f9645c0488 admin admin] PATH_INFO: `/v3/projects/fc07bf2c662949489a4e14676cabff98` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:44.151099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb1381-7436-4e33-b806-a6f9645c0488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc07bf2c662949489a4e14676cabff98)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:44.156631 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbb001-ac7d-4aa4-a650-a7c64c6e1f00 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:44.158909 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb1381-7436-4e33-b806-a6f9645c0488 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:44.170242 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701daee5-c0b3-486e-ae05-ed539c46d71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:44.170871 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701daee5-c0b3-486e-ae05-ed539c46d71d admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:44.173452 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701daee5-c0b3-486e-ae05-ed539c46d71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:44.173675 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701daee5-c0b3-486e-ae05-ed539c46d71d admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:44.179832 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701daee5-c0b3-486e-ae05-ed539c46d71d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:30:44.180690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701daee5-c0b3-486e-ae05-ed539c46d71d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:44.183959 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701daee5-c0b3-486e-ae05-ed539c46d71d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:44.205988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 906/1809] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:30:44.211428 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701daee5-c0b3-486e-ae05-ed539c46d71d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:44.244776 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701daee5-c0b3-486e-ae05-ed539c46d71d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:44.251594 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8555d-3a85-4489-9c91-3740a251f1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:44.254095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8555d-3a85-4489-9c91-3740a251f1e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:44.255599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8555d-3a85-4489-9c91-3740a251f1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:44.256076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8555d-3a85-4489-9c91-3740a251f1e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:44.257777 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8555d-3a85-4489-9c91-3740a251f1e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:44.261386 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8555d-3a85-4489-9c91-3740a251f1e4 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:44.295287 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:44.314775 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8cfb1381-7436-4e33-b806-a6f9645c0488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc07bf2c662949489a4e14676cabff98', 'request_id': 'req-8cfb1381-7436-4e33-b806-a6f9645c0488'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:44.336197 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8cfb1381-7436-4e33-b806-a6f9645c0488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc07bf2c662949489a4e14676cabff98', 'request_id': 'req-8cfb1381-7436-4e33-b806-a6f9645c0488'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:44.343789 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 907/1810] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:44 2022] POST /identity/v3/projects => generated 369 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:44.347835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8555d-3a85-4489-9c91-3740a251f1e4 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:44.367153 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8cfb1381-7436-4e33-b806-a6f9645c0488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc07bf2c662949489a4e14676cabff98', 'request_id': 'req-8cfb1381-7436-4e33-b806-a6f9645c0488'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:44.408624 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8cfb1381-7436-4e33-b806-a6f9645c0488 admin admin] The token cache is being invalidate because project fc07bf2c662949489a4e14676cabff98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:30:44.408926 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8cfb1381-7436-4e33-b806-a6f9645c0488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:44.409677 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8cfb1381-7436-4e33-b806-a6f9645c0488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:44.415429 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 904/1811] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:30:43 2022] DELETE /identity/v3/projects/fc07bf2c662949489a4e14676cabff98 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:44.416708 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936424f-9a74-4038-b8b7-fb72c07e53df None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:44.417004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936424f-9a74-4038-b8b7-fb72c07e53df None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:44.417411 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936424f-9a74-4038-b8b7-fb72c07e53df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:44.485703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a936424f-9a74-4038-b8b7-fb72c07e53df None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:44.486532 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a936424f-9a74-4038-b8b7-fb72c07e53df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:44.555019 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8555d-3a85-4489-9c91-3740a251f1e4 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:44.566368 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76514645-11d9-41de-91f2-f9cc71471304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:44.567673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76514645-11d9-41de-91f2-f9cc71471304 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:44.568179 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76514645-11d9-41de-91f2-f9cc71471304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:44.569176 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76514645-11d9-41de-91f2-f9cc71471304 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:44.570707 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76514645-11d9-41de-91f2-f9cc71471304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:44.573597 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76514645-11d9-41de-91f2-f9cc71471304 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:44.635400 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 908/1812] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:44 2022] POST /identity/v3/users => generated 285 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:44.639059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76514645-11d9-41de-91f2-f9cc71471304 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:44.642313 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-76514645-11d9-41de-91f2-f9cc71471304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:44.699289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76514645-11d9-41de-91f2-f9cc71471304 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:44.721379 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90bd08-192b-4b6c-a7d5-d1a8827abd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:44.723473 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90bd08-192b-4b6c-a7d5-d1a8827abd81 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:44.724211 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90bd08-192b-4b6c-a7d5-d1a8827abd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:44.724794 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90bd08-192b-4b6c-a7d5-d1a8827abd81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:44.726340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90bd08-192b-4b6c-a7d5-d1a8827abd81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:44.730862 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90bd08-192b-4b6c-a7d5-d1a8827abd81 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:44.735079 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 905/1813] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:44.744779 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d450be-a6ee-4347-8467-4da8da23ceb9 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:44.745197 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d450be-a6ee-4347-8467-4da8da23ceb9 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:44.745402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d450be-a6ee-4347-8467-4da8da23ceb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:44.760735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 909/1814] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:44.765209 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90bd08-192b-4b6c-a7d5-d1a8827abd81 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:44.793968 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90bd08-192b-4b6c-a7d5-d1a8827abd81 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:44.811068 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec12fa-6794-4986-a04b-b5c22b63180a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:44.815581 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-67d450be-a6ee-4347-8467-4da8da23ceb9 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:44.820298 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec12fa-6794-4986-a04b-b5c22b63180a admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:44.821124 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec12fa-6794-4986-a04b-b5c22b63180a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:44.822334 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec12fa-6794-4986-a04b-b5c22b63180a admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:44.823716 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-67d450be-a6ee-4347-8467-4da8da23ceb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:44.825166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec12fa-6794-4986-a04b-b5c22b63180a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:44.830814 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec12fa-6794-4986-a04b-b5c22b63180a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:44.848689 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 906/1815] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:44.854165 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d450be-a6ee-4347-8467-4da8da23ceb9 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:44.871853 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d450be-a6ee-4347-8467-4da8da23ceb9 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:44.873339 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 910/1816] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:44.874600 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec12fa-6794-4986-a04b-b5c22b63180a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:44.896185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d447a73-eda6-4033-a45c-83596e9f5635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:44.906311 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d447a73-eda6-4033-a45c-83596e9f5635 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:44.907419 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d447a73-eda6-4033-a45c-83596e9f5635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:44.907682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d447a73-eda6-4033-a45c-83596e9f5635 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:44.908770 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d447a73-eda6-4033-a45c-83596e9f5635 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:30:44.909205 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d447a73-eda6-4033-a45c-83596e9f5635 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:44.916729 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec12fa-6794-4986-a04b-b5c22b63180a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:44.920126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d447a73-eda6-4033-a45c-83596e9f5635 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:44.943842 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc91b1c-86c3-49e6-9149-a34a5db3e01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:44.944471 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc91b1c-86c3-49e6-9149-a34a5db3e01b admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:44.944768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc91b1c-86c3-49e6-9149-a34a5db3e01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:44.945046 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc91b1c-86c3-49e6-9149-a34a5db3e01b admin admin] PATH_INFO: `/v3/projects/e1b1b8e7422c4e558521ada7aab9ec2c/users/423bdab2759c4af2b2c819886fb37bb0/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:44.965913 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 907/1817] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:30:44.970425 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d447a73-eda6-4033-a45c-83596e9f5635 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:44.993420 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc91b1c-86c3-49e6-9149-a34a5db3e01b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b1b8e7422c4e558521ada7aab9ec2c, user_id=423bdab2759c4af2b2c819886fb37bb0, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:45.000765 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc91b1c-86c3-49e6-9149-a34a5db3e01b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:45.027326 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d447a73-eda6-4033-a45c-83596e9f5635 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:45.044173 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 911/1818] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:44 2022] PUT /identity/v3/projects/e1b1b8e7422c4e558521ada7aab9ec2c/users/423bdab2759c4af2b2c819886fb37bb0/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:45.055982 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f094f-55a5-4a3f-a117-bcffd11c57df None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:45.056616 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f094f-55a5-4a3f-a117-bcffd11c57df None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:45.057257 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f094f-55a5-4a3f-a117-bcffd11c57df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:45.136206 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-465f094f-55a5-4a3f-a117-bcffd11c57df None None] MFA Rules not processed for user `423bdab2759c4af2b2c819886fb37bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:45.137826 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-465f094f-55a5-4a3f-a117-bcffd11c57df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:45.268658 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca1a88-0661-4023-9cd9-9906a27db231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:45.271050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca1a88-0661-4023-9cd9-9906a27db231 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:45.271385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca1a88-0661-4023-9cd9-9906a27db231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:45.273172 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca1a88-0661-4023-9cd9-9906a27db231 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:45.275944 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca1a88-0661-4023-9cd9-9906a27db231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:45.282741 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca1a88-0661-4023-9cd9-9906a27db231 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:45.297739 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:45.345413 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 912/1819] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:45.347238 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f094f-55a5-4a3f-a117-bcffd11c57df None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:45.377680 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 908/1820] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:44 2022] POST /identity/v3/projects => generated 377 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:30:45.380311 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca1a88-0661-4023-9cd9-9906a27db231 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:45.432230 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f094f-55a5-4a3f-a117-bcffd11c57df None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:45.558388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:45.597884 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca1a88-0661-4023-9cd9-9906a27db231 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:45.624749 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb61a5-f428-43bb-81e6-d3797feadb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:45.624749 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb61a5-f428-43bb-81e6-d3797feadb13 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:45.624749 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb61a5-f428-43bb-81e6-d3797feadb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:45.624749 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb61a5-f428-43bb-81e6-d3797feadb13 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:45.625182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb61a5-f428-43bb-81e6-d3797feadb13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:45.625182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb61a5-f428-43bb-81e6-d3797feadb13 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:45.669989 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 909/1821] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:45 2022] POST /identity/v3/users => generated 289 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:45.673867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb61a5-f428-43bb-81e6-d3797feadb13 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:45.680508 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf57b84-bf00-4952-9ade-2fe28c89ac11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:45.683646 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf57b84-bf00-4952-9ade-2fe28c89ac11 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:45.683938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf57b84-bf00-4952-9ade-2fe28c89ac11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:45.684962 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf57b84-bf00-4952-9ade-2fe28c89ac11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:45.687073 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf57b84-bf00-4952-9ade-2fe28c89ac11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:45.693162 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf57b84-bf00-4952-9ade-2fe28c89ac11 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:45.703341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb61a5-f428-43bb-81e6-d3797feadb13 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:45.714487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313a693-f610-4c53-a831-f2b060ee07e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:45.716084 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313a693-f610-4c53-a831-f2b060ee07e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:45.729174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313a693-f610-4c53-a831-f2b060ee07e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:45.732115 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313a693-f610-4c53-a831-f2b060ee07e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:45.733629 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313a693-f610-4c53-a831-f2b060ee07e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:45.742099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313a693-f610-4c53-a831-f2b060ee07e9 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:45.759404 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 910/1822] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:45.763853 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313a693-f610-4c53-a831-f2b060ee07e9 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:45.776162 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 913/1823] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:45 2022] POST /identity/v3/projects => generated 367 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:45.783053 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf57b84-bf00-4952-9ade-2fe28c89ac11 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:45.796627 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313a693-f610-4c53-a831-f2b060ee07e9 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:45.909659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae922cf-1c92-4b0e-bdae-787f4e5a9332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:45.914223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae922cf-1c92-4b0e-bdae-787f4e5a9332 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:45.915813 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae922cf-1c92-4b0e-bdae-787f4e5a9332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:45.915986 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae922cf-1c92-4b0e-bdae-787f4e5a9332 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:45.919156 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae922cf-1c92-4b0e-bdae-787f4e5a9332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:45.921332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae922cf-1c92-4b0e-bdae-787f4e5a9332 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:45.952239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 911/1824] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:45.954443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae922cf-1c92-4b0e-bdae-787f4e5a9332 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:45.975950 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf57b84-bf00-4952-9ade-2fe28c89ac11 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:45.981837 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae922cf-1c92-4b0e-bdae-787f4e5a9332 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:45.989202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c5d8e-d580-4370-851c-eb23672602ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:45.990550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c5d8e-d580-4370-851c-eb23672602ca admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:45.990976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c5d8e-d580-4370-851c-eb23672602ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:45.991231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c5d8e-d580-4370-851c-eb23672602ca admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:45.992056 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c5d8e-d580-4370-851c-eb23672602ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:45.996458 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c5d8e-d580-4370-851c-eb23672602ca admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:46.006360 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e73785-9f94-486a-885d-a3ccabee1bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:46.010928 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e73785-9f94-486a-885d-a3ccabee1bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:46.011852 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e73785-9f94-486a-885d-a3ccabee1bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:46.012636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e73785-9f94-486a-885d-a3ccabee1bf6 admin admin] PATH_INFO: `/v3/projects/662665d2ce1f4714b895fbb3f529b103/users/2a79a286f099403d9ed453c865a74bdc/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:46.055971 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e73785-9f94-486a-885d-a3ccabee1bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=662665d2ce1f4714b895fbb3f529b103, user_id=2a79a286f099403d9ed453c865a74bdc, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:46.058857 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e73785-9f94-486a-885d-a3ccabee1bf6 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:46.059386 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 914/1825] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:45 2022] POST /identity/v3/users => generated 290 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:30:46.060859 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c5d8e-d580-4370-851c-eb23672602ca admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:46.104798 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c5d8e-d580-4370-851c-eb23672602ca admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:46.112958 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 912/1826] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:45 2022] PUT /identity/v3/projects/662665d2ce1f4714b895fbb3f529b103/users/2a79a286f099403d9ed453c865a74bdc/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:46.114650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79256ac-4879-4c60-8d5d-f48f514e6acc None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:46.114950 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79256ac-4879-4c60-8d5d-f48f514e6acc None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:46.115227 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79256ac-4879-4c60-8d5d-f48f514e6acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:46.170644 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-f79256ac-4879-4c60-8d5d-f48f514e6acc None None] MFA Rules not processed for user `2a79a286f099403d9ed453c865a74bdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:46.171813 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f79256ac-4879-4c60-8d5d-f48f514e6acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:46.239761 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:46.310145 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004789aa-cd1c-4366-afc3-c2bccca3077b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:46.313591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004789aa-cd1c-4366-afc3-c2bccca3077b admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:46.313962 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004789aa-cd1c-4366-afc3-c2bccca3077b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:46.314240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004789aa-cd1c-4366-afc3-c2bccca3077b admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:46.319162 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004789aa-cd1c-4366-afc3-c2bccca3077b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:46.320902 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004789aa-cd1c-4366-afc3-c2bccca3077b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:46.347003 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 913/1828] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:46.347197 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 915/1827] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:46.348200 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79256ac-4879-4c60-8d5d-f48f514e6acc None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:46.348476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004789aa-cd1c-4366-afc3-c2bccca3077b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:46.377277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79256ac-4879-4c60-8d5d-f48f514e6acc None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:46.379175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004789aa-cd1c-4366-afc3-c2bccca3077b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:46.384082 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7d008-dd34-4293-91e4-b06772be43d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:46.384917 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7d008-dd34-4293-91e4-b06772be43d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:46.385369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7d008-dd34-4293-91e4-b06772be43d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:46.385977 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7d008-dd34-4293-91e4-b06772be43d7 admin admin] PATH_INFO: `/v3/projects/65d528bda3304baab28be5ca693c3149/users/292eb0070700428db73135d8dbaccfb2/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:46.401232 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a7b68-e759-413a-9b18-2ffc0fbc3c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:46.401870 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a7b68-e759-413a-9b18-2ffc0fbc3c3f admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:46.402803 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a7b68-e759-413a-9b18-2ffc0fbc3c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:46.402803 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a7b68-e759-413a-9b18-2ffc0fbc3c3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:46.403041 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a7b68-e759-413a-9b18-2ffc0fbc3c3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:46.407778 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a7b68-e759-413a-9b18-2ffc0fbc3c3f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:46.419888 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7d008-dd34-4293-91e4-b06772be43d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d528bda3304baab28be5ca693c3149, user_id=292eb0070700428db73135d8dbaccfb2, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:46.425457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7d008-dd34-4293-91e4-b06772be43d7 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:46.457878 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 914/1829] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:46 2022] PUT /identity/v3/projects/65d528bda3304baab28be5ca693c3149/users/292eb0070700428db73135d8dbaccfb2/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:46.457878 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7d008-dd34-4293-91e4-b06772be43d7 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:46.464783 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8cb7d008-dd34-4293-91e4-b06772be43d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:46.496699 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 916/1830] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:46 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:46.497783 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a7b68-e759-413a-9b18-2ffc0fbc3c3f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:46.533461 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:46.607562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7d008-dd34-4293-91e4-b06772be43d7 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:46.725289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df7af2-6d85-48ce-b177-83843903b54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:46.725966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df7af2-6d85-48ce-b177-83843903b54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:46.726244 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df7af2-6d85-48ce-b177-83843903b54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:46.727412 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df7af2-6d85-48ce-b177-83843903b54b admin admin] PATH_INFO: `/v3/projects/de9fed28b20045649bff2e56e4fa05f3` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:46.742425 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df7af2-6d85-48ce-b177-83843903b54b admin admin] RBAC: Authorizing `identity:delete_project(project_id=de9fed28b20045649bff2e56e4fa05f3)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:46.745974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df7af2-6d85-48ce-b177-83843903b54b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:46.749296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a7b68-e759-413a-9b18-2ffc0fbc3c3f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:46.767358 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49eea3-fba0-40f6-9ee3-8db2038a165c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:46.768586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49eea3-fba0-40f6-9ee3-8db2038a165c admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:46.781210 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49eea3-fba0-40f6-9ee3-8db2038a165c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:46.781573 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49eea3-fba0-40f6-9ee3-8db2038a165c admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:46.782352 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49eea3-fba0-40f6-9ee3-8db2038a165c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:46.784068 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49eea3-fba0-40f6-9ee3-8db2038a165c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:46.811311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 917/1831] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:46.812324 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49eea3-fba0-40f6-9ee3-8db2038a165c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:46.834171 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49eea3-fba0-40f6-9ee3-8db2038a165c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:46.883949 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-48df7af2-6d85-48ce-b177-83843903b54b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de9fed28b20045649bff2e56e4fa05f3', 'request_id': 'req-48df7af2-6d85-48ce-b177-83843903b54b'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:46.887086 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:46.902763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-48df7af2-6d85-48ce-b177-83843903b54b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de9fed28b20045649bff2e56e4fa05f3', 'request_id': 'req-48df7af2-6d85-48ce-b177-83843903b54b'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:46.926064 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-48df7af2-6d85-48ce-b177-83843903b54b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de9fed28b20045649bff2e56e4fa05f3', 'request_id': 'req-48df7af2-6d85-48ce-b177-83843903b54b'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:46.963119 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-48df7af2-6d85-48ce-b177-83843903b54b admin admin] The token cache is being invalidate because project de9fed28b20045649bff2e56e4fa05f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:30:46.963448 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-48df7af2-6d85-48ce-b177-83843903b54b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:46.965637 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-48df7af2-6d85-48ce-b177-83843903b54b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:46.975042 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 915/1832] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:30:46 2022] DELETE /identity/v3/projects/de9fed28b20045649bff2e56e4fa05f3 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:46.976102 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df7af2-6d85-48ce-b177-83843903b54b admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:46.989105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-48df7af2-6d85-48ce-b177-83843903b54b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:47.068341 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57140b01-0155-452e-97fb-1a78cdbbcf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:47.069139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57140b01-0155-452e-97fb-1a78cdbbcf17 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:47.069803 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57140b01-0155-452e-97fb-1a78cdbbcf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:47.069803 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57140b01-0155-452e-97fb-1a78cdbbcf17 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:47.071852 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57140b01-0155-452e-97fb-1a78cdbbcf17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:47.076864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57140b01-0155-452e-97fb-1a78cdbbcf17 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:47.127597 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 918/1833] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:46 2022] POST /identity/v3/users => generated 289 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:47.129875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a24472-952f-4b64-b274-db5d7ef9f5db None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:47.134282 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a24472-952f-4b64-b274-db5d7ef9f5db None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:47.134861 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a24472-952f-4b64-b274-db5d7ef9f5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:47.196291 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d1a24472-952f-4b64-b274-db5d7ef9f5db None None] MFA Rules not processed for user `589fc45f2ad54cfc8fed48d26b0bf5fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:47.199617 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d1a24472-952f-4b64-b274-db5d7ef9f5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:47.240160 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df7af2-6d85-48ce-b177-83843903b54b admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:47.269007 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb87f7-fe99-489d-b6c9-b828d7fd8952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:47.270700 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb87f7-fe99-489d-b6c9-b828d7fd8952 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:47.271119 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb87f7-fe99-489d-b6c9-b828d7fd8952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:47.271401 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb87f7-fe99-489d-b6c9-b828d7fd8952 admin admin] PATH_INFO: `/v3/projects/65d528bda3304baab28be5ca693c3149/users/292eb0070700428db73135d8dbaccfb2/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:47.282438 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 919/1834] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:47 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:47.283594 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a24472-952f-4b64-b274-db5d7ef9f5db None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:47.285161 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d1a24472-952f-4b64-b274-db5d7ef9f5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:47.286041 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb87f7-fe99-489d-b6c9-b828d7fd8952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d528bda3304baab28be5ca693c3149, user_id=292eb0070700428db73135d8dbaccfb2, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:47.293800 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb87f7-fe99-489d-b6c9-b828d7fd8952 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:47.309615 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a24472-952f-4b64-b274-db5d7ef9f5db None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:47.324180 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 916/1835] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:46 2022] PUT /identity/v3/projects/65d528bda3304baab28be5ca693c3149/users/292eb0070700428db73135d8dbaccfb2/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:47.325077 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb87f7-fe99-489d-b6c9-b828d7fd8952 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:47.331696 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-7bdb87f7-fe99-489d-b6c9-b828d7fd8952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:47.376591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:47.418054 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33746fb-2b83-4a6f-a82e-341eb095a7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:47.418695 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33746fb-2b83-4a6f-a82e-341eb095a7cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:47.418973 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33746fb-2b83-4a6f-a82e-341eb095a7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:47.419244 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33746fb-2b83-4a6f-a82e-341eb095a7cf admin admin] PATH_INFO: `/v3/users/f1136aba12994c0fb4dc9594217d7314` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:47.420422 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33746fb-2b83-4a6f-a82e-341eb095a7cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1136aba12994c0fb4dc9594217d7314)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:47.422389 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33746fb-2b83-4a6f-a82e-341eb095a7cf admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:47.450651 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb87f7-fe99-489d-b6c9-b828d7fd8952 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:47.457693 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c80eed-d240-45be-83af-1809e2b43fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:47.458328 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c80eed-d240-45be-83af-1809e2b43fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:47.458612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c80eed-d240-45be-83af-1809e2b43fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:47.458877 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c80eed-d240-45be-83af-1809e2b43fd0 admin admin] PATH_INFO: `/v3/projects/8d64c6b7f4ce4277b5e021a40d167482` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:47.460187 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c80eed-d240-45be-83af-1809e2b43fd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d64c6b7f4ce4277b5e021a40d167482)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:47.462421 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c80eed-d240-45be-83af-1809e2b43fd0 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:47.482983 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e33746fb-2b83-4a6f-a82e-341eb095a7cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1136aba12994c0fb4dc9594217d7314'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:47.494069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e33746fb-2b83-4a6f-a82e-341eb095a7cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1136aba12994c0fb4dc9594217d7314'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:47.496529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e33746fb-2b83-4a6f-a82e-341eb095a7cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1136aba12994c0fb4dc9594217d7314'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:47.511836 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e33746fb-2b83-4a6f-a82e-341eb095a7cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1136aba12994c0fb4dc9594217d7314'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:47.520981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e5c80eed-d240-45be-83af-1809e2b43fd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d64c6b7f4ce4277b5e021a40d167482', 'request_id': 'req-e5c80eed-d240-45be-83af-1809e2b43fd0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:47.528773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e5c80eed-d240-45be-83af-1809e2b43fd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d64c6b7f4ce4277b5e021a40d167482', 'request_id': 'req-e5c80eed-d240-45be-83af-1809e2b43fd0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:47.529052 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e33746fb-2b83-4a6f-a82e-341eb095a7cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1136aba12994c0fb4dc9594217d7314'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:47.538767 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e5c80eed-d240-45be-83af-1809e2b43fd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d64c6b7f4ce4277b5e021a40d167482', 'request_id': 'req-e5c80eed-d240-45be-83af-1809e2b43fd0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:47.542322 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 920/1836] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:30:47 2022] DELETE /identity/v3/users/f1136aba12994c0fb4dc9594217d7314 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:47.543880 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33746fb-2b83-4a6f-a82e-341eb095a7cf admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:47.546939 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e33746fb-2b83-4a6f-a82e-341eb095a7cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:47.575663 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e5c80eed-d240-45be-83af-1809e2b43fd0 admin admin] The token cache is being invalidate because project 8d64c6b7f4ce4277b5e021a40d167482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:30:47.575964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e5c80eed-d240-45be-83af-1809e2b43fd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:47.578332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e5c80eed-d240-45be-83af-1809e2b43fd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:47.581814 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 917/1837] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:30:47 2022] DELETE /identity/v3/projects/8d64c6b7f4ce4277b5e021a40d167482 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:47.582694 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c80eed-d240-45be-83af-1809e2b43fd0 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:47.585830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e5c80eed-d240-45be-83af-1809e2b43fd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:47.597767 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:47.664473 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33746fb-2b83-4a6f-a82e-341eb095a7cf admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:47.670046 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd4b6b-3eed-43d1-b6c7-00b8c7268714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:47.670892 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd4b6b-3eed-43d1-b6c7-00b8c7268714 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:47.671207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd4b6b-3eed-43d1-b6c7-00b8c7268714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:47.671447 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd4b6b-3eed-43d1-b6c7-00b8c7268714 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:47.672155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd4b6b-3eed-43d1-b6c7-00b8c7268714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:47.675147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd4b6b-3eed-43d1-b6c7-00b8c7268714 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:47.698724 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 921/1838] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:47.700496 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7642b4-9537-4fe6-b26b-69d4589c5f40 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:47.700921 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7642b4-9537-4fe6-b26b-69d4589c5f40 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:47.701194 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7642b4-9537-4fe6-b26b-69d4589c5f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:47.701629 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c80eed-d240-45be-83af-1809e2b43fd0 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:47.716091 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3f8b6-1454-4373-be6a-42366e267851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:47.716836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3f8b6-1454-4373-be6a-42366e267851 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:47.717206 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3f8b6-1454-4373-be6a-42366e267851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:47.717553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3f8b6-1454-4373-be6a-42366e267851 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:47.718266 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3f8b6-1454-4373-be6a-42366e267851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:47.723876 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3f8b6-1454-4373-be6a-42366e267851 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:47.760955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-0e7642b4-9537-4fe6-b26b-69d4589c5f40 None None] MFA Rules not processed for user `292eb0070700428db73135d8dbaccfb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:47.762392 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0e7642b4-9537-4fe6-b26b-69d4589c5f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:47.783487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 918/1839] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:47 2022] POST /identity/v3/projects => generated 405 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:47.787133 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd74971-ced2-4a84-92a7-ef80a80df294 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:47.787428 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd74971-ced2-4a84-92a7-ef80a80df294 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:47.788634 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd74971-ced2-4a84-92a7-ef80a80df294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:47.837663 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-5cd74971-ced2-4a84-92a7-ef80a80df294 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:47.838895 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5cd74971-ced2-4a84-92a7-ef80a80df294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:47.860035 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:47.913120 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 922/1840] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:47.914103 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7642b4-9537-4fe6-b26b-69d4589c5f40 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:47.917706 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0e7642b4-9537-4fe6-b26b-69d4589c5f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:47.941428 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7642b4-9537-4fe6-b26b-69d4589c5f40 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:47.995143 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 919/1841] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:47.996120 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd74971-ced2-4a84-92a7-ef80a80df294 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:48.006906 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd74971-ced2-4a84-92a7-ef80a80df294 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:48.012186 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49de715-093e-4dca-81b0-3e701a8d15e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:48.015648 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49de715-093e-4dca-81b0-3e701a8d15e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:48.015648 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49de715-093e-4dca-81b0-3e701a8d15e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:48.015648 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49de715-093e-4dca-81b0-3e701a8d15e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:48.016121 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49de715-093e-4dca-81b0-3e701a8d15e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:48.018377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49de715-093e-4dca-81b0-3e701a8d15e9 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:48.052012 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afff165-c73b-49f3-99a8-cb2d723f65de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:48.057002 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afff165-c73b-49f3-99a8-cb2d723f65de admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:48.057662 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 920/1842] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:47 2022] POST /identity/v3/users => generated 309 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:48.058747 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afff165-c73b-49f3-99a8-cb2d723f65de admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:48.059597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49de715-093e-4dca-81b0-3e701a8d15e9 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:48.059734 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afff165-c73b-49f3-99a8-cb2d723f65de admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:48.060967 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afff165-c73b-49f3-99a8-cb2d723f65de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:48.063422 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afff165-c73b-49f3-99a8-cb2d723f65de admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:48.064302 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a49de715-093e-4dca-81b0-3e701a8d15e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:48.088481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 923/1843] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:48.093669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d4f54-06a9-429a-ab00-9f4bce81c143 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:48.094464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d4f54-06a9-429a-ab00-9f4bce81c143 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:48.095380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d4f54-06a9-429a-ab00-9f4bce81c143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:48.125882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-237d4f54-06a9-429a-ab00-9f4bce81c143 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:48.127103 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-237d4f54-06a9-429a-ab00-9f4bce81c143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:48.138167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 924/1844] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:48.139144 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d4f54-06a9-429a-ab00-9f4bce81c143 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:48.168383 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49de715-093e-4dca-81b0-3e701a8d15e9 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:48.170852 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d4f54-06a9-429a-ab00-9f4bce81c143 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:48.172673 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770d702-510b-49b7-b791-b7b99af6937a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:48.173853 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770d702-510b-49b7-b791-b7b99af6937a service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:48.174139 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770d702-510b-49b7-b791-b7b99af6937a service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:48.174442 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770d702-510b-49b7-b791-b7b99af6937a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:48.179407 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da3aaf-31e6-40f8-ad03-5efd9cd386e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:48.193386 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da3aaf-31e6-40f8-ad03-5efd9cd386e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:48.195730 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da3aaf-31e6-40f8-ad03-5efd9cd386e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:48.196770 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da3aaf-31e6-40f8-ad03-5efd9cd386e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:48.197551 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da3aaf-31e6-40f8-ad03-5efd9cd386e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:48.200441 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da3aaf-31e6-40f8-ad03-5efd9cd386e6 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:48.225367 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 925/1845] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:48.226168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da3aaf-31e6-40f8-ad03-5efd9cd386e6 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:48.235385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:48.251152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da3aaf-31e6-40f8-ad03-5efd9cd386e6 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:48.264360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec6b8c-4ed8-4283-a145-818ff5f86331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:48.270011 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec6b8c-4ed8-4283-a145-818ff5f86331 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:48.270578 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec6b8c-4ed8-4283-a145-818ff5f86331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:48.271851 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec6b8c-4ed8-4283-a145-818ff5f86331 admin admin] PATH_INFO: `/v3/projects/91e956b9383641e295ac144b5ed96ad5/users/deee93edb1af4155ad5f8e9163c5a745/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:48.296400 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec6b8c-4ed8-4283-a145-818ff5f86331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e956b9383641e295ac144b5ed96ad5, user_id=deee93edb1af4155ad5f8e9163c5a745, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:48.299369 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec6b8c-4ed8-4283-a145-818ff5f86331 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:48.302951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770d702-510b-49b7-b791-b7b99af6937a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:48.306352 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770d702-510b-49b7-b791-b7b99af6937a service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:48.325634 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 921/1846] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:48 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:48.328017 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770d702-510b-49b7-b791-b7b99af6937a service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:48.353502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770d702-510b-49b7-b791-b7b99af6937a service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:48.367744 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 926/1847] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:48 2022] PUT /identity/v3/projects/91e956b9383641e295ac144b5ed96ad5/users/deee93edb1af4155ad5f8e9163c5a745/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:48.369144 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec6b8c-4ed8-4283-a145-818ff5f86331 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:48.441030 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5339a-7c38-47e8-bea8-5ea24d634cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:48.441658 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5339a-7c38-47e8-bea8-5ea24d634cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:48.441935 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5339a-7c38-47e8-bea8-5ea24d634cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:48.442234 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5339a-7c38-47e8-bea8-5ea24d634cb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:48.442920 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5339a-7c38-47e8-bea8-5ea24d634cb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:30:48.443221 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5339a-7c38-47e8-bea8-5ea24d634cb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:48.445076 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5339a-7c38-47e8-bea8-5ea24d634cb8 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:48.449109 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec6b8c-4ed8-4283-a145-818ff5f86331 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:48.454539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523bed7-2551-4337-a37e-258a962a5409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:48.455225 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523bed7-2551-4337-a37e-258a962a5409 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:48.455490 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523bed7-2551-4337-a37e-258a962a5409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:48.455760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523bed7-2551-4337-a37e-258a962a5409 admin admin] PATH_INFO: `/v3/projects/fc087b80b53a4a449397a731a78f6709/users/8b1b382b926a40c092ff761f25aa678d/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:48.457757 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 922/1848] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:30:48.458765 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5339a-7c38-47e8-bea8-5ea24d634cb8 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:48.460657 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5ee5339a-7c38-47e8-bea8-5ea24d634cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:48.473609 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5339a-7c38-47e8-bea8-5ea24d634cb8 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:48.475671 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523bed7-2551-4337-a37e-258a962a5409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc087b80b53a4a449397a731a78f6709, user_id=8b1b382b926a40c092ff761f25aa678d, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:48.478909 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a581c-f377-4d3f-a563-9a65cba44f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:48.479089 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523bed7-2551-4337-a37e-258a962a5409 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:48.479526 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a581c-f377-4d3f-a563-9a65cba44f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:48.479801 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a581c-f377-4d3f-a563-9a65cba44f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:48.480291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a581c-f377-4d3f-a563-9a65cba44f0d admin admin] PATH_INFO: `/v3/projects/8f3e384e4c8a4ec091dbb3d5119f765a` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:48.481458 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a581c-f377-4d3f-a563-9a65cba44f0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f3e384e4c8a4ec091dbb3d5119f765a)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:48.483342 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a581c-f377-4d3f-a563-9a65cba44f0d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:48.493890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 927/1849] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:48 2022] PUT /identity/v3/projects/fc087b80b53a4a449397a731a78f6709/users/8b1b382b926a40c092ff761f25aa678d/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:48.496739 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af12cd-1ada-46a4-903b-099be32e4c7e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:48.496739 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af12cd-1ada-46a4-903b-099be32e4c7e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:48.496739 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af12cd-1ada-46a4-903b-099be32e4c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:48.515295 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:48.526654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-20af12cd-1ada-46a4-903b-099be32e4c7e None None] MFA Rules not processed for user `deee93edb1af4155ad5f8e9163c5a745`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:48.527910 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-20af12cd-1ada-46a4-903b-099be32e4c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:48.534752 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-413a581c-f377-4d3f-a563-9a65cba44f0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f3e384e4c8a4ec091dbb3d5119f765a', 'request_id': 'req-413a581c-f377-4d3f-a563-9a65cba44f0d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:48.541538 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-413a581c-f377-4d3f-a563-9a65cba44f0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f3e384e4c8a4ec091dbb3d5119f765a', 'request_id': 'req-413a581c-f377-4d3f-a563-9a65cba44f0d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:48.548496 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-413a581c-f377-4d3f-a563-9a65cba44f0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f3e384e4c8a4ec091dbb3d5119f765a', 'request_id': 'req-413a581c-f377-4d3f-a563-9a65cba44f0d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:48.562655 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-413a581c-f377-4d3f-a563-9a65cba44f0d admin admin] The token cache is being invalidate because project 8f3e384e4c8a4ec091dbb3d5119f765a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:30:48.562938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-413a581c-f377-4d3f-a563-9a65cba44f0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:48.563574 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-413a581c-f377-4d3f-a563-9a65cba44f0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:48.565531 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 923/1850] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:30:48 2022] DELETE /identity/v3/projects/8f3e384e4c8a4ec091dbb3d5119f765a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:48.566554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a581c-f377-4d3f-a563-9a65cba44f0d admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:48.567963 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-413a581c-f377-4d3f-a563-9a65cba44f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:48.598459 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 928/1851] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:48.599499 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af12cd-1ada-46a4-903b-099be32e4c7e None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:48.600811 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-20af12cd-1ada-46a4-903b-099be32e4c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:48.615055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:48.633408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a581c-f377-4d3f-a563-9a65cba44f0d admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:48.637874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef231125-45b7-4211-a8ed-9c0c4c774076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:48.638493 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef231125-45b7-4211-a8ed-9c0c4c774076 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:48.638874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef231125-45b7-4211-a8ed-9c0c4c774076 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:48.639152 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef231125-45b7-4211-a8ed-9c0c4c774076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:48.641058 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ef231125-45b7-4211-a8ed-9c0c4c774076 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:48.675983 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af12cd-1ada-46a4-903b-099be32e4c7e None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:48.681144 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b2055-6090-4999-839c-d1e75772766e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:48.681762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b2055-6090-4999-839c-d1e75772766e admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:48.682046 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b2055-6090-4999-839c-d1e75772766e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:48.682320 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b2055-6090-4999-839c-d1e75772766e admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:48.683038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b2055-6090-4999-839c-d1e75772766e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:48.685702 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b2055-6090-4999-839c-d1e75772766e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:48.707595 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef231125-45b7-4211-a8ed-9c0c4c774076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:48.709250 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef231125-45b7-4211-a8ed-9c0c4c774076 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:48.715308 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 929/1852] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:48 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:48.719366 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b2055-6090-4999-839c-d1e75772766e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:48.719985 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 924/1853] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:48.721222 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-248b2055-6090-4999-839c-d1e75772766e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:48.721507 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a247d-f5bc-4dfb-aada-8063a5c0b602 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:48.721795 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a247d-f5bc-4dfb-aada-8063a5c0b602 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:48.722223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a247d-f5bc-4dfb-aada-8063a5c0b602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:48.752430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-0e9a247d-f5bc-4dfb-aada-8063a5c0b602 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:48.753725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0e9a247d-f5bc-4dfb-aada-8063a5c0b602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:48.819890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b2055-6090-4999-839c-d1e75772766e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:48.827672 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551e276-70ea-47ac-895d-66365ab68b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:48.828291 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551e276-70ea-47ac-895d-66365ab68b78 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:48.828572 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551e276-70ea-47ac-895d-66365ab68b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:48.828844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551e276-70ea-47ac-895d-66365ab68b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:48.829534 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551e276-70ea-47ac-895d-66365ab68b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:48.831152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551e276-70ea-47ac-895d-66365ab68b78 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:48.842665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 925/1854] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:48.845894 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a247d-f5bc-4dfb-aada-8063a5c0b602 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:48.846109 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 930/1855] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:48.846941 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551e276-70ea-47ac-895d-66365ab68b78 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:48.847864 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0e9a247d-f5bc-4dfb-aada-8063a5c0b602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:48.858373 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551e276-70ea-47ac-895d-66365ab68b78 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:48.864424 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d6cdd-a94a-4e19-b422-b677fae81292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:48.865167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d6cdd-a94a-4e19-b422-b677fae81292 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:48.865552 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d6cdd-a94a-4e19-b422-b677fae81292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:48.865964 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d6cdd-a94a-4e19-b422-b677fae81292 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:48.866614 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d6cdd-a94a-4e19-b422-b677fae81292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:48.868814 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d6cdd-a94a-4e19-b422-b677fae81292 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:48.874743 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a247d-f5bc-4dfb-aada-8063a5c0b602 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:48.881583 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bcf4c-fd89-4243-a1a2-3263cb23df4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:48.882280 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bcf4c-fd89-4243-a1a2-3263cb23df4e admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:48.882627 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bcf4c-fd89-4243-a1a2-3263cb23df4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:48.883490 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bcf4c-fd89-4243-a1a2-3263cb23df4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:48.884190 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bcf4c-fd89-4243-a1a2-3263cb23df4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:48.886302 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bcf4c-fd89-4243-a1a2-3263cb23df4e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:48.905817 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 931/1856] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:48 2022] POST /identity/v3/users => generated 292 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:48.906898 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d6cdd-a94a-4e19-b422-b677fae81292 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:48.914305 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:48.924099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d6cdd-a94a-4e19-b422-b677fae81292 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:48.928058 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 926/1857] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:48 2022] POST /identity/v3/projects => generated 379 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:48.931180 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6588d3-8b2f-4e93-836f-c5d6ada12ceb None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:48.932611 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6588d3-8b2f-4e93-836f-c5d6ada12ceb None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:48.933503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6588d3-8b2f-4e93-836f-c5d6ada12ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:48.937737 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c46bcf-f2b2-4ca9-8739-63d2e9c98f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:48.938428 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c46bcf-f2b2-4ca9-8739-63d2e9c98f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:48.938802 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c46bcf-f2b2-4ca9-8739-63d2e9c98f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:48.939543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c46bcf-f2b2-4ca9-8739-63d2e9c98f65 admin admin] PATH_INFO: `/v3/projects/fc087b80b53a4a449397a731a78f6709/users/8b1b382b926a40c092ff761f25aa678d/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:48.941676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c46bcf-f2b2-4ca9-8739-63d2e9c98f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc087b80b53a4a449397a731a78f6709, user_id=8b1b382b926a40c092ff761f25aa678d, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:48.944327 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c46bcf-f2b2-4ca9-8739-63d2e9c98f65 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:48.963217 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 932/1858] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:48 2022] PUT /identity/v3/projects/fc087b80b53a4a449397a731a78f6709/users/8b1b382b926a40c092ff761f25aa678d/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:48.964161 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c46bcf-f2b2-4ca9-8739-63d2e9c98f65 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:48.967743 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-3b6588d3-8b2f-4e93-836f-c5d6ada12ceb None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:48.969431 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3b6588d3-8b2f-4e93-836f-c5d6ada12ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:49.057004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 927/1859] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:49.059054 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6588d3-8b2f-4e93-836f-c5d6ada12ceb None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:49.072393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c46bcf-f2b2-4ca9-8739-63d2e9c98f65 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:49.074157 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6588d3-8b2f-4e93-836f-c5d6ada12ceb None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:49.083641 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101ca7d-9ad1-4ed4-8abb-45508880899b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:49.084631 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101ca7d-9ad1-4ed4-8abb-45508880899b admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:49.085238 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101ca7d-9ad1-4ed4-8abb-45508880899b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:49.085981 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e0710-5980-485d-a84d-846e6562e22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:49.086622 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101ca7d-9ad1-4ed4-8abb-45508880899b admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:49.087547 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101ca7d-9ad1-4ed4-8abb-45508880899b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:49.089358 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e0710-5980-485d-a84d-846e6562e22c admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:49.089903 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e0710-5980-485d-a84d-846e6562e22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:49.089993 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e0710-5980-485d-a84d-846e6562e22c admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:49.090596 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e0710-5980-485d-a84d-846e6562e22c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:49.091087 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101ca7d-9ad1-4ed4-8abb-45508880899b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:49.094535 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e0710-5980-485d-a84d-846e6562e22c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:49.105724 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:49.120686 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 933/1860] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:49.121907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e0710-5980-485d-a84d-846e6562e22c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:49.146963 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 928/1861] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:49 2022] POST /identity/v3/users => generated 296 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:49.148128 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101ca7d-9ad1-4ed4-8abb-45508880899b admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:49.156293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e0710-5980-485d-a84d-846e6562e22c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:49.170315 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101ca7d-9ad1-4ed4-8abb-45508880899b admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:49.172195 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e0115-3e1d-486b-a54b-a147ee5a57e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:49.172910 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e0115-3e1d-486b-a54b-a147ee5a57e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:49.176146 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e0115-3e1d-486b-a54b-a147ee5a57e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:49.176572 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e0115-3e1d-486b-a54b-a147ee5a57e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:49.177402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e0115-3e1d-486b-a54b-a147ee5a57e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:30:49.177844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e0115-3e1d-486b-a54b-a147ee5a57e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:49.179615 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e0115-3e1d-486b-a54b-a147ee5a57e5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:49.198963 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b44e7a-eb8a-4fb0-96f2-cd1ba8c0fb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:49.201771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b44e7a-eb8a-4fb0-96f2-cd1ba8c0fb12 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:49.203743 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b44e7a-eb8a-4fb0-96f2-cd1ba8c0fb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:49.204241 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b44e7a-eb8a-4fb0-96f2-cd1ba8c0fb12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:49.204917 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b44e7a-eb8a-4fb0-96f2-cd1ba8c0fb12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:49.206566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b44e7a-eb8a-4fb0-96f2-cd1ba8c0fb12 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:49.220059 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 929/1862] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:49.221230 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b44e7a-eb8a-4fb0-96f2-cd1ba8c0fb12 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:49.221337 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 934/1863] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:30:49.226987 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e0115-3e1d-486b-a54b-a147ee5a57e5 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:49.246290 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b44e7a-eb8a-4fb0-96f2-cd1ba8c0fb12 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:49.253167 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b37801-2b04-4d02-af93-88c8ce8d4628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:49.253914 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b37801-2b04-4d02-af93-88c8ce8d4628 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:49.254270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b37801-2b04-4d02-af93-88c8ce8d4628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:49.254785 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b37801-2b04-4d02-af93-88c8ce8d4628 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:49.255916 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b37801-2b04-4d02-af93-88c8ce8d4628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:49.258924 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b37801-2b04-4d02-af93-88c8ce8d4628 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:49.267030 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e0115-3e1d-486b-a54b-a147ee5a57e5 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:49.284958 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 930/1864] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:49.287300 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b37801-2b04-4d02-af93-88c8ce8d4628 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:49.293553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f70ed5-859d-4a3a-91bf-13d56f5161ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:49.295948 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f70ed5-859d-4a3a-91bf-13d56f5161ed admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:49.296240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f70ed5-859d-4a3a-91bf-13d56f5161ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:49.296519 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f70ed5-859d-4a3a-91bf-13d56f5161ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:49.297198 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f70ed5-859d-4a3a-91bf-13d56f5161ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:49.303461 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f70ed5-859d-4a3a-91bf-13d56f5161ed admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:49.317737 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b37801-2b04-4d02-af93-88c8ce8d4628 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:49.330136 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf7b72-3755-4c02-b93b-6cf6cc4ce654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:49.330842 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf7b72-3755-4c02-b93b-6cf6cc4ce654 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:49.331131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf7b72-3755-4c02-b93b-6cf6cc4ce654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:49.331401 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf7b72-3755-4c02-b93b-6cf6cc4ce654 admin admin] PATH_INFO: `/v3/projects/a2022154a846444cbd3ef356be7a8ece/users/73335f27406547629ec3135c96aa52fc/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:49.354161 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 935/1865] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:49 2022] POST /identity/v3/projects => generated 393 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:49.355655 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f70ed5-859d-4a3a-91bf-13d56f5161ed admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:49.362887 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf7b72-3755-4c02-b93b-6cf6cc4ce654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2022154a846444cbd3ef356be7a8ece, user_id=73335f27406547629ec3135c96aa52fc, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:49.366904 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf7b72-3755-4c02-b93b-6cf6cc4ce654 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:49.401013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 931/1866] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:49 2022] PUT /identity/v3/projects/a2022154a846444cbd3ef356be7a8ece/users/73335f27406547629ec3135c96aa52fc/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:49.401013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf7b72-3755-4c02-b93b-6cf6cc4ce654 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:49.485218 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f70ed5-859d-4a3a-91bf-13d56f5161ed admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:49.530292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf7b72-3755-4c02-b93b-6cf6cc4ce654 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:49.534984 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727b414-b10a-4dca-90f9-d7f5ca57a60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:49.535593 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727b414-b10a-4dca-90f9-d7f5ca57a60d admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:49.535875 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727b414-b10a-4dca-90f9-d7f5ca57a60d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:49.536149 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727b414-b10a-4dca-90f9-d7f5ca57a60d admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:49.536778 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1727b414-b10a-4dca-90f9-d7f5ca57a60d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:49.538725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1727b414-b10a-4dca-90f9-d7f5ca57a60d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:49.566057 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 932/1867] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:49 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:49.567620 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ca259-9d30-48b0-abf1-89ce1e0f91b7 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:49.567984 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ca259-9d30-48b0-abf1-89ce1e0f91b7 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:49.568384 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ca259-9d30-48b0-abf1-89ce1e0f91b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:49.573504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:49.579840 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32dd59f-cca3-4861-a8f4-950fa75b2d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:49.580665 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dd59f-cca3-4861-a8f4-950fa75b2d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:49.581066 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dd59f-cca3-4861-a8f4-950fa75b2d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:49.581283 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32dd59f-cca3-4861-a8f4-950fa75b2d1b admin admin] PATH_INFO: `/v3/projects/43bf851f83da414e987c0cda83e1857c/users/48dc1de7d99e45148793bc1c865929a3/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:49.599150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32dd59f-cca3-4861-a8f4-950fa75b2d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=43bf851f83da414e987c0cda83e1857c, user_id=48dc1de7d99e45148793bc1c865929a3, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:49.602384 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32dd59f-cca3-4861-a8f4-950fa75b2d1b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:49.604372 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-1f6ca259-9d30-48b0-abf1-89ce1e0f91b7 None None] MFA Rules not processed for user `73335f27406547629ec3135c96aa52fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:49.606415 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1f6ca259-9d30-48b0-abf1-89ce1e0f91b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:49.619169 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 936/1868] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:49 2022] PUT /identity/v3/projects/43bf851f83da414e987c0cda83e1857c/users/48dc1de7d99e45148793bc1c865929a3/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:49.620876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32dd59f-cca3-4861-a8f4-950fa75b2d1b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:49.684947 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 933/1869] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:49.685865 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ca259-9d30-48b0-abf1-89ce1e0f91b7 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:49.692871 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32dd59f-cca3-4861-a8f4-950fa75b2d1b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:49.698257 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31997d8e-5a0c-466b-b175-e64807aff48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:49.698892 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31997d8e-5a0c-466b-b175-e64807aff48b admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:49.698994 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ca259-9d30-48b0-abf1-89ce1e0f91b7 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:49.699164 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31997d8e-5a0c-466b-b175-e64807aff48b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:49.699442 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31997d8e-5a0c-466b-b175-e64807aff48b admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:49.700099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31997d8e-5a0c-466b-b175-e64807aff48b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:49.701775 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31997d8e-5a0c-466b-b175-e64807aff48b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:49.704118 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99eaea-33d2-4129-9257-5f17f60c3653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:49.704756 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99eaea-33d2-4129-9257-5f17f60c3653 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:49.705059 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99eaea-33d2-4129-9257-5f17f60c3653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:49.705340 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99eaea-33d2-4129-9257-5f17f60c3653 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:49.705998 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99eaea-33d2-4129-9257-5f17f60c3653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:49.707615 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99eaea-33d2-4129-9257-5f17f60c3653 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:49.714154 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 937/1870] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:49.715020 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31997d8e-5a0c-466b-b175-e64807aff48b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:49.725616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 934/1871] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:49.725616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99eaea-33d2-4129-9257-5f17f60c3653 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:49.729398 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31997d8e-5a0c-466b-b175-e64807aff48b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:49.734281 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830c5a2-50ce-4bea-8a15-356811b4b85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:49.734791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99eaea-33d2-4129-9257-5f17f60c3653 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:49.735500 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830c5a2-50ce-4bea-8a15-356811b4b85a admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:49.735923 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830c5a2-50ce-4bea-8a15-356811b4b85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:49.736211 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830c5a2-50ce-4bea-8a15-356811b4b85a admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:49.736830 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830c5a2-50ce-4bea-8a15-356811b4b85a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:49.738931 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830c5a2-50ce-4bea-8a15-356811b4b85a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:49.739501 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169fb34-cbd4-44d4-b60a-67b7b23cd502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:49.740120 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169fb34-cbd4-44d4-b60a-67b7b23cd502 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:49.740470 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169fb34-cbd4-44d4-b60a-67b7b23cd502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:49.740747 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169fb34-cbd4-44d4-b60a-67b7b23cd502 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:49.741478 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3169fb34-cbd4-44d4-b60a-67b7b23cd502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:49.743692 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3169fb34-cbd4-44d4-b60a-67b7b23cd502 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:49.756636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 935/1872] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:49.757415 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169fb34-cbd4-44d4-b60a-67b7b23cd502 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:49.764749 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:49.768991 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169fb34-cbd4-44d4-b60a-67b7b23cd502 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:49.774505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 938/1873] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:49 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:49.775434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830c5a2-50ce-4bea-8a15-356811b4b85a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:49.775976 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee440c-a603-470b-baaa-4f98f7a9db60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:49.776936 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee440c-a603-470b-baaa-4f98f7a9db60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:49.777428 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee440c-a603-470b-baaa-4f98f7a9db60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:49.777683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee440c-a603-470b-baaa-4f98f7a9db60 admin admin] PATH_INFO: `/v3/projects/43bf851f83da414e987c0cda83e1857c/users/48dc1de7d99e45148793bc1c865929a3/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:49.779632 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee440c-a603-470b-baaa-4f98f7a9db60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43bf851f83da414e987c0cda83e1857c, user_id=48dc1de7d99e45148793bc1c865929a3, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:49.782441 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee440c-a603-470b-baaa-4f98f7a9db60 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:49.795504 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 936/1874] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:49 2022] PUT /identity/v3/projects/43bf851f83da414e987c0cda83e1857c/users/48dc1de7d99e45148793bc1c865929a3/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:49.796277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee440c-a603-470b-baaa-4f98f7a9db60 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:49.857359 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830c5a2-50ce-4bea-8a15-356811b4b85a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:49.862408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5841b-a652-497d-8dd8-16f958717edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:49.863079 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5841b-a652-497d-8dd8-16f958717edb admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:49.863382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5841b-a652-497d-8dd8-16f958717edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:49.863660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5841b-a652-497d-8dd8-16f958717edb admin admin] PATH_INFO: `/v3/projects/43dc2f65411144c2892e44069f4fe2b3/users/aa98fd24cc6a4f6eaf4077160e8112fe/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:49.868025 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee440c-a603-470b-baaa-4f98f7a9db60 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:49.874448 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b507ad9-8923-4578-b0d8-9b61a24f4db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:49.875289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b507ad9-8923-4578-b0d8-9b61a24f4db0 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:49.875868 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b507ad9-8923-4578-b0d8-9b61a24f4db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:49.876026 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b507ad9-8923-4578-b0d8-9b61a24f4db0 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:49.876746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b507ad9-8923-4578-b0d8-9b61a24f4db0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:49.880423 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b507ad9-8923-4578-b0d8-9b61a24f4db0 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:49.883937 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5841b-a652-497d-8dd8-16f958717edb admin admin] RBAC: Authorizing `identity:create_grant(project_id=43dc2f65411144c2892e44069f4fe2b3, user_id=aa98fd24cc6a4f6eaf4077160e8112fe, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:49.887323 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5841b-a652-497d-8dd8-16f958717edb admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:49.928328 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 939/1875] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:49 2022] PUT /identity/v3/projects/43dc2f65411144c2892e44069f4fe2b3/users/aa98fd24cc6a4f6eaf4077160e8112fe/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:49.934052 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 937/1876] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:49 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:49.934719 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8aad3-2333-429e-a0e2-81149e2428b7 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:49.934719 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8aad3-2333-429e-a0e2-81149e2428b7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:49.934719 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8aad3-2333-429e-a0e2-81149e2428b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:49.935232 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9f19a-d983-41f9-9b1d-f6f401471e55 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:49.935527 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9f19a-d983-41f9-9b1d-f6f401471e55 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:49.935802 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9f19a-d983-41f9-9b1d-f6f401471e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:50.001988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-6ac8aad3-2333-429e-a0e2-81149e2428b7 None None] MFA Rules not processed for user `48dc1de7d99e45148793bc1c865929a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:50.005815 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6ac8aad3-2333-429e-a0e2-81149e2428b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:50.007067 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-58f9f19a-d983-41f9-9b1d-f6f401471e55 None None] MFA Rules not processed for user `aa98fd24cc6a4f6eaf4077160e8112fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:50.008389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-58f9f19a-d983-41f9-9b1d-f6f401471e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:50.048852 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:50.116885 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 940/1877] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:50.118507 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8aad3-2333-429e-a0e2-81149e2428b7 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:50.154024 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 938/1878] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:50.155530 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9f19a-d983-41f9-9b1d-f6f401471e55 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:50.233768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8aad3-2333-429e-a0e2-81149e2428b7 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:50.243213 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad1711-9217-4202-b914-5228f1670016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:50.244337 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad1711-9217-4202-b914-5228f1670016 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:50.244714 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad1711-9217-4202-b914-5228f1670016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:50.245236 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad1711-9217-4202-b914-5228f1670016 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:50.247378 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad1711-9217-4202-b914-5228f1670016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:50.250188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad1711-9217-4202-b914-5228f1670016 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:50.269784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 941/1879] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:50.271628 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad1711-9217-4202-b914-5228f1670016 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:50.286809 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad1711-9217-4202-b914-5228f1670016 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:50.292094 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9f19a-d983-41f9-9b1d-f6f401471e55 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:50.293920 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812b2a7-f009-4378-9d09-0a177f35d5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:50.301908 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812b2a7-f009-4378-9d09-0a177f35d5ab admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:50.302134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812b2a7-f009-4378-9d09-0a177f35d5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:50.302379 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812b2a7-f009-4378-9d09-0a177f35d5ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:50.303057 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812b2a7-f009-4378-9d09-0a177f35d5ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:50.309776 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641ca2e-9a8a-4426-9a5e-16772c17e715 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:50.310729 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641ca2e-9a8a-4426-9a5e-16772c17e715 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:50.311018 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641ca2e-9a8a-4426-9a5e-16772c17e715 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:50.311364 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641ca2e-9a8a-4426-9a5e-16772c17e715 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:50.322317 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812b2a7-f009-4378-9d09-0a177f35d5ab admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:50.368432 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641ca2e-9a8a-4426-9a5e-16772c17e715 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:50.370389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641ca2e-9a8a-4426-9a5e-16772c17e715 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:50.413098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 939/1880] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:50 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:50.414284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641ca2e-9a8a-4426-9a5e-16772c17e715 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:50.420053 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 942/1881] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:50 2022] POST /identity/v3/projects => generated 393 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:50.423189 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812b2a7-f009-4378-9d09-0a177f35d5ab admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:50.450692 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641ca2e-9a8a-4426-9a5e-16772c17e715 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:50.475638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:50.607543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812b2a7-f009-4378-9d09-0a177f35d5ab admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:50.616275 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4b6ba-6964-4e27-85e6-b2dbf306a6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:50.617829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4b6ba-6964-4e27-85e6-b2dbf306a6de admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:50.618122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4b6ba-6964-4e27-85e6-b2dbf306a6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:50.618398 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4b6ba-6964-4e27-85e6-b2dbf306a6de admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:50.619704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4b6ba-6964-4e27-85e6-b2dbf306a6de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:50.623531 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3936994-32f0-46bb-b0a8-7b363ff43bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:50.624435 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3936994-32f0-46bb-b0a8-7b363ff43bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:50.624970 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3936994-32f0-46bb-b0a8-7b363ff43bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:50.625605 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3936994-32f0-46bb-b0a8-7b363ff43bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:50.626475 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3936994-32f0-46bb-b0a8-7b363ff43bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:50.628283 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3936994-32f0-46bb-b0a8-7b363ff43bb2 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:50.635709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4b6ba-6964-4e27-85e6-b2dbf306a6de admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:50.641089 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 940/1882] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:50.642164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3936994-32f0-46bb-b0a8-7b363ff43bb2 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:50.686903 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 943/1883] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:50 2022] POST /identity/v3/users => generated 303 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:50.690930 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa51c8a-9107-43bc-991f-bfd624ffd269 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:50.691240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa51c8a-9107-43bc-991f-bfd624ffd269 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:50.691524 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa51c8a-9107-43bc-991f-bfd624ffd269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:50.761331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3936994-32f0-46bb-b0a8-7b363ff43bb2 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:50.769303 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9fa51c8a-9107-43bc-991f-bfd624ffd269 None None] MFA Rules not processed for user `8b1b382b926a40c092ff761f25aa678d`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:50.771337 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d34e7-2f75-4135-b206-25043ca2e6a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:50.771834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d34e7-2f75-4135-b206-25043ca2e6a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:50.772121 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d34e7-2f75-4135-b206-25043ca2e6a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:50.773789 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9fa51c8a-9107-43bc-991f-bfd624ffd269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:50.774946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d34e7-2f75-4135-b206-25043ca2e6a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:50.777898 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f21d34e7-2f75-4135-b206-25043ca2e6a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:50.806301 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:50.904180 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d34e7-2f75-4135-b206-25043ca2e6a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:50.907062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 944/1884] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:50 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:50.908771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d34e7-2f75-4135-b206-25043ca2e6a1 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:50.911063 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa51c8a-9107-43bc-991f-bfd624ffd269 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:50.932436 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa51c8a-9107-43bc-991f-bfd624ffd269 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:50.937179 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 941/1885] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:50.938130 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36f6fc-125d-4e60-9505-0e2d1bb46e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:50.938814 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36f6fc-125d-4e60-9505-0e2d1bb46e5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:50.939158 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36f6fc-125d-4e60-9505-0e2d1bb46e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:50.939416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36f6fc-125d-4e60-9505-0e2d1bb46e5f admin admin] PATH_INFO: `/v3/projects/d011b9d961134d7999b8e8bb754bba19/users/ead2e7dac1fb4c299b540158cfea6067/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:50.941912 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d34e7-2f75-4135-b206-25043ca2e6a1 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:50.957479 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36f6fc-125d-4e60-9505-0e2d1bb46e5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d011b9d961134d7999b8e8bb754bba19, user_id=ead2e7dac1fb4c299b540158cfea6067, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:50.960592 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36f6fc-125d-4e60-9505-0e2d1bb46e5f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:50.979033 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 945/1886] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:50 2022] PUT /identity/v3/projects/d011b9d961134d7999b8e8bb754bba19/users/ead2e7dac1fb4c299b540158cfea6067/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:50.988104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d34e7-2f75-4135-b206-25043ca2e6a1 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:50.995215 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e195e-ed8f-4e97-8d19-6965e91cf630 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:50.995215 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e195e-ed8f-4e97-8d19-6965e91cf630 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:50.995215 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e195e-ed8f-4e97-8d19-6965e91cf630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:51.058080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f74e195e-ed8f-4e97-8d19-6965e91cf630 None None] MFA Rules not processed for user `ead2e7dac1fb4c299b540158cfea6067`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:51.059362 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f74e195e-ed8f-4e97-8d19-6965e91cf630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:51.162073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5437e-c974-45de-b599-4c43023b632f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:51.162993 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5437e-c974-45de-b599-4c43023b632f admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:51.163652 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5437e-c974-45de-b599-4c43023b632f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:51.164667 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5437e-c974-45de-b599-4c43023b632f admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:51.165791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5437e-c974-45de-b599-4c43023b632f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:51.167624 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5437e-c974-45de-b599-4c43023b632f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:51.179280 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:51.217722 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 942/1887] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:51.225980 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5437e-c974-45de-b599-4c43023b632f admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:51.254875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 946/1888] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:51.260211 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e195e-ed8f-4e97-8d19-6965e91cf630 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:51.263278 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5437e-c974-45de-b599-4c43023b632f admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:51.277478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e195e-ed8f-4e97-8d19-6965e91cf630 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:51.284320 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425df15-2a68-4e9e-8a10-06210c5a44d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:51.284840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849dddf-cfe5-410e-a146-e1155d44808f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:51.284983 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425df15-2a68-4e9e-8a10-06210c5a44d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:51.285258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425df15-2a68-4e9e-8a10-06210c5a44d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:51.285694 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425df15-2a68-4e9e-8a10-06210c5a44d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:51.286272 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849dddf-cfe5-410e-a146-e1155d44808f admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:51.286502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425df15-2a68-4e9e-8a10-06210c5a44d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:51.286606 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849dddf-cfe5-410e-a146-e1155d44808f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:51.286819 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849dddf-cfe5-410e-a146-e1155d44808f admin admin] PATH_INFO: `/v3/projects/fac470be681c42948026e02c09f5eb50/users/9f86d9c58c3f4e71babc0e01753d2e6e/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:51.289931 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425df15-2a68-4e9e-8a10-06210c5a44d2 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:51.316553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849dddf-cfe5-410e-a146-e1155d44808f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fac470be681c42948026e02c09f5eb50, user_id=9f86d9c58c3f4e71babc0e01753d2e6e, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:51.319304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849dddf-cfe5-410e-a146-e1155d44808f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:51.338194 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 947/1889] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:51 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:51.340409 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 943/1890] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:51 2022] PUT /identity/v3/projects/fac470be681c42948026e02c09f5eb50/users/9f86d9c58c3f4e71babc0e01753d2e6e/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:30:51.344782 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425df15-2a68-4e9e-8a10-06210c5a44d2 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:51.345397 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849dddf-cfe5-410e-a146-e1155d44808f admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:51.472025 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849dddf-cfe5-410e-a146-e1155d44808f admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:51.478221 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:51.484628 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425df15-2a68-4e9e-8a10-06210c5a44d2 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:51.488179 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7045f-4c38-411e-b484-cdd0c7525a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:51.489009 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7045f-4c38-411e-b484-cdd0c7525a47 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:51.489982 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7045f-4c38-411e-b484-cdd0c7525a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:51.490846 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7045f-4c38-411e-b484-cdd0c7525a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:51.491399 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7714e-dbe1-492c-86f0-3583d8cbb019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:51.491959 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7045f-4c38-411e-b484-cdd0c7525a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:51.492986 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7714e-dbe1-492c-86f0-3583d8cbb019 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:51.493553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7714e-dbe1-492c-86f0-3583d8cbb019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:51.494082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7714e-dbe1-492c-86f0-3583d8cbb019 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:51.495069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7714e-dbe1-492c-86f0-3583d8cbb019 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:51.495918 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7045f-4c38-411e-b484-cdd0c7525a47 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:51.497449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7714e-dbe1-492c-86f0-3583d8cbb019 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:51.520542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 944/1891] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:51.525980 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7045f-4c38-411e-b484-cdd0c7525a47 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:51.533461 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 948/1892] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:51 2022] POST /identity/v3/users => generated 299 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:51.540325 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7045f-4c38-411e-b484-cdd0c7525a47 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:51.548388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5ea40-d5cc-4e47-9dfb-057424e28931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:51.549596 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5ea40-d5cc-4e47-9dfb-057424e28931 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:51.549876 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5ea40-d5cc-4e47-9dfb-057424e28931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:51.550162 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5ea40-d5cc-4e47-9dfb-057424e28931 admin admin] PATH_INFO: `/v3/projects/fac470be681c42948026e02c09f5eb50/users/9f86d9c58c3f4e71babc0e01753d2e6e/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:51.550289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7714e-dbe1-492c-86f0-3583d8cbb019 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:51.552453 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5ea40-d5cc-4e47-9dfb-057424e28931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fac470be681c42948026e02c09f5eb50, user_id=9f86d9c58c3f4e71babc0e01753d2e6e, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:51.565228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5ea40-d5cc-4e47-9dfb-057424e28931 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:51.580610 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7714e-dbe1-492c-86f0-3583d8cbb019 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:51.593120 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 945/1893] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:51 2022] PUT /identity/v3/projects/fac470be681c42948026e02c09f5eb50/users/9f86d9c58c3f4e71babc0e01753d2e6e/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:30:51.599751 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48e2e4-0e87-4bbf-ab44-35f225f8bbe3 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:51.600435 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48e2e4-0e87-4bbf-ab44-35f225f8bbe3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:51.600622 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48e2e4-0e87-4bbf-ab44-35f225f8bbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:51.661584 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-ac48e2e4-0e87-4bbf-ab44-35f225f8bbe3 None None] MFA Rules not processed for user `9f86d9c58c3f4e71babc0e01753d2e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:51.664055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ac48e2e4-0e87-4bbf-ab44-35f225f8bbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:51.681272 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86086b52-08c6-4595-b2e1-893aae484bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:51.681951 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86086b52-08c6-4595-b2e1-893aae484bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:51.682268 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86086b52-08c6-4595-b2e1-893aae484bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:51.682536 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86086b52-08c6-4595-b2e1-893aae484bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:51.684747 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86086b52-08c6-4595-b2e1-893aae484bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:51.686514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86086b52-08c6-4595-b2e1-893aae484bd9 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:51.701767 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 949/1894] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:51.705908 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86086b52-08c6-4595-b2e1-893aae484bd9 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:51.734760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86086b52-08c6-4595-b2e1-893aae484bd9 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:51.743662 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c7ca0-c125-459a-b8be-750d26ff1139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:51.745365 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c7ca0-c125-459a-b8be-750d26ff1139 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:51.746134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c7ca0-c125-459a-b8be-750d26ff1139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:51.746645 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c7ca0-c125-459a-b8be-750d26ff1139 admin admin] PATH_INFO: `/v3/projects/44b703b6681b4e7ea27ec10646bd02d9/users/e6a6558ca1734aaca6c9cfa5be287564/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:51.764500 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c7ca0-c125-459a-b8be-750d26ff1139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b703b6681b4e7ea27ec10646bd02d9, user_id=e6a6558ca1734aaca6c9cfa5be287564, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:51.767146 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c7ca0-c125-459a-b8be-750d26ff1139 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:51.782534 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 946/1895] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:51 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:30:51.792210 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 950/1896] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:51 2022] PUT /identity/v3/projects/44b703b6681b4e7ea27ec10646bd02d9/users/e6a6558ca1734aaca6c9cfa5be287564/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:51.795669 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48e2e4-0e87-4bbf-ab44-35f225f8bbe3 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:51.809164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48e2e4-0e87-4bbf-ab44-35f225f8bbe3 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:51.814101 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c7ca0-c125-459a-b8be-750d26ff1139 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:51.868457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:51.888076 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4022e8-eacc-4a0f-982d-9857730e2eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:51.888886 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4022e8-eacc-4a0f-982d-9857730e2eee admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:51.889282 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4022e8-eacc-4a0f-982d-9857730e2eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:51.889630 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4022e8-eacc-4a0f-982d-9857730e2eee admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:51.890287 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4022e8-eacc-4a0f-982d-9857730e2eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:51.891892 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4022e8-eacc-4a0f-982d-9857730e2eee admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:51.900039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c7ca0-c125-459a-b8be-750d26ff1139 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:51.905052 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 947/1897] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:51.906930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4022e8-eacc-4a0f-982d-9857730e2eee admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:51.907950 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c1a7e-cb9f-47cc-a667-df5e8169ad4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:51.908562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c1a7e-cb9f-47cc-a667-df5e8169ad4d service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:51.908859 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c1a7e-cb9f-47cc-a667-df5e8169ad4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:51.909145 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c1a7e-cb9f-47cc-a667-df5e8169ad4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:51.917519 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4022e8-eacc-4a0f-982d-9857730e2eee admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:51.922190 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752d3e0-6031-4951-93d3-b7b514b816e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:51.922834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752d3e0-6031-4951-93d3-b7b514b816e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:51.923117 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752d3e0-6031-4951-93d3-b7b514b816e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:51.923419 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752d3e0-6031-4951-93d3-b7b514b816e7 admin admin] PATH_INFO: `/v3/projects/44b703b6681b4e7ea27ec10646bd02d9/users/e6a6558ca1734aaca6c9cfa5be287564/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:51.925396 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752d3e0-6031-4951-93d3-b7b514b816e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b703b6681b4e7ea27ec10646bd02d9, user_id=e6a6558ca1734aaca6c9cfa5be287564, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:51.928033 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752d3e0-6031-4951-93d3-b7b514b816e7 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:51.938768 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 948/1898] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:51 2022] PUT /identity/v3/projects/44b703b6681b4e7ea27ec10646bd02d9/users/e6a6558ca1734aaca6c9cfa5be287564/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:51.949370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569d9f3-13a5-495a-94cc-1c25fc3944d8 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:51.949732 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569d9f3-13a5-495a-94cc-1c25fc3944d8 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:51.950075 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569d9f3-13a5-495a-94cc-1c25fc3944d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:51.975950 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c1a7e-cb9f-47cc-a667-df5e8169ad4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:51.979407 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c1a7e-cb9f-47cc-a667-df5e8169ad4d service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:51.980624 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c569d9f3-13a5-495a-94cc-1c25fc3944d8 None None] MFA Rules not processed for user `e6a6558ca1734aaca6c9cfa5be287564`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:51.981913 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c569d9f3-13a5-495a-94cc-1c25fc3944d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:51.995334 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 951/1899] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:51 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:30:52.065822 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c1a7e-cb9f-47cc-a667-df5e8169ad4d service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:52.067347 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-155c1a7e-cb9f-47cc-a667-df5e8169ad4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:52.079983 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 949/1900] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:52.084303 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c1a7e-cb9f-47cc-a667-df5e8169ad4d service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:52.090746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:52.098818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569d9f3-13a5-495a-94cc-1c25fc3944d8 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:52.151487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f49f5c-e166-4d05-b428-805f1715b305 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:52.152210 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f49f5c-e166-4d05-b428-805f1715b305 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:52.152556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f49f5c-e166-4d05-b428-805f1715b305 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:52.152898 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f49f5c-e166-4d05-b428-805f1715b305 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:52.181959 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569d9f3-13a5-495a-94cc-1c25fc3944d8 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:52.187515 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3a728-c919-4d7c-ba90-1371c9bad7cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:52.188862 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3a728-c919-4d7c-ba90-1371c9bad7cb service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:52.189374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3a728-c919-4d7c-ba90-1371c9bad7cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:52.189939 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3a728-c919-4d7c-ba90-1371c9bad7cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:52.203825 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3a728-c919-4d7c-ba90-1371c9bad7cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:52.206472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3a728-c919-4d7c-ba90-1371c9bad7cb service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:52.219813 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 950/1901] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:52.225105 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f49f5c-e166-4d05-b428-805f1715b305 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:52.227184 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f49f5c-e166-4d05-b428-805f1715b305 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:52.238544 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 952/1902] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:52 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:30:52.281348 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690f748-09c1-455e-9f0d-b4ed999fd750 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:52.281348 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690f748-09c1-455e-9f0d-b4ed999fd750 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:52.281654 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690f748-09c1-455e-9f0d-b4ed999fd750 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:52.283289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 951/1903] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 9 02:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:30:52.302887 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8afb0-4761-4e54-924f-5c9ea82427d2 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:52.303470 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8afb0-4761-4e54-924f-5c9ea82427d2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:52.303659 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8afb0-4761-4e54-924f-5c9ea82427d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:52.330433 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-68e8afb0-4761-4e54-924f-5c9ea82427d2 None None] MFA Rules not processed for user `5fe21d9a65a34abeae7329df924d7998`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:52.334257 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-68e8afb0-4761-4e54-924f-5c9ea82427d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:52.415872 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 953/1904] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 9 02:30:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:52.470384 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690f748-09c1-455e-9f0d-b4ed999fd750 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:52.473504 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2690f748-09c1-455e-9f0d-b4ed999fd750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:52.522818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690f748-09c1-455e-9f0d-b4ed999fd750 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:52.536780 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b4af8-8bc3-49ec-b8a8-903c5501e9da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fe21d9a65a34abeae7329df924d7998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:52.538167 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b4af8-8bc3-49ec-b8a8-903c5501e9da service placement] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:52.538550 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b4af8-8bc3-49ec-b8a8-903c5501e9da service placement] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:52.538923 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b4af8-8bc3-49ec-b8a8-903c5501e9da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:52.548199 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b4af8-8bc3-49ec-b8a8-903c5501e9da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:52.550006 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b4af8-8bc3-49ec-b8a8-903c5501e9da service placement] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:52.575852 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 952/1905] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:52.607675 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b7d9c-64c9-42a3-9753-01a2b893e167 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:52.608008 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b7d9c-64c9-42a3-9753-01a2b893e167 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:52.608248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b7d9c-64c9-42a3-9753-01a2b893e167 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:52.610565 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 954/1906] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 9 02:30:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:30:52.642242 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4027fc-1cfe-4514-9179-602f1e6525f0 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:52.642830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4027fc-1cfe-4514-9179-602f1e6525f0 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:52.643334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4027fc-1cfe-4514-9179-602f1e6525f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:52.688879 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-8b4027fc-1cfe-4514-9179-602f1e6525f0 None None] MFA Rules not processed for user `78fff294b9794a26aa1bbc231fa1133c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:52.693366 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8b4027fc-1cfe-4514-9179-602f1e6525f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:52.827143 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:52.917506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 953/1907] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 9 02:30:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:52.952916 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b7d9c-64c9-42a3-9753-01a2b893e167 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:52.955123 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-624b7d9c-64c9-42a3-9753-01a2b893e167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:53.002612 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b7d9c-64c9-42a3-9753-01a2b893e167 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:53.010045 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cf278-3d2b-42fb-b6da-c3e2b637f92c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:53.017473 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cf278-3d2b-42fb-b6da-c3e2b637f92c service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:53.017770 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cf278-3d2b-42fb-b6da-c3e2b637f92c service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:53.018051 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cf278-3d2b-42fb-b6da-c3e2b637f92c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:53.031225 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5cf278-3d2b-42fb-b6da-c3e2b637f92c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:53.034556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5cf278-3d2b-42fb-b6da-c3e2b637f92c service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:53.049602 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 955/1908] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:53.375084 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4027fc-1cfe-4514-9179-602f1e6525f0 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:53.502199 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4027fc-1cfe-4514-9179-602f1e6525f0 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:53.509393 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297fa1e-8922-494c-8433-1f2ad67f45f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:53.510301 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297fa1e-8922-494c-8433-1f2ad67f45f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:53.510625 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297fa1e-8922-494c-8433-1f2ad67f45f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:53.510909 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297fa1e-8922-494c-8433-1f2ad67f45f4 admin admin] PATH_INFO: `/v3/users/589fc45f2ad54cfc8fed48d26b0bf5fa` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:53.512126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297fa1e-8922-494c-8433-1f2ad67f45f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=589fc45f2ad54cfc8fed48d26b0bf5fa)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:53.515087 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297fa1e-8922-494c-8433-1f2ad67f45f4 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:53.604869 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c297fa1e-8922-494c-8433-1f2ad67f45f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '589fc45f2ad54cfc8fed48d26b0bf5fa'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:53.633448 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c297fa1e-8922-494c-8433-1f2ad67f45f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '589fc45f2ad54cfc8fed48d26b0bf5fa'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:53.646226 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cf278-3d2b-42fb-b6da-c3e2b637f92c service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:53.667589 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c297fa1e-8922-494c-8433-1f2ad67f45f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '589fc45f2ad54cfc8fed48d26b0bf5fa'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:53.669917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cf278-3d2b-42fb-b6da-c3e2b637f92c service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:53.670390 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c297fa1e-8922-494c-8433-1f2ad67f45f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '589fc45f2ad54cfc8fed48d26b0bf5fa'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:53.683160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689b477-3890-4eef-a292-2e3754a86e88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:53.684316 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689b477-3890-4eef-a292-2e3754a86e88 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:53.685825 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689b477-3890-4eef-a292-2e3754a86e88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:53.686139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689b477-3890-4eef-a292-2e3754a86e88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:53.690711 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c689b477-3890-4eef-a292-2e3754a86e88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:53.704161 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c297fa1e-8922-494c-8433-1f2ad67f45f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '589fc45f2ad54cfc8fed48d26b0bf5fa'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:53.719117 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 954/1909] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:30:53 2022] DELETE /identity/v3/users/589fc45f2ad54cfc8fed48d26b0bf5fa => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:53.785453 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:53.832990 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689b477-3890-4eef-a292-2e3754a86e88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:53.840176 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689b477-3890-4eef-a292-2e3754a86e88 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:53.875767 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 956/1910] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:53.944865 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297fa1e-8922-494c-8433-1f2ad67f45f4 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:53.948169 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c297fa1e-8922-494c-8433-1f2ad67f45f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:54.082913 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:54.103696 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297fa1e-8922-494c-8433-1f2ad67f45f4 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:54.109785 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d45114-2649-4ce7-beb6-bb74ddcc9d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:54.110568 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d45114-2649-4ce7-beb6-bb74ddcc9d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:54.110977 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d45114-2649-4ce7-beb6-bb74ddcc9d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:54.111496 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d45114-2649-4ce7-beb6-bb74ddcc9d4a admin admin] PATH_INFO: `/v3/users/423bdab2759c4af2b2c819886fb37bb0` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:54.113470 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d45114-2649-4ce7-beb6-bb74ddcc9d4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=423bdab2759c4af2b2c819886fb37bb0)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:54.116321 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d45114-2649-4ce7-beb6-bb74ddcc9d4a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:54.233630 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-a1d45114-2649-4ce7-beb6-bb74ddcc9d4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '423bdab2759c4af2b2c819886fb37bb0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:54.247280 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-a1d45114-2649-4ce7-beb6-bb74ddcc9d4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '423bdab2759c4af2b2c819886fb37bb0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:54.261052 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-a1d45114-2649-4ce7-beb6-bb74ddcc9d4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '423bdab2759c4af2b2c819886fb37bb0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:54.262292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-a1d45114-2649-4ce7-beb6-bb74ddcc9d4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '423bdab2759c4af2b2c819886fb37bb0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:54.301261 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-a1d45114-2649-4ce7-beb6-bb74ddcc9d4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '423bdab2759c4af2b2c819886fb37bb0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:54.310410 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 955/1911] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:30:53 2022] DELETE /identity/v3/users/423bdab2759c4af2b2c819886fb37bb0 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:54.312017 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689b477-3890-4eef-a292-2e3754a86e88 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:54.314599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c689b477-3890-4eef-a292-2e3754a86e88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:54.315199 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7893e4-fa71-4905-a11d-001be76e5201 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:54.315493 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7893e4-fa71-4905-a11d-001be76e5201 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:54.315790 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7893e4-fa71-4905-a11d-001be76e5201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:54.338221 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689b477-3890-4eef-a292-2e3754a86e88 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:54.359717 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-dd7893e4-fa71-4905-a11d-001be76e5201 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:54.360687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-dd7893e4-fa71-4905-a11d-001be76e5201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:54.463024 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f3f64-6d20-4db5-a515-27ea7ad49445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:54.463663 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f3f64-6d20-4db5-a515-27ea7ad49445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:54.463943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f3f64-6d20-4db5-a515-27ea7ad49445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:54.464218 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f3f64-6d20-4db5-a515-27ea7ad49445 admin admin] PATH_INFO: `/v3/projects/c39c7d1ca99d4a878450f5ea733086ac` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:54.465361 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f3f64-6d20-4db5-a515-27ea7ad49445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c39c7d1ca99d4a878450f5ea733086ac)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:54.467423 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f3f64-6d20-4db5-a515-27ea7ad49445 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:54.470854 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 956/1912] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:54.482559 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7893e4-fa71-4905-a11d-001be76e5201 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:54.485273 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-dd7893e4-fa71-4905-a11d-001be76e5201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:54.523957 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-394f3f64-6d20-4db5-a515-27ea7ad49445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c39c7d1ca99d4a878450f5ea733086ac', 'request_id': 'req-394f3f64-6d20-4db5-a515-27ea7ad49445'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:54.529652 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-394f3f64-6d20-4db5-a515-27ea7ad49445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c39c7d1ca99d4a878450f5ea733086ac', 'request_id': 'req-394f3f64-6d20-4db5-a515-27ea7ad49445'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:54.536553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-394f3f64-6d20-4db5-a515-27ea7ad49445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c39c7d1ca99d4a878450f5ea733086ac', 'request_id': 'req-394f3f64-6d20-4db5-a515-27ea7ad49445'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:54.552576 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-394f3f64-6d20-4db5-a515-27ea7ad49445 admin admin] The token cache is being invalidate because project c39c7d1ca99d4a878450f5ea733086ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:30:54.552878 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-394f3f64-6d20-4db5-a515-27ea7ad49445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:54.553747 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-394f3f64-6d20-4db5-a515-27ea7ad49445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:54.557057 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 957/1913] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:30:54 2022] DELETE /identity/v3/projects/c39c7d1ca99d4a878450f5ea733086ac => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:54.557729 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7893e4-fa71-4905-a11d-001be76e5201 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:54.560609 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f3f64-6d20-4db5-a515-27ea7ad49445 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:54.562223 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-394f3f64-6d20-4db5-a515-27ea7ad49445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:54.587011 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:54.617767 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffd8c0-3cec-45c4-b5bd-04a982cd0f84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:54.618388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffd8c0-3cec-45c4-b5bd-04a982cd0f84 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:54.619036 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffd8c0-3cec-45c4-b5bd-04a982cd0f84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:54.619036 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffd8c0-3cec-45c4-b5bd-04a982cd0f84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:54.620751 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-86ffd8c0-3cec-45c4-b5bd-04a982cd0f84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:54.631964 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f3f64-6d20-4db5-a515-27ea7ad49445 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:54.632703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffd8c0-3cec-45c4-b5bd-04a982cd0f84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:54.634416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffd8c0-3cec-45c4-b5bd-04a982cd0f84 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:54.637291 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07570ca-8c2a-4ae5-9b54-d7433add89ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:54.638147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07570ca-8c2a-4ae5-9b54-d7433add89ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:54.641135 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07570ca-8c2a-4ae5-9b54-d7433add89ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:54.641135 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07570ca-8c2a-4ae5-9b54-d7433add89ef admin admin] PATH_INFO: `/v3/users/8b1b382b926a40c092ff761f25aa678d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:54.641776 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07570ca-8c2a-4ae5-9b54-d7433add89ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b1b382b926a40c092ff761f25aa678d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:54.643723 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07570ca-8c2a-4ae5-9b54-d7433add89ef admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:54.644377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 957/1914] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:54.666331 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:54.720865 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b07570ca-8c2a-4ae5-9b54-d7433add89ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b1b382b926a40c092ff761f25aa678d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:54.732194 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b07570ca-8c2a-4ae5-9b54-d7433add89ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b1b382b926a40c092ff761f25aa678d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:54.733166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b07570ca-8c2a-4ae5-9b54-d7433add89ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b1b382b926a40c092ff761f25aa678d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:54.749413 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b07570ca-8c2a-4ae5-9b54-d7433add89ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b1b382b926a40c092ff761f25aa678d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:54.758993 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b07570ca-8c2a-4ae5-9b54-d7433add89ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b1b382b926a40c092ff761f25aa678d'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:54.775419 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 958/1915] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:30:54 2022] DELETE /identity/v3/users/8b1b382b926a40c092ff761f25aa678d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:54.964252 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffd8c0-3cec-45c4-b5bd-04a982cd0f84 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:54.965870 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-86ffd8c0-3cec-45c4-b5bd-04a982cd0f84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:54.997416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffd8c0-3cec-45c4-b5bd-04a982cd0f84 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:55.064557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07570ca-8c2a-4ae5-9b54-d7433add89ef admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:55.066093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b07570ca-8c2a-4ae5-9b54-d7433add89ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:55.072641 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76afa35-db1f-444f-86da-9aa0adf94104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:55.073510 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76afa35-db1f-444f-86da-9aa0adf94104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:55.074069 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76afa35-db1f-444f-86da-9aa0adf94104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:55.074487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76afa35-db1f-444f-86da-9aa0adf94104 admin admin] PATH_INFO: `/v3/projects/e1b1b8e7422c4e558521ada7aab9ec2c` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:55.076736 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76afa35-db1f-444f-86da-9aa0adf94104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1b1b8e7422c4e558521ada7aab9ec2c)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:55.079010 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76afa35-db1f-444f-86da-9aa0adf94104 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:55.092180 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07570ca-8c2a-4ae5-9b54-d7433add89ef admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:55.097745 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbd807-b5df-4f99-a90c-a13afee8dae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:55.098655 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbd807-b5df-4f99-a90c-a13afee8dae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:55.099006 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbd807-b5df-4f99-a90c-a13afee8dae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:55.099353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbd807-b5df-4f99-a90c-a13afee8dae6 admin admin] PATH_INFO: `/v3/projects/fc087b80b53a4a449397a731a78f6709` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:55.102439 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbd807-b5df-4f99-a90c-a13afee8dae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc087b80b53a4a449397a731a78f6709)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:55.104466 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbd807-b5df-4f99-a90c-a13afee8dae6 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:55.153560 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-a76afa35-db1f-444f-86da-9aa0adf94104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1b1b8e7422c4e558521ada7aab9ec2c', 'request_id': 'req-a76afa35-db1f-444f-86da-9aa0adf94104'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:55.162353 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-a76afa35-db1f-444f-86da-9aa0adf94104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1b1b8e7422c4e558521ada7aab9ec2c', 'request_id': 'req-a76afa35-db1f-444f-86da-9aa0adf94104'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:55.170297 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c5bbd807-b5df-4f99-a90c-a13afee8dae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc087b80b53a4a449397a731a78f6709', 'request_id': 'req-c5bbd807-b5df-4f99-a90c-a13afee8dae6'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:55.173233 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-a76afa35-db1f-444f-86da-9aa0adf94104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1b1b8e7422c4e558521ada7aab9ec2c', 'request_id': 'req-a76afa35-db1f-444f-86da-9aa0adf94104'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:55.176391 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c5bbd807-b5df-4f99-a90c-a13afee8dae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc087b80b53a4a449397a731a78f6709', 'request_id': 'req-c5bbd807-b5df-4f99-a90c-a13afee8dae6'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:55.184510 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c5bbd807-b5df-4f99-a90c-a13afee8dae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc087b80b53a4a449397a731a78f6709', 'request_id': 'req-c5bbd807-b5df-4f99-a90c-a13afee8dae6'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:55.199617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-a76afa35-db1f-444f-86da-9aa0adf94104 admin admin] The token cache is being invalidate because project e1b1b8e7422c4e558521ada7aab9ec2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:30:55.199919 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-a76afa35-db1f-444f-86da-9aa0adf94104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:55.200768 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-a76afa35-db1f-444f-86da-9aa0adf94104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:55.205877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c5bbd807-b5df-4f99-a90c-a13afee8dae6 admin admin] The token cache is being invalidate because project fc087b80b53a4a449397a731a78f6709 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:30:55.206321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c5bbd807-b5df-4f99-a90c-a13afee8dae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:55.221233 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 958/1916] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:30:54 2022] DELETE /identity/v3/projects/e1b1b8e7422c4e558521ada7aab9ec2c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:55.221494 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c5bbd807-b5df-4f99-a90c-a13afee8dae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:55.222343 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76afa35-db1f-444f-86da-9aa0adf94104 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:55.223777 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a76afa35-db1f-444f-86da-9aa0adf94104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:55.224358 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 959/1917] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:30:55 2022] DELETE /identity/v3/projects/fc087b80b53a4a449397a731a78f6709 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:30:55.229494 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0204f-6b87-4dce-a4a8-650cafbc0ea0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:55.230344 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0204f-6b87-4dce-a4a8-650cafbc0ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:55.230734 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0204f-6b87-4dce-a4a8-650cafbc0ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:55.266470 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5dc0204f-6b87-4dce-a4a8-650cafbc0ea0 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:55.267707 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5dc0204f-6b87-4dce-a4a8-650cafbc0ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:55.311216 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76afa35-db1f-444f-86da-9aa0adf94104 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:55.318363 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:55.355403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 960/1918] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:55.358408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0204f-6b87-4dce-a4a8-650cafbc0ea0 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:55.361002 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5dc0204f-6b87-4dce-a4a8-650cafbc0ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:55.395357 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853ddd5-9f30-42fc-8190-969608f8b183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:55.395922 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853ddd5-9f30-42fc-8190-969608f8b183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:55.396208 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853ddd5-9f30-42fc-8190-969608f8b183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:55.396492 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853ddd5-9f30-42fc-8190-969608f8b183 admin admin] PATH_INFO: `/v3/users/292eb0070700428db73135d8dbaccfb2` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:55.397687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853ddd5-9f30-42fc-8190-969608f8b183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=292eb0070700428db73135d8dbaccfb2)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:55.399898 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0204f-6b87-4dce-a4a8-650cafbc0ea0 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:55.400190 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853ddd5-9f30-42fc-8190-969608f8b183 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:55.406962 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c0e37-0549-49e6-ae57-1ad3ad7bd4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:55.407944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c0e37-0549-49e6-ae57-1ad3ad7bd4ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:55.408432 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c0e37-0549-49e6-ae57-1ad3ad7bd4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:55.408909 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c0e37-0549-49e6-ae57-1ad3ad7bd4ee admin admin] PATH_INFO: `/v3/users/2a79a286f099403d9ed453c865a74bdc` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:55.410301 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c0e37-0549-49e6-ae57-1ad3ad7bd4ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a79a286f099403d9ed453c865a74bdc)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:55.412447 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c0e37-0549-49e6-ae57-1ad3ad7bd4ee admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:55.431386 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:55.456184 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6853ddd5-9f30-42fc-8190-969608f8b183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '292eb0070700428db73135d8dbaccfb2'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:55.465111 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6853ddd5-9f30-42fc-8190-969608f8b183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '292eb0070700428db73135d8dbaccfb2'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:55.473951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6853ddd5-9f30-42fc-8190-969608f8b183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '292eb0070700428db73135d8dbaccfb2'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:55.475027 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6853ddd5-9f30-42fc-8190-969608f8b183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '292eb0070700428db73135d8dbaccfb2'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:55.489137 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-672c0e37-0549-49e6-ae57-1ad3ad7bd4ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a79a286f099403d9ed453c865a74bdc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:55.501129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-672c0e37-0549-49e6-ae57-1ad3ad7bd4ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a79a286f099403d9ed453c865a74bdc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:55.502274 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-672c0e37-0549-49e6-ae57-1ad3ad7bd4ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a79a286f099403d9ed453c865a74bdc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:55.503634 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6853ddd5-9f30-42fc-8190-969608f8b183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '292eb0070700428db73135d8dbaccfb2'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:55.525430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 959/1919] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:30:55 2022] DELETE /identity/v3/users/292eb0070700428db73135d8dbaccfb2 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:55.525430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ff880-90b6-4805-93f0-06dfd0ec6b8a None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:55.525430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ff880-90b6-4805-93f0-06dfd0ec6b8a None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:55.525430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ff880-90b6-4805-93f0-06dfd0ec6b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:55.525724 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-672c0e37-0549-49e6-ae57-1ad3ad7bd4ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a79a286f099403d9ed453c865a74bdc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:55.528495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-672c0e37-0549-49e6-ae57-1ad3ad7bd4ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a79a286f099403d9ed453c865a74bdc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:55.541526 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 961/1920] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:30:55 2022] DELETE /identity/v3/users/2a79a286f099403d9ed453c865a74bdc => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:55.545829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3512e-9be0-44f0-a425-d78dcfd4a53a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:55.546385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3512e-9be0-44f0-a425-d78dcfd4a53a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:55.547020 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3512e-9be0-44f0-a425-d78dcfd4a53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:55.563314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-4e3ff880-90b6-4805-93f0-06dfd0ec6b8a None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:55.564933 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4e3ff880-90b6-4805-93f0-06dfd0ec6b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:55.573343 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ead3512e-9be0-44f0-a425-d78dcfd4a53a None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:55.574474 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ead3512e-9be0-44f0-a425-d78dcfd4a53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:55.651902 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 962/1921] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:55.660874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 960/1922] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:55.665921 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3512e-9be0-44f0-a425-d78dcfd4a53a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:55.672550 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ff880-90b6-4805-93f0-06dfd0ec6b8a None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:55.675936 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4e3ff880-90b6-4805-93f0-06dfd0ec6b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:55.681460 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3512e-9be0-44f0-a425-d78dcfd4a53a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:55.689712 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f62d79-6b00-4dba-9e0f-06bd402b227a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:55.690835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f62d79-6b00-4dba-9e0f-06bd402b227a admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:55.691263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f62d79-6b00-4dba-9e0f-06bd402b227a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:55.691667 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f62d79-6b00-4dba-9e0f-06bd402b227a admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:55.693722 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f62d79-6b00-4dba-9e0f-06bd402b227a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:30:55.694335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f62d79-6b00-4dba-9e0f-06bd402b227a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:55.697159 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f62d79-6b00-4dba-9e0f-06bd402b227a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:55.723769 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 963/1923] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:30:55.729870 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f62d79-6b00-4dba-9e0f-06bd402b227a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:55.745557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f62d79-6b00-4dba-9e0f-06bd402b227a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:55.751436 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965244fd-d53e-4e77-85c0-8113cb228b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:55.752054 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965244fd-d53e-4e77-85c0-8113cb228b3e admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:55.752331 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965244fd-d53e-4e77-85c0-8113cb228b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:55.752600 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965244fd-d53e-4e77-85c0-8113cb228b3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:55.753258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965244fd-d53e-4e77-85c0-8113cb228b3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:55.755329 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965244fd-d53e-4e77-85c0-8113cb228b3e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:55.757539 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:55.803958 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 964/1924] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:55 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:30:55.804176 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ff880-90b6-4805-93f0-06dfd0ec6b8a None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:55.805631 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965244fd-d53e-4e77-85c0-8113cb228b3e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:55.865458 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80368c20-a97c-4c2d-ba88-425feff5f674 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:55.866185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80368c20-a97c-4c2d-ba88-425feff5f674 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:55.866470 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80368c20-a97c-4c2d-ba88-425feff5f674 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:55.866766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80368c20-a97c-4c2d-ba88-425feff5f674 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:55.885552 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:55.903099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965244fd-d53e-4e77-85c0-8113cb228b3e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:55.909194 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8939ee6-19c1-4fa8-b5f5-0b2b40746973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:55.909842 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8939ee6-19c1-4fa8-b5f5-0b2b40746973 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:55.910101 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8939ee6-19c1-4fa8-b5f5-0b2b40746973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:55.910568 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8939ee6-19c1-4fa8-b5f5-0b2b40746973 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:55.911160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8939ee6-19c1-4fa8-b5f5-0b2b40746973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:55.913723 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8939ee6-19c1-4fa8-b5f5-0b2b40746973 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:55.935582 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 965/1925] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:55 2022] POST /identity/v3/users => generated 290 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:30:55.936470 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8939ee6-19c1-4fa8-b5f5-0b2b40746973 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:55.938067 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d8939ee6-19c1-4fa8-b5f5-0b2b40746973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:55.941666 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80368c20-a97c-4c2d-ba88-425feff5f674 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:55.943194 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80368c20-a97c-4c2d-ba88-425feff5f674 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:55.950610 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8939ee6-19c1-4fa8-b5f5-0b2b40746973 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:55.953191 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 961/1926] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:30:55.954008 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80368c20-a97c-4c2d-ba88-425feff5f674 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:55.955563 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a08c55-3fa6-4c4e-9a40-d578fb54907c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:55.956191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a08c55-3fa6-4c4e-9a40-d578fb54907c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:55.956470 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a08c55-3fa6-4c4e-9a40-d578fb54907c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:55.956739 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a08c55-3fa6-4c4e-9a40-d578fb54907c admin admin] PATH_INFO: `/v3/projects/65d528bda3304baab28be5ca693c3149` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:55.957947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a08c55-3fa6-4c4e-9a40-d578fb54907c admin admin] RBAC: Authorizing `identity:delete_project(project_id=65d528bda3304baab28be5ca693c3149)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:55.960170 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a08c55-3fa6-4c4e-9a40-d578fb54907c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:55.964915 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80368c20-a97c-4c2d-ba88-425feff5f674 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:55.976764 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd5d7d-2bcc-4f47-89ed-ed76effa6fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:55.976764 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd5d7d-2bcc-4f47-89ed-ed76effa6fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:55.976764 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd5d7d-2bcc-4f47-89ed-ed76effa6fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:55.976764 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd5d7d-2bcc-4f47-89ed-ed76effa6fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:55.977383 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd5d7d-2bcc-4f47-89ed-ed76effa6fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:55.977383 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd5d7d-2bcc-4f47-89ed-ed76effa6fb8 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:55.998559 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 962/1927] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:56.002125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd5d7d-2bcc-4f47-89ed-ed76effa6fb8 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:56.020921 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd5d7d-2bcc-4f47-89ed-ed76effa6fb8 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:56.039418 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-31a08c55-3fa6-4c4e-9a40-d578fb54907c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65d528bda3304baab28be5ca693c3149', 'request_id': 'req-31a08c55-3fa6-4c4e-9a40-d578fb54907c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:56.047348 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-31a08c55-3fa6-4c4e-9a40-d578fb54907c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65d528bda3304baab28be5ca693c3149', 'request_id': 'req-31a08c55-3fa6-4c4e-9a40-d578fb54907c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:56.056354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-31a08c55-3fa6-4c4e-9a40-d578fb54907c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65d528bda3304baab28be5ca693c3149', 'request_id': 'req-31a08c55-3fa6-4c4e-9a40-d578fb54907c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:56.074911 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-31a08c55-3fa6-4c4e-9a40-d578fb54907c admin admin] The token cache is being invalidate because project 65d528bda3304baab28be5ca693c3149 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:30:56.075904 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-31a08c55-3fa6-4c4e-9a40-d578fb54907c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:56.076736 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-31a08c55-3fa6-4c4e-9a40-d578fb54907c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:56.078918 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 966/1928] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:30:55 2022] DELETE /identity/v3/projects/65d528bda3304baab28be5ca693c3149 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:56.085353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f89cf7-9c58-468f-802b-b16afe51fd04 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:56.086382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f89cf7-9c58-468f-802b-b16afe51fd04 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:56.086826 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f89cf7-9c58-468f-802b-b16afe51fd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:56.103218 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a3616-4443-42f6-86dc-6425b7a2ef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:56.103963 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a3616-4443-42f6-86dc-6425b7a2ef39 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:56.104823 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a3616-4443-42f6-86dc-6425b7a2ef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:56.105419 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a3616-4443-42f6-86dc-6425b7a2ef39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:56.106211 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a3616-4443-42f6-86dc-6425b7a2ef39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:56.108806 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a3616-4443-42f6-86dc-6425b7a2ef39 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:56.116675 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-94f89cf7-9c58-468f-802b-b16afe51fd04 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:56.119116 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-94f89cf7-9c58-468f-802b-b16afe51fd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:56.123851 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 963/1929] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:56.127486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a3616-4443-42f6-86dc-6425b7a2ef39 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:56.129455 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ac7a3616-4443-42f6-86dc-6425b7a2ef39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:56.145334 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 967/1930] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:56.148849 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76701deb-74c8-40ea-a69f-f7309639be84 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:56.149199 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76701deb-74c8-40ea-a69f-f7309639be84 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:56.149504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76701deb-74c8-40ea-a69f-f7309639be84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:56.152766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a3616-4443-42f6-86dc-6425b7a2ef39 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:56.157869 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314d186-b345-4560-9834-3d06baeb7fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:56.158456 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314d186-b345-4560-9834-3d06baeb7fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:56.158799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314d186-b345-4560-9834-3d06baeb7fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:56.158989 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314d186-b345-4560-9834-3d06baeb7fdb admin admin] PATH_INFO: `/v3/projects/fa10a9a8556447e4b1974454f5132b3e/users/6ccf810bcc0f480193f6a2bed2b2b7d1/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:56.178101 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f314d186-b345-4560-9834-3d06baeb7fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa10a9a8556447e4b1974454f5132b3e, user_id=6ccf810bcc0f480193f6a2bed2b2b7d1, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:56.181153 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f314d186-b345-4560-9834-3d06baeb7fdb admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:56.181902 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-76701deb-74c8-40ea-a69f-f7309639be84 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:56.183109 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-76701deb-74c8-40ea-a69f-f7309639be84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:56.185335 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:56.196227 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 968/1931] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:56.197738 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76701deb-74c8-40ea-a69f-f7309639be84 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:56.205245 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 964/1932] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:56 2022] PUT /identity/v3/projects/fa10a9a8556447e4b1974454f5132b3e/users/6ccf810bcc0f480193f6a2bed2b2b7d1/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:30:56.208484 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76701deb-74c8-40ea-a69f-f7309639be84 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:56.217966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc3632-1623-4370-9ea3-e1257055f8c9 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:56.218305 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc3632-1623-4370-9ea3-e1257055f8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:56.218526 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc3632-1623-4370-9ea3-e1257055f8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:56.321046 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e341f-5959-461b-ae26-2fd5a8aebbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:56.321046 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e341f-5959-461b-ae26-2fd5a8aebbeb admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:56.321046 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e341f-5959-461b-ae26-2fd5a8aebbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:56.321046 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e341f-5959-461b-ae26-2fd5a8aebbeb admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:56.321557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e341f-5959-461b-ae26-2fd5a8aebbeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:30:56.321557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e341f-5959-461b-ae26-2fd5a8aebbeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:56.321557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e341f-5959-461b-ae26-2fd5a8aebbeb admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:56.329584 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-aebc3632-1623-4370-9ea3-e1257055f8c9 None None] MFA Rules not processed for user `6ccf810bcc0f480193f6a2bed2b2b7d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:56.330681 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 969/1933] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:30:56.334343 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-aebc3632-1623-4370-9ea3-e1257055f8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:56.336147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e341f-5959-461b-ae26-2fd5a8aebbeb admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:56.359990 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e341f-5959-461b-ae26-2fd5a8aebbeb admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:56.372521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745f1eb-ba1d-4e95-8c7b-849509f8a541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:56.373184 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745f1eb-ba1d-4e95-8c7b-849509f8a541 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:56.373469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745f1eb-ba1d-4e95-8c7b-849509f8a541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:56.373746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745f1eb-ba1d-4e95-8c7b-849509f8a541 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:56.378602 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745f1eb-ba1d-4e95-8c7b-849509f8a541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:56.383718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745f1eb-ba1d-4e95-8c7b-849509f8a541 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:56.446738 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 965/1934] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:56.471697 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 970/1935] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:56 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:56.476338 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745f1eb-ba1d-4e95-8c7b-849509f8a541 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:56.476519 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc3632-1623-4370-9ea3-e1257055f8c9 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:56.491086 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc3632-1623-4370-9ea3-e1257055f8c9 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:56.520877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:56.587939 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745f1eb-ba1d-4e95-8c7b-849509f8a541 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:56.601487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b617c-a9e3-4466-8498-dada4cbb34f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:56.602226 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b617c-a9e3-4466-8498-dada4cbb34f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:56.602566 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b617c-a9e3-4466-8498-dada4cbb34f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:56.602953 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b617c-a9e3-4466-8498-dada4cbb34f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:56.604149 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b617c-a9e3-4466-8498-dada4cbb34f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:56.606338 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b617c-a9e3-4466-8498-dada4cbb34f4 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:56.652392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ee6ec-154b-4f0b-9d2a-1c990de5d3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:56.666170 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ee6ec-154b-4f0b-9d2a-1c990de5d3ed admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:56.667261 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ee6ec-154b-4f0b-9d2a-1c990de5d3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:56.669565 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 971/1936] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:56 2022] POST /identity/v3/users => generated 291 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:56.672090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b617c-a9e3-4466-8498-dada4cbb34f4 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:56.673914 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ee6ec-154b-4f0b-9d2a-1c990de5d3ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:56.675080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ee6ec-154b-4f0b-9d2a-1c990de5d3ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:56.675242 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-452b617c-a9e3-4466-8498-dada4cbb34f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:56.682487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ee6ec-154b-4f0b-9d2a-1c990de5d3ed admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:56.691822 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b617c-a9e3-4466-8498-dada4cbb34f4 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:56.698456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9481b2e-60f0-4ee5-83c0-2cac2c3e24ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:56.700155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9481b2e-60f0-4ee5-83c0-2cac2c3e24ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:56.700935 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9481b2e-60f0-4ee5-83c0-2cac2c3e24ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:56.701283 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9481b2e-60f0-4ee5-83c0-2cac2c3e24ec admin admin] PATH_INFO: `/v3/projects/662665d2ce1f4714b895fbb3f529b103` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:56.703302 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9481b2e-60f0-4ee5-83c0-2cac2c3e24ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=662665d2ce1f4714b895fbb3f529b103)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:56.705577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9481b2e-60f0-4ee5-83c0-2cac2c3e24ec admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:56.752985 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 966/1937] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:56 2022] POST /identity/v3/projects => generated 381 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:56.753924 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ee6ec-154b-4f0b-9d2a-1c990de5d3ed admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:56.778122 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-aa5ee6ec-154b-4f0b-9d2a-1c990de5d3ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:56.854189 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a9481b2e-60f0-4ee5-83c0-2cac2c3e24ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '662665d2ce1f4714b895fbb3f529b103', 'request_id': 'req-a9481b2e-60f0-4ee5-83c0-2cac2c3e24ec'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:56.872181 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a9481b2e-60f0-4ee5-83c0-2cac2c3e24ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '662665d2ce1f4714b895fbb3f529b103', 'request_id': 'req-a9481b2e-60f0-4ee5-83c0-2cac2c3e24ec'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:56.896681 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a9481b2e-60f0-4ee5-83c0-2cac2c3e24ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '662665d2ce1f4714b895fbb3f529b103', 'request_id': 'req-a9481b2e-60f0-4ee5-83c0-2cac2c3e24ec'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:56.926435 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a9481b2e-60f0-4ee5-83c0-2cac2c3e24ec admin admin] The token cache is being invalidate because project 662665d2ce1f4714b895fbb3f529b103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:30:56.926639 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a9481b2e-60f0-4ee5-83c0-2cac2c3e24ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:56.928133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a9481b2e-60f0-4ee5-83c0-2cac2c3e24ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:56.933764 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 972/1938] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:30:56 2022] DELETE /identity/v3/projects/662665d2ce1f4714b895fbb3f529b103 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:56.935628 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9481b2e-60f0-4ee5-83c0-2cac2c3e24ec admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:56.938249 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a9481b2e-60f0-4ee5-83c0-2cac2c3e24ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:57.006294 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ee6ec-154b-4f0b-9d2a-1c990de5d3ed admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:57.031385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:57.051514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9481b2e-60f0-4ee5-83c0-2cac2c3e24ec admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:57.059540 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556afe99-ce07-44a0-9f1a-5ff4ec5f4eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:57.060413 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556afe99-ce07-44a0-9f1a-5ff4ec5f4eba admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:57.060780 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556afe99-ce07-44a0-9f1a-5ff4ec5f4eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:57.061224 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556afe99-ce07-44a0-9f1a-5ff4ec5f4eba admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:57.061997 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556afe99-ce07-44a0-9f1a-5ff4ec5f4eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:57.063827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556afe99-ce07-44a0-9f1a-5ff4ec5f4eba admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:57.076378 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 973/1939] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:56 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:57.077758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556afe99-ce07-44a0-9f1a-5ff4ec5f4eba admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:57.079823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-556afe99-ce07-44a0-9f1a-5ff4ec5f4eba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:57.093450 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e450bca-a68b-4014-9bcc-22709ae7289f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:57.094237 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e450bca-a68b-4014-9bcc-22709ae7289f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:57.094589 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556afe99-ce07-44a0-9f1a-5ff4ec5f4eba admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:57.094766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e450bca-a68b-4014-9bcc-22709ae7289f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:57.094916 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e450bca-a68b-4014-9bcc-22709ae7289f admin admin] PATH_INFO: `/v3/users/aa98fd24cc6a4f6eaf4077160e8112fe` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:57.096153 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e450bca-a68b-4014-9bcc-22709ae7289f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa98fd24cc6a4f6eaf4077160e8112fe)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:57.098252 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e450bca-a68b-4014-9bcc-22709ae7289f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:57.107832 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e54ef-3c6a-4cd7-91fe-359f050149db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:57.108453 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e54ef-3c6a-4cd7-91fe-359f050149db admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:57.108735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e54ef-3c6a-4cd7-91fe-359f050149db admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:57.109000 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e54ef-3c6a-4cd7-91fe-359f050149db admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:57.109932 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e54ef-3c6a-4cd7-91fe-359f050149db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:57.111861 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e54ef-3c6a-4cd7-91fe-359f050149db admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:57.138423 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 974/1940] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:57 2022] POST /identity/v3/users => generated 297 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:57.138423 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e54ef-3c6a-4cd7-91fe-359f050149db admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:57.140009 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3c5e54ef-3c6a-4cd7-91fe-359f050149db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:57.154421 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e54ef-3c6a-4cd7-91fe-359f050149db admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:57.164571 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90734d9d-dc58-4233-8c08-6bae1727fc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:57.165245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90734d9d-dc58-4233-8c08-6bae1727fc79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:57.165528 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90734d9d-dc58-4233-8c08-6bae1727fc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:57.165805 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90734d9d-dc58-4233-8c08-6bae1727fc79 admin admin] PATH_INFO: `/v3/users/deee93edb1af4155ad5f8e9163c5a745` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:57.167682 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90734d9d-dc58-4233-8c08-6bae1727fc79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deee93edb1af4155ad5f8e9163c5a745)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:57.173316 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90734d9d-dc58-4233-8c08-6bae1727fc79 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:57.189108 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:57.191953 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-0e450bca-a68b-4014-9bcc-22709ae7289f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa98fd24cc6a4f6eaf4077160e8112fe'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:57.208890 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-0e450bca-a68b-4014-9bcc-22709ae7289f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa98fd24cc6a4f6eaf4077160e8112fe'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:57.224265 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-0e450bca-a68b-4014-9bcc-22709ae7289f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa98fd24cc6a4f6eaf4077160e8112fe'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:57.224934 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-0e450bca-a68b-4014-9bcc-22709ae7289f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa98fd24cc6a4f6eaf4077160e8112fe'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:57.255188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-90734d9d-dc58-4233-8c08-6bae1727fc79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deee93edb1af4155ad5f8e9163c5a745'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:57.264869 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-90734d9d-dc58-4233-8c08-6bae1727fc79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deee93edb1af4155ad5f8e9163c5a745'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:57.265727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-90734d9d-dc58-4233-8c08-6bae1727fc79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deee93edb1af4155ad5f8e9163c5a745'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:57.266427 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-0e450bca-a68b-4014-9bcc-22709ae7289f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa98fd24cc6a4f6eaf4077160e8112fe'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:57.278018 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 967/1941] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:30:56 2022] DELETE /identity/v3/users/aa98fd24cc6a4f6eaf4077160e8112fe => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:57.278806 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e450bca-a68b-4014-9bcc-22709ae7289f admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:57.282007 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0e450bca-a68b-4014-9bcc-22709ae7289f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:57.282767 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-90734d9d-dc58-4233-8c08-6bae1727fc79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deee93edb1af4155ad5f8e9163c5a745'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:57.291819 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-90734d9d-dc58-4233-8c08-6bae1727fc79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deee93edb1af4155ad5f8e9163c5a745'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:57.298336 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 975/1942] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:30:57 2022] DELETE /identity/v3/users/deee93edb1af4155ad5f8e9163c5a745 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:57.299152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90734d9d-dc58-4233-8c08-6bae1727fc79 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:57.306290 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-90734d9d-dc58-4233-8c08-6bae1727fc79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:57.373402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e450bca-a68b-4014-9bcc-22709ae7289f admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:57.413180 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90734d9d-dc58-4233-8c08-6bae1727fc79 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:57.421002 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af755df-4a1c-4299-b3af-3632461176f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:57.421968 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af755df-4a1c-4299-b3af-3632461176f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:57.423622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af755df-4a1c-4299-b3af-3632461176f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:57.423902 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af755df-4a1c-4299-b3af-3632461176f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:57.424595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af755df-4a1c-4299-b3af-3632461176f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:57.426767 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af755df-4a1c-4299-b3af-3632461176f7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:57.427255 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:57.439022 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 976/1943] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:57.440689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ded12-4978-4eb4-93b3-cf25bb140d89 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:57.441194 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ded12-4978-4eb4-93b3-cf25bb140d89 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:57.441795 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ded12-4978-4eb4-93b3-cf25bb140d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:57.449397 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae0a79-7409-41e5-8329-b17768308839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:57.450131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae0a79-7409-41e5-8329-b17768308839 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:57.450432 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae0a79-7409-41e5-8329-b17768308839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:57.450851 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae0a79-7409-41e5-8329-b17768308839 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:57.451640 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae0a79-7409-41e5-8329-b17768308839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:57.453267 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae0a79-7409-41e5-8329-b17768308839 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:57.465264 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f73ded12-4978-4eb4-93b3-cf25bb140d89 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:57.468895 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 968/1944] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:57.469048 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f73ded12-4978-4eb4-93b3-cf25bb140d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:57.469132 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae0a79-7409-41e5-8329-b17768308839 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:57.483387 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 977/1945] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:57.483543 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae0a79-7409-41e5-8329-b17768308839 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:57.483644 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ded12-4978-4eb4-93b3-cf25bb140d89 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:57.485888 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f73ded12-4978-4eb4-93b3-cf25bb140d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:57.496038 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa9aec-1a76-4ffe-a137-4c09e8966981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:57.497056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa9aec-1a76-4ffe-a137-4c09e8966981 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:57.497460 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa9aec-1a76-4ffe-a137-4c09e8966981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:57.497576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa9aec-1a76-4ffe-a137-4c09e8966981 admin admin] PATH_INFO: `/v3/projects/c6bd84a041ae4a56b2f1ed8052eee319/users/c1d5a28f090140edabc10af3f615e784/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:57.499673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ded12-4978-4eb4-93b3-cf25bb140d89 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:57.504362 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0923c4-4683-42d5-8158-a269cef64cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:57.505318 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0923c4-4683-42d5-8158-a269cef64cec admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:57.505318 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0923c4-4683-42d5-8158-a269cef64cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:57.506886 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0923c4-4683-42d5-8158-a269cef64cec admin admin] PATH_INFO: `/v3/projects/3dea4e8658d2403e854c1f46e6d04319/users/e8d2af85238f4e70be3b061caba850b9/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:57.514123 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa9aec-1a76-4ffe-a137-4c09e8966981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6bd84a041ae4a56b2f1ed8052eee319, user_id=c1d5a28f090140edabc10af3f615e784, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:57.517066 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa9aec-1a76-4ffe-a137-4c09e8966981 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:57.523613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0923c4-4683-42d5-8158-a269cef64cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dea4e8658d2403e854c1f46e6d04319, user_id=e8d2af85238f4e70be3b061caba850b9, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:57.527008 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0923c4-4683-42d5-8158-a269cef64cec admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:57.533271 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 969/1946] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:57 2022] PUT /identity/v3/projects/c6bd84a041ae4a56b2f1ed8052eee319/users/c1d5a28f090140edabc10af3f615e784/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:57.534108 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa9aec-1a76-4ffe-a137-4c09e8966981 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:57.535810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-fbaa9aec-1a76-4ffe-a137-4c09e8966981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:57.546622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 978/1947] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:57 2022] PUT /identity/v3/projects/3dea4e8658d2403e854c1f46e6d04319/users/e8d2af85238f4e70be3b061caba850b9/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:57.556146 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0923c4-4683-42d5-8158-a269cef64cec admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:57.608802 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa9aec-1a76-4ffe-a137-4c09e8966981 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:57.644656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:57.659980 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0923c4-4683-42d5-8158-a269cef64cec admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:57.667411 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b3d31-c5ae-4a6b-814c-e7bd839cd100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:57.668102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b3d31-c5ae-4a6b-814c-e7bd839cd100 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:57.668389 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b3d31-c5ae-4a6b-814c-e7bd839cd100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:57.668667 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b3d31-c5ae-4a6b-814c-e7bd839cd100 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:57.669344 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b3d31-c5ae-4a6b-814c-e7bd839cd100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:57.671017 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b3d31-c5ae-4a6b-814c-e7bd839cd100 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:57.672132 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28a2d6-f7cc-46f0-97a5-78db34644b01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:57.672750 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28a2d6-f7cc-46f0-97a5-78db34644b01 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:57.673051 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28a2d6-f7cc-46f0-97a5-78db34644b01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:57.673339 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28a2d6-f7cc-46f0-97a5-78db34644b01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:57.685534 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 979/1948] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:57.685534 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3eb6fa-5281-470e-9624-3b7a7fd6ca79 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:57.685534 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3eb6fa-5281-470e-9624-3b7a7fd6ca79 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:57.685534 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3eb6fa-5281-470e-9624-3b7a7fd6ca79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:57.685940 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28a2d6-f7cc-46f0-97a5-78db34644b01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:57.686967 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28a2d6-f7cc-46f0-97a5-78db34644b01 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:57.700736 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 970/1949] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:57.701586 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28a2d6-f7cc-46f0-97a5-78db34644b01 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:57.712798 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28a2d6-f7cc-46f0-97a5-78db34644b01 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:57.715658 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8f3eb6fa-5281-470e-9624-3b7a7fd6ca79 None None] MFA Rules not processed for user `e8d2af85238f4e70be3b061caba850b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:57.717404 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8f3eb6fa-5281-470e-9624-3b7a7fd6ca79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:57.718400 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f35002-b65c-4cfa-9878-8e35ee6b9d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:57.719134 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f35002-b65c-4cfa-9878-8e35ee6b9d2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:57.719512 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f35002-b65c-4cfa-9878-8e35ee6b9d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:57.719844 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f35002-b65c-4cfa-9878-8e35ee6b9d2d admin admin] PATH_INFO: `/v3/projects/c6bd84a041ae4a56b2f1ed8052eee319/users/c1d5a28f090140edabc10af3f615e784/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:57.722060 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f35002-b65c-4cfa-9878-8e35ee6b9d2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6bd84a041ae4a56b2f1ed8052eee319, user_id=c1d5a28f090140edabc10af3f615e784, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:57.725439 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f35002-b65c-4cfa-9878-8e35ee6b9d2d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:57.753220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 971/1950] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:57 2022] PUT /identity/v3/projects/c6bd84a041ae4a56b2f1ed8052eee319/users/c1d5a28f090140edabc10af3f615e784/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:57.753220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f35002-b65c-4cfa-9878-8e35ee6b9d2d admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:57.754545 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-98f35002-b65c-4cfa-9878-8e35ee6b9d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:57.817543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 980/1951] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:57.821678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35679c-7eae-4398-a9b9-d76635d452fd None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:57.821678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35679c-7eae-4398-a9b9-d76635d452fd None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:57.821678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35679c-7eae-4398-a9b9-d76635d452fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:57.840436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f35002-b65c-4cfa-9878-8e35ee6b9d2d admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:57.845875 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29417dc-6340-446e-ba74-ed1d34149504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:57.846549 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29417dc-6340-446e-ba74-ed1d34149504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:57.846900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29417dc-6340-446e-ba74-ed1d34149504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:57.847178 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29417dc-6340-446e-ba74-ed1d34149504 admin admin] PATH_INFO: `/v3/projects/91e956b9383641e295ac144b5ed96ad5` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:57.848578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29417dc-6340-446e-ba74-ed1d34149504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91e956b9383641e295ac144b5ed96ad5)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:57.850527 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29417dc-6340-446e-ba74-ed1d34149504 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:57.854009 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:57.855531 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-3e35679c-7eae-4398-a9b9-d76635d452fd None None] MFA Rules not processed for user `c1d5a28f090140edabc10af3f615e784`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:57.857509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3e35679c-7eae-4398-a9b9-d76635d452fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:57.920347 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c29417dc-6340-446e-ba74-ed1d34149504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91e956b9383641e295ac144b5ed96ad5', 'request_id': 'req-c29417dc-6340-446e-ba74-ed1d34149504'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:57.931051 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c29417dc-6340-446e-ba74-ed1d34149504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91e956b9383641e295ac144b5ed96ad5', 'request_id': 'req-c29417dc-6340-446e-ba74-ed1d34149504'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:57.939596 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c29417dc-6340-446e-ba74-ed1d34149504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91e956b9383641e295ac144b5ed96ad5', 'request_id': 'req-c29417dc-6340-446e-ba74-ed1d34149504'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:57.960072 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 981/1952] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:57.961458 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c29417dc-6340-446e-ba74-ed1d34149504 admin admin] The token cache is being invalidate because project 91e956b9383641e295ac144b5ed96ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:30:57.961819 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35679c-7eae-4398-a9b9-d76635d452fd None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:57.962160 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c29417dc-6340-446e-ba74-ed1d34149504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:57.963363 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c29417dc-6340-446e-ba74-ed1d34149504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:57.975452 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 972/1953] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:30:57 2022] DELETE /identity/v3/projects/91e956b9383641e295ac144b5ed96ad5 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:57.980305 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29417dc-6340-446e-ba74-ed1d34149504 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:57.989854 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c29417dc-6340-446e-ba74-ed1d34149504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:58.002512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35679c-7eae-4398-a9b9-d76635d452fd None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:58.066803 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29417dc-6340-446e-ba74-ed1d34149504 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:58.072954 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d70bf3-ef26-495e-9eec-1da8dea75944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:58.073627 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d70bf3-ef26-495e-9eec-1da8dea75944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:58.074032 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d70bf3-ef26-495e-9eec-1da8dea75944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:58.074320 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d70bf3-ef26-495e-9eec-1da8dea75944 admin admin] PATH_INFO: `/v3/users/48dc1de7d99e45148793bc1c865929a3` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:58.076255 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d70bf3-ef26-495e-9eec-1da8dea75944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48dc1de7d99e45148793bc1c865929a3)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:58.078373 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d70bf3-ef26-495e-9eec-1da8dea75944 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:58.098977 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d8204-b71d-4757-96d5-7f2bdfbcf2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:58.099599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d8204-b71d-4757-96d5-7f2bdfbcf2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:58.099924 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d8204-b71d-4757-96d5-7f2bdfbcf2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:58.100153 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d8204-b71d-4757-96d5-7f2bdfbcf2c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:58.101317 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d8204-b71d-4757-96d5-7f2bdfbcf2c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:58.103540 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d8204-b71d-4757-96d5-7f2bdfbcf2c2 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:58.115406 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:58.135929 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 982/1954] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:57 2022] POST /identity/v3/projects => generated 379 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:58.136991 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d8204-b71d-4757-96d5-7f2bdfbcf2c2 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:58.138581 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ab7d8204-b71d-4757-96d5-7f2bdfbcf2c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:58.150724 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f8d70bf3-ef26-495e-9eec-1da8dea75944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48dc1de7d99e45148793bc1c865929a3'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:58.158090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f8d70bf3-ef26-495e-9eec-1da8dea75944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48dc1de7d99e45148793bc1c865929a3'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:58.165526 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f8d70bf3-ef26-495e-9eec-1da8dea75944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48dc1de7d99e45148793bc1c865929a3'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:58.166192 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f8d70bf3-ef26-495e-9eec-1da8dea75944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48dc1de7d99e45148793bc1c865929a3'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:58.178495 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f8d70bf3-ef26-495e-9eec-1da8dea75944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48dc1de7d99e45148793bc1c865929a3'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:58.185206 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 973/1955] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:30:57 2022] DELETE /identity/v3/users/48dc1de7d99e45148793bc1c865929a3 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:58.186053 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d70bf3-ef26-495e-9eec-1da8dea75944 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:58.187393 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f8d70bf3-ef26-495e-9eec-1da8dea75944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:58.200672 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d8204-b71d-4757-96d5-7f2bdfbcf2c2 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:58.202086 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:58.263024 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d70bf3-ef26-495e-9eec-1da8dea75944 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:58.269193 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b351b45-c90e-47e8-abe9-5d1e4c77f255 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:58.270127 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b351b45-c90e-47e8-abe9-5d1e4c77f255 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:58.270470 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b351b45-c90e-47e8-abe9-5d1e4c77f255 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:58.270592 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc403f-c0d4-4f0c-b1b6-6cad9cac9733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:58.270904 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b351b45-c90e-47e8-abe9-5d1e4c77f255 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:58.271408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc403f-c0d4-4f0c-b1b6-6cad9cac9733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:58.271736 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc403f-c0d4-4f0c-b1b6-6cad9cac9733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:58.272076 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc403f-c0d4-4f0c-b1b6-6cad9cac9733 admin admin] PATH_INFO: `/v3/projects/43dc2f65411144c2892e44069f4fe2b3` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:58.273310 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc403f-c0d4-4f0c-b1b6-6cad9cac9733 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43dc2f65411144c2892e44069f4fe2b3)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:58.273966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6b351b45-c90e-47e8-abe9-5d1e4c77f255 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:58.275810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc403f-c0d4-4f0c-b1b6-6cad9cac9733 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:58.351834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6bcc403f-c0d4-4f0c-b1b6-6cad9cac9733 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43dc2f65411144c2892e44069f4fe2b3', 'request_id': 'req-6bcc403f-c0d4-4f0c-b1b6-6cad9cac9733'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:58.360773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6bcc403f-c0d4-4f0c-b1b6-6cad9cac9733 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43dc2f65411144c2892e44069f4fe2b3', 'request_id': 'req-6bcc403f-c0d4-4f0c-b1b6-6cad9cac9733'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:58.377863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6bcc403f-c0d4-4f0c-b1b6-6cad9cac9733 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43dc2f65411144c2892e44069f4fe2b3', 'request_id': 'req-6bcc403f-c0d4-4f0c-b1b6-6cad9cac9733'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:58.391088 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b351b45-c90e-47e8-abe9-5d1e4c77f255 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:58.393989 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b351b45-c90e-47e8-abe9-5d1e4c77f255 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:58.397520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6bcc403f-c0d4-4f0c-b1b6-6cad9cac9733 admin admin] The token cache is being invalidate because project 43dc2f65411144c2892e44069f4fe2b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:30:58.397858 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6bcc403f-c0d4-4f0c-b1b6-6cad9cac9733 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:58.398582 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6bcc403f-c0d4-4f0c-b1b6-6cad9cac9733 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:58.400229 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 974/1956] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:30:58 2022] DELETE /identity/v3/projects/43dc2f65411144c2892e44069f4fe2b3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:58.403313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc403f-c0d4-4f0c-b1b6-6cad9cac9733 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:58.403313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6bcc403f-c0d4-4f0c-b1b6-6cad9cac9733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:58.419436 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 983/1957] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:58.421417 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b351b45-c90e-47e8-abe9-5d1e4c77f255 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:58.453909 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b351b45-c90e-47e8-abe9-5d1e4c77f255 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:58.549696 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc403f-c0d4-4f0c-b1b6-6cad9cac9733 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:58.551484 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:58.563959 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380aba7-59ce-4f23-a17b-29d780804e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:58.564811 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380aba7-59ce-4f23-a17b-29d780804e85 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:58.565343 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380aba7-59ce-4f23-a17b-29d780804e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:58.566867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380aba7-59ce-4f23-a17b-29d780804e85 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:58.568779 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380aba7-59ce-4f23-a17b-29d780804e85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:58.572570 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380aba7-59ce-4f23-a17b-29d780804e85 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:58.575412 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e56f5-4b8c-4c6a-b768-78d0023e1f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:58.576228 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e56f5-4b8c-4c6a-b768-78d0023e1f38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:58.576587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e56f5-4b8c-4c6a-b768-78d0023e1f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:58.577504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e56f5-4b8c-4c6a-b768-78d0023e1f38 admin admin] PATH_INFO: `/v3/users/9f86d9c58c3f4e71babc0e01753d2e6e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:58.579476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e56f5-4b8c-4c6a-b768-78d0023e1f38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f86d9c58c3f4e71babc0e01753d2e6e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:58.582276 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e56f5-4b8c-4c6a-b768-78d0023e1f38 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:58.603449 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 975/1958] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:58 2022] POST /identity/v3/users => generated 296 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:58.609084 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380aba7-59ce-4f23-a17b-29d780804e85 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:58.662496 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380aba7-59ce-4f23-a17b-29d780804e85 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:58.682496 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5ebdf-d8a0-4256-a840-e7eb506aa4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:58.683129 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5ebdf-d8a0-4256-a840-e7eb506aa4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:58.683408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5ebdf-d8a0-4256-a840-e7eb506aa4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:58.683725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5ebdf-d8a0-4256-a840-e7eb506aa4f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:58.690008 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5ebdf-d8a0-4256-a840-e7eb506aa4f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:58.692351 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a5ebdf-d8a0-4256-a840-e7eb506aa4f0 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:58.708892 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 976/1959] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:58.710350 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5ebdf-d8a0-4256-a840-e7eb506aa4f0 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:58.711933 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d1a5ebdf-d8a0-4256-a840-e7eb506aa4f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:58.721042 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4a5e56f5-4b8c-4c6a-b768-78d0023e1f38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f86d9c58c3f4e71babc0e01753d2e6e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:58.734613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4a5e56f5-4b8c-4c6a-b768-78d0023e1f38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f86d9c58c3f4e71babc0e01753d2e6e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:58.735480 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4a5e56f5-4b8c-4c6a-b768-78d0023e1f38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f86d9c58c3f4e71babc0e01753d2e6e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:58.742263 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:58.780978 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4a5e56f5-4b8c-4c6a-b768-78d0023e1f38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f86d9c58c3f4e71babc0e01753d2e6e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:58.797250 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4a5e56f5-4b8c-4c6a-b768-78d0023e1f38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f86d9c58c3f4e71babc0e01753d2e6e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:58.806642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 984/1960] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:30:58 2022] DELETE /identity/v3/users/9f86d9c58c3f4e71babc0e01753d2e6e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:58.807725 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e56f5-4b8c-4c6a-b768-78d0023e1f38 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:58.809256 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4a5e56f5-4b8c-4c6a-b768-78d0023e1f38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:58.811866 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5ebdf-d8a0-4256-a840-e7eb506aa4f0 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:58.889668 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e75b3-c437-4f82-99a0-2116e4fbcff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:58.890723 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e75b3-c437-4f82-99a0-2116e4fbcff9 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:58.891150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e75b3-c437-4f82-99a0-2116e4fbcff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:58.891845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e75b3-c437-4f82-99a0-2116e4fbcff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:58.893967 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-068e75b3-c437-4f82-99a0-2116e4fbcff9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:58.919611 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e56f5-4b8c-4c6a-b768-78d0023e1f38 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:58.925274 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cb3c4-788e-4322-b551-a5b3090cd72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:58.925927 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cb3c4-788e-4322-b551-a5b3090cd72b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:58.926251 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cb3c4-788e-4322-b551-a5b3090cd72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:58.926534 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cb3c4-788e-4322-b551-a5b3090cd72b admin admin] PATH_INFO: `/v3/projects/43bf851f83da414e987c0cda83e1857c` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:58.927710 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1cb3c4-788e-4322-b551-a5b3090cd72b admin admin] RBAC: Authorizing `identity:delete_project(project_id=43bf851f83da414e987c0cda83e1857c)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:58.929780 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1cb3c4-788e-4322-b551-a5b3090cd72b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:58.971535 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e75b3-c437-4f82-99a0-2116e4fbcff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:58.972981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e75b3-c437-4f82-99a0-2116e4fbcff9 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:58.989205 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 977/1961] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:58.991352 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e75b3-c437-4f82-99a0-2116e4fbcff9 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:58.993382 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-068e75b3-c437-4f82-99a0-2116e4fbcff9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:58.999683 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cd1cb3c4-788e-4322-b551-a5b3090cd72b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43bf851f83da414e987c0cda83e1857c', 'request_id': 'req-cd1cb3c4-788e-4322-b551-a5b3090cd72b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:59.007930 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cd1cb3c4-788e-4322-b551-a5b3090cd72b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43bf851f83da414e987c0cda83e1857c', 'request_id': 'req-cd1cb3c4-788e-4322-b551-a5b3090cd72b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:59.011858 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e75b3-c437-4f82-99a0-2116e4fbcff9 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:59.016313 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cd1cb3c4-788e-4322-b551-a5b3090cd72b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43bf851f83da414e987c0cda83e1857c', 'request_id': 'req-cd1cb3c4-788e-4322-b551-a5b3090cd72b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:59.034378 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cd1cb3c4-788e-4322-b551-a5b3090cd72b admin admin] The token cache is being invalidate because project 43bf851f83da414e987c0cda83e1857c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:30:59.034682 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cd1cb3c4-788e-4322-b551-a5b3090cd72b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:59.035430 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cd1cb3c4-788e-4322-b551-a5b3090cd72b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:59.041180 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 985/1962] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:30:58 2022] DELETE /identity/v3/projects/43bf851f83da414e987c0cda83e1857c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:59.041180 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cb3c4-788e-4322-b551-a5b3090cd72b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:59.043479 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cd1cb3c4-788e-4322-b551-a5b3090cd72b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:59.050935 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:59.115279 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c967148-8fb4-4ece-83de-a05ceff9fa73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:59.115914 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c967148-8fb4-4ece-83de-a05ceff9fa73 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:59.116190 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c967148-8fb4-4ece-83de-a05ceff9fa73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:59.116472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c967148-8fb4-4ece-83de-a05ceff9fa73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:59.118809 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1c967148-8fb4-4ece-83de-a05ceff9fa73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:59.159128 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cb3c4-788e-4322-b551-a5b3090cd72b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:59.166884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02cffa-ec91-4725-82a4-1965564735a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:59.167870 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02cffa-ec91-4725-82a4-1965564735a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:59.168538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02cffa-ec91-4725-82a4-1965564735a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:59.169083 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02cffa-ec91-4725-82a4-1965564735a7 admin admin] PATH_INFO: `/v3/projects/72a750ed32dc41ae9a6be94a06be387b/users/1b72ace5a399440588b9f91c0a1ed9d0/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:59.197434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02cffa-ec91-4725-82a4-1965564735a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a750ed32dc41ae9a6be94a06be387b, user_id=1b72ace5a399440588b9f91c0a1ed9d0, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:59.204830 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02cffa-ec91-4725-82a4-1965564735a7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:59.210050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:59.235229 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c967148-8fb4-4ece-83de-a05ceff9fa73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:59.237120 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c967148-8fb4-4ece-83de-a05ceff9fa73 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:59.238550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 986/1963] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:59 2022] PUT /identity/v3/projects/72a750ed32dc41ae9a6be94a06be387b/users/1b72ace5a399440588b9f91c0a1ed9d0/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:59.239971 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c3056-b2da-4a6f-a4ad-510cd1799da2 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:59.240274 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c3056-b2da-4a6f-a4ad-510cd1799da2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:59.241286 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c3056-b2da-4a6f-a4ad-510cd1799da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:59.252449 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 978/1964] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:30:59.253786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c967148-8fb4-4ece-83de-a05ceff9fa73 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:59.255708 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1c967148-8fb4-4ece-83de-a05ceff9fa73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:59.273984 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c967148-8fb4-4ece-83de-a05ceff9fa73 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:59.301673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-756c3056-b2da-4a6f-a4ad-510cd1799da2 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:59.303253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-756c3056-b2da-4a6f-a4ad-510cd1799da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:59.347369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c99f4b-7dda-46f1-ae98-d1187eb3ec68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:59.348372 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c99f4b-7dda-46f1-ae98-d1187eb3ec68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:59.348722 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c99f4b-7dda-46f1-ae98-d1187eb3ec68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:59.349091 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c99f4b-7dda-46f1-ae98-d1187eb3ec68 admin admin] PATH_INFO: `/v3/projects/fac470be681c42948026e02c09f5eb50` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:59.350474 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c99f4b-7dda-46f1-ae98-d1187eb3ec68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fac470be681c42948026e02c09f5eb50)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:59.352864 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c99f4b-7dda-46f1-ae98-d1187eb3ec68 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:59.412259 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-88c99f4b-7dda-46f1-ae98-d1187eb3ec68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fac470be681c42948026e02c09f5eb50', 'request_id': 'req-88c99f4b-7dda-46f1-ae98-d1187eb3ec68'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:59.418846 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-88c99f4b-7dda-46f1-ae98-d1187eb3ec68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fac470be681c42948026e02c09f5eb50', 'request_id': 'req-88c99f4b-7dda-46f1-ae98-d1187eb3ec68'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:59.423728 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 987/1965] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:59.424828 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c3056-b2da-4a6f-a4ad-510cd1799da2 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:59.427466 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-88c99f4b-7dda-46f1-ae98-d1187eb3ec68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fac470be681c42948026e02c09f5eb50', 'request_id': 'req-88c99f4b-7dda-46f1-ae98-d1187eb3ec68'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:59.446113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-88c99f4b-7dda-46f1-ae98-d1187eb3ec68 admin admin] The token cache is being invalidate because project fac470be681c42948026e02c09f5eb50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:30:59.446420 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-88c99f4b-7dda-46f1-ae98-d1187eb3ec68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:59.446976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c3056-b2da-4a6f-a4ad-510cd1799da2 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:59.447205 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-88c99f4b-7dda-46f1-ae98-d1187eb3ec68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:30:59.452834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 979/1966] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:30:59 2022] DELETE /identity/v3/projects/fac470be681c42948026e02c09f5eb50 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:59.454253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97335035-aed4-4478-8727-04c4553c5b9a None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:59.454602 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97335035-aed4-4478-8727-04c4553c5b9a None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:59.454804 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97335035-aed4-4478-8727-04c4553c5b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:59.488149 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-97335035-aed4-4478-8727-04c4553c5b9a None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:59.499850 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-97335035-aed4-4478-8727-04c4553c5b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:59.553504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3e097-fc8c-4d6c-826b-eeeaaddaafc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:59.554295 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3e097-fc8c-4d6c-826b-eeeaaddaafc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:59.554672 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3e097-fc8c-4d6c-826b-eeeaaddaafc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:59.555131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3e097-fc8c-4d6c-826b-eeeaaddaafc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:59.555944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3e097-fc8c-4d6c-826b-eeeaaddaafc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:59.558789 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3e097-fc8c-4d6c-826b-eeeaaddaafc0 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:59.595350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 988/1967] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:30:59.597054 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68902c17-eca5-453f-9b8f-34696ed89ddb None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:59.597556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68902c17-eca5-453f-9b8f-34696ed89ddb None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:59.598078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68902c17-eca5-453f-9b8f-34696ed89ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:59.624390 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-68902c17-eca5-453f-9b8f-34696ed89ddb None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:59.625808 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 980/1968] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:59.626762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-68902c17-eca5-453f-9b8f-34696ed89ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:59.627205 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97335035-aed4-4478-8727-04c4553c5b9a None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:59.630721 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-97335035-aed4-4478-8727-04c4553c5b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:59.638353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 989/1969] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:59.639171 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68902c17-eca5-453f-9b8f-34696ed89ddb None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:59.652264 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68902c17-eca5-453f-9b8f-34696ed89ddb None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:59.659658 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcb337-f76a-4430-ad76-e9ad9227b3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:59.660363 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcb337-f76a-4430-ad76-e9ad9227b3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:59.667281 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcb337-f76a-4430-ad76-e9ad9227b3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:59.667281 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcb337-f76a-4430-ad76-e9ad9227b3f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:59.667281 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfcb337-f76a-4430-ad76-e9ad9227b3f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:30:59.667281 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfcb337-f76a-4430-ad76-e9ad9227b3f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:59.667281 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfcb337-f76a-4430-ad76-e9ad9227b3f5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:59.670926 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97335035-aed4-4478-8727-04c4553c5b9a None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:59.679528 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb637e16-102b-4c5f-8823-56dd1b22a1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:59.680456 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb637e16-102b-4c5f-8823-56dd1b22a1fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:59.680968 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb637e16-102b-4c5f-8823-56dd1b22a1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:59.681154 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 990/1970] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:30:59.681685 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb637e16-102b-4c5f-8823-56dd1b22a1fc admin admin] PATH_INFO: `/v3/projects/72a750ed32dc41ae9a6be94a06be387b/users/1b72ace5a399440588b9f91c0a1ed9d0/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:59.682585 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb938ca-da66-44c5-b14f-aa36c9c52d9c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:59.683467 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb938ca-da66-44c5-b14f-aa36c9c52d9c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:59.683812 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb938ca-da66-44c5-b14f-aa36c9c52d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:59.687171 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb637e16-102b-4c5f-8823-56dd1b22a1fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a750ed32dc41ae9a6be94a06be387b, user_id=1b72ace5a399440588b9f91c0a1ed9d0, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:59.691272 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb637e16-102b-4c5f-8823-56dd1b22a1fc admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:59.694633 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:59.720623 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-dcb938ca-da66-44c5-b14f-aa36c9c52d9c None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:59.720623 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-dcb938ca-da66-44c5-b14f-aa36c9c52d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:59.720902 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 981/1971] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:30:59 2022] PUT /identity/v3/projects/72a750ed32dc41ae9a6be94a06be387b/users/1b72ace5a399440588b9f91c0a1ed9d0/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:30:59.720902 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb637e16-102b-4c5f-8823-56dd1b22a1fc admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:59.730241 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:30:59.792212 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 991/1972] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:59.792212 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f334c39-5c5a-4b79-9ab0-b4c03305b437 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:59.792212 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f334c39-5c5a-4b79-9ab0-b4c03305b437 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:59.792212 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f334c39-5c5a-4b79-9ab0-b4c03305b437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:59.816656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb637e16-102b-4c5f-8823-56dd1b22a1fc admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:59.822168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5f334c39-5c5a-4b79-9ab0-b4c03305b437 None None] MFA Rules not processed for user `1b72ace5a399440588b9f91c0a1ed9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:30:59.822408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a665ef2-6d2d-4445-9503-2786cc731ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:59.823000 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a665ef2-6d2d-4445-9503-2786cc731ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:59.823280 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a665ef2-6d2d-4445-9503-2786cc731ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:59.823554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a665ef2-6d2d-4445-9503-2786cc731ef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:59.824411 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a665ef2-6d2d-4445-9503-2786cc731ef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:59.824795 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5f334c39-5c5a-4b79-9ab0-b4c03305b437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:59.826370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a665ef2-6d2d-4445-9503-2786cc731ef1 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:59.858633 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 982/1973] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:30:59 2022] POST /identity/v3/projects => generated 367 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:30:59.860200 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a665ef2-6d2d-4445-9503-2786cc731ef1 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:59.948183 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a665ef2-6d2d-4445-9503-2786cc731ef1 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:30:59.954878 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 992/1974] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:30:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:30:59.955908 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f334c39-5c5a-4b79-9ab0-b4c03305b437 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:59.960863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b288d-da37-457a-8821-ca3ee88d2356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:30:59.961535 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b288d-da37-457a-8821-ca3ee88d2356 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:30:59.961827 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b288d-da37-457a-8821-ca3ee88d2356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:30:59.962099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b288d-da37-457a-8821-ca3ee88d2356 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:30:59.962838 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b288d-da37-457a-8821-ca3ee88d2356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:30:59.963147 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b288d-da37-457a-8821-ca3ee88d2356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:30:59.964985 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b288d-da37-457a-8821-ca3ee88d2356 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:30:59.986469 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 983/1975] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:30:59.993084 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b288d-da37-457a-8821-ca3ee88d2356 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:30:59.998154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-cd3b288d-da37-457a-8821-ca3ee88d2356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:30:59.999042 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f334c39-5c5a-4b79-9ab0-b4c03305b437 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:00.011402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c9a07-a4f1-4e9e-8744-ed647d76be57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:00.013957 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c9a07-a4f1-4e9e-8744-ed647d76be57 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:00.014250 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c9a07-a4f1-4e9e-8744-ed647d76be57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:00.014531 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c9a07-a4f1-4e9e-8744-ed647d76be57 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:00.017056 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c9a07-a4f1-4e9e-8744-ed647d76be57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:00.023607 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c9a07-a4f1-4e9e-8744-ed647d76be57 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:00.079664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 993/1976] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:30:59 2022] POST /identity/v3/users => generated 284 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:00.082092 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c9a07-a4f1-4e9e-8744-ed647d76be57 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:00.095067 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c9a07-a4f1-4e9e-8744-ed647d76be57 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:00.102330 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ade099-6d2c-4bee-9963-29a6be8131fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:00.103138 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ade099-6d2c-4bee-9963-29a6be8131fc admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:00.103485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ade099-6d2c-4bee-9963-29a6be8131fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:00.103882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ade099-6d2c-4bee-9963-29a6be8131fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:00.104582 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ade099-6d2c-4bee-9963-29a6be8131fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:00.106845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ade099-6d2c-4bee-9963-29a6be8131fc admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:00.128102 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b288d-da37-457a-8821-ca3ee88d2356 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:00.135487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26e9ac-1e8d-45d1-a140-2c73a2d68339 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:00.136165 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26e9ac-1e8d-45d1-a140-2c73a2d68339 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:00.136499 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26e9ac-1e8d-45d1-a140-2c73a2d68339 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:00.136780 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26e9ac-1e8d-45d1-a140-2c73a2d68339 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:00.155069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 994/1977] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:00 2022] POST /identity/v3/projects => generated 389 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:00.155069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ade099-6d2c-4bee-9963-29a6be8131fc admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:00.228518 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:00.232722 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:00.252479 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26e9ac-1e8d-45d1-a140-2c73a2d68339 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:00.252686 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ade099-6d2c-4bee-9963-29a6be8131fc admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:00.254285 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26e9ac-1e8d-45d1-a140-2c73a2d68339 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:00.257910 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681fb9a3-04f5-4df5-b879-8888e1bdab36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:00.258648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fb9a3-04f5-4df5-b879-8888e1bdab36 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:00.258928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fb9a3-04f5-4df5-b879-8888e1bdab36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:00.259278 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fb9a3-04f5-4df5-b879-8888e1bdab36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:00.259999 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681fb9a3-04f5-4df5-b879-8888e1bdab36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:00.261726 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681fb9a3-04f5-4df5-b879-8888e1bdab36 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:00.265591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 984/1978] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:30:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:00.266419 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26e9ac-1e8d-45d1-a140-2c73a2d68339 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:00.272306 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 995/1979] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:00.277108 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681fb9a3-04f5-4df5-b879-8888e1bdab36 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:00.278934 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26e9ac-1e8d-45d1-a140-2c73a2d68339 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:00.285331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d8e43-714d-430f-975a-c1d9f1328804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:00.285955 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d8e43-714d-430f-975a-c1d9f1328804 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:00.286242 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d8e43-714d-430f-975a-c1d9f1328804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:00.286523 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d8e43-714d-430f-975a-c1d9f1328804 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:00.287159 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d8e43-714d-430f-975a-c1d9f1328804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:00.289196 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681fb9a3-04f5-4df5-b879-8888e1bdab36 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:00.294507 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccaadf-1c36-4fec-96b1-3ec96bd2146a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:00.295062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccaadf-1c36-4fec-96b1-3ec96bd2146a admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:00.295358 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccaadf-1c36-4fec-96b1-3ec96bd2146a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:00.295713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ccaadf-1c36-4fec-96b1-3ec96bd2146a admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:00.296355 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccaadf-1c36-4fec-96b1-3ec96bd2146a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:00.297993 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ccaadf-1c36-4fec-96b1-3ec96bd2146a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:00.300532 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d8e43-714d-430f-975a-c1d9f1328804 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:00.309912 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 996/1980] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:00.314330 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccaadf-1c36-4fec-96b1-3ec96bd2146a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:00.326354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ccaadf-1c36-4fec-96b1-3ec96bd2146a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:00.332267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab70f4d-886e-45fc-bf1d-77687d578114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:00.333269 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab70f4d-886e-45fc-bf1d-77687d578114 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:00.333620 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab70f4d-886e-45fc-bf1d-77687d578114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:00.334389 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab70f4d-886e-45fc-bf1d-77687d578114 admin admin] PATH_INFO: `/v3/projects/41b782200ed64f99a225319d2bb14dc7/users/43bf989f9b5749f187afb7c814ff0ac6/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:00.338972 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 985/1981] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:00 2022] POST /identity/v3/users => generated 295 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:00.340176 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d8e43-714d-430f-975a-c1d9f1328804 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:00.356831 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab70f4d-886e-45fc-bf1d-77687d578114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41b782200ed64f99a225319d2bb14dc7, user_id=43bf989f9b5749f187afb7c814ff0ac6, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:00.361773 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab70f4d-886e-45fc-bf1d-77687d578114 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:00.363597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d8e43-714d-430f-975a-c1d9f1328804 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:00.370208 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c72cf9-c421-423f-b7b2-de7574532c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:00.370945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c72cf9-c421-423f-b7b2-de7574532c3a admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:00.371317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c72cf9-c421-423f-b7b2-de7574532c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:00.371558 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c72cf9-c421-423f-b7b2-de7574532c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:00.372466 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c72cf9-c421-423f-b7b2-de7574532c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:00.375558 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c72cf9-c421-423f-b7b2-de7574532c3a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:00.385090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 997/1982] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:00 2022] PUT /identity/v3/projects/41b782200ed64f99a225319d2bb14dc7/users/43bf989f9b5749f187afb7c814ff0ac6/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:31:00.394434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee52940-a474-4d7f-a73c-b03d9a89d1c1 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:00.394952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee52940-a474-4d7f-a73c-b03d9a89d1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:00.395137 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee52940-a474-4d7f-a73c-b03d9a89d1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:00.398951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 986/1983] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:00.402958 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c72cf9-c421-423f-b7b2-de7574532c3a admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:00.417084 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c72cf9-c421-423f-b7b2-de7574532c3a admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:00.430898 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5ee52940-a474-4d7f-a73c-b03d9a89d1c1 None None] MFA Rules not processed for user `43bf989f9b5749f187afb7c814ff0ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:00.432242 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5ee52940-a474-4d7f-a73c-b03d9a89d1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:00.504841 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba598452-53f7-4b37-a088-402a855778c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:00.505628 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba598452-53f7-4b37-a088-402a855778c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:00.506056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba598452-53f7-4b37-a088-402a855778c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:00.506341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba598452-53f7-4b37-a088-402a855778c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:00.507154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba598452-53f7-4b37-a088-402a855778c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:00.509123 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba598452-53f7-4b37-a088-402a855778c2 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:00.524352 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 987/1984] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:31:00.526433 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba598452-53f7-4b37-a088-402a855778c2 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:00.537656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 998/1985] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:31:00.543717 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee52940-a474-4d7f-a73c-b03d9a89d1c1 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:00.561503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba598452-53f7-4b37-a088-402a855778c2 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:00.566514 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc49979-8ca6-4749-a5bf-63baec7a4fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:00.566773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc49979-8ca6-4749-a5bf-63baec7a4fd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:00.567198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc49979-8ca6-4749-a5bf-63baec7a4fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:00.567672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc49979-8ca6-4749-a5bf-63baec7a4fd0 admin admin] PATH_INFO: `/v3/projects/c67790e8265149bf98d79a5f303da381/users/671c8d89bb1148b6a6a6668a9c7cc4f5/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:00.569473 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee52940-a474-4d7f-a73c-b03d9a89d1c1 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:00.583933 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc49979-8ca6-4749-a5bf-63baec7a4fd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c67790e8265149bf98d79a5f303da381, user_id=671c8d89bb1148b6a6a6668a9c7cc4f5, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:00.587713 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc49979-8ca6-4749-a5bf-63baec7a4fd0 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:00.588867 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0e2a4-81b9-484b-bae0-53a671fd00e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:00.589556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0e2a4-81b9-484b-bae0-53a671fd00e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:00.589846 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0e2a4-81b9-484b-bae0-53a671fd00e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:00.590256 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0e2a4-81b9-484b-bae0-53a671fd00e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:00.591861 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0e2a4-81b9-484b-bae0-53a671fd00e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:00.594328 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0e2a4-81b9-484b-bae0-53a671fd00e6 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:00.614569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 988/1986] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:00 2022] PUT /identity/v3/projects/c67790e8265149bf98d79a5f303da381/users/671c8d89bb1148b6a6a6668a9c7cc4f5/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:00.616613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8d408-2012-4c96-97db-4c75aa2fb315 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:00.616904 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8d408-2012-4c96-97db-4c75aa2fb315 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:00.617207 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8d408-2012-4c96-97db-4c75aa2fb315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:00.654000 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 999/1987] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:00 2022] POST /identity/v3/projects => generated 367 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:31:00.657997 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0e2a4-81b9-484b-bae0-53a671fd00e6 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:00.687935 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-0fe8d408-2012-4c96-97db-4c75aa2fb315 None None] MFA Rules not processed for user `671c8d89bb1148b6a6a6668a9c7cc4f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:00.690239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0fe8d408-2012-4c96-97db-4c75aa2fb315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:00.757804 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0e2a4-81b9-484b-bae0-53a671fd00e6 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:00.765509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad84f80-51c3-4537-adc5-2166499d925b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:00.766381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad84f80-51c3-4537-adc5-2166499d925b admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:00.766997 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad84f80-51c3-4537-adc5-2166499d925b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:00.767279 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad84f80-51c3-4537-adc5-2166499d925b admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:00.768211 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad84f80-51c3-4537-adc5-2166499d925b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:00.770585 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad84f80-51c3-4537-adc5-2166499d925b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:00.805113 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1000/1988] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:00 2022] POST /identity/v3/users => generated 290 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:00.807752 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad84f80-51c3-4537-adc5-2166499d925b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:00.808047 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 989/1989] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:31:00.812884 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8d408-2012-4c96-97db-4c75aa2fb315 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:00.824453 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad84f80-51c3-4537-adc5-2166499d925b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:00.826083 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:00.830640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb2765-0b11-46eb-8434-16fb2dc2e1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:00.831319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb2765-0b11-46eb-8434-16fb2dc2e1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:00.831622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb2765-0b11-46eb-8434-16fb2dc2e1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:00.831894 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb2765-0b11-46eb-8434-16fb2dc2e1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:00.832844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb2765-0b11-46eb-8434-16fb2dc2e1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:00.836173 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb2765-0b11-46eb-8434-16fb2dc2e1b4 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:00.836789 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8d408-2012-4c96-97db-4c75aa2fb315 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:00.839674 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:00.847056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f68fe-1d26-40a7-96c5-4158b8587261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:00.848196 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f68fe-1d26-40a7-96c5-4158b8587261 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:00.848196 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f68fe-1d26-40a7-96c5-4158b8587261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:00.848456 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f68fe-1d26-40a7-96c5-4158b8587261 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:00.849464 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f68fe-1d26-40a7-96c5-4158b8587261 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:00.852353 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f68fe-1d26-40a7-96c5-4158b8587261 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:00.858986 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1001/1990] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:00.860276 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb2765-0b11-46eb-8434-16fb2dc2e1b4 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:00.877044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb2765-0b11-46eb-8434-16fb2dc2e1b4 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:00.886555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91536d3-1300-4edb-89ee-e9f0083e70be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:00.887344 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91536d3-1300-4edb-89ee-e9f0083e70be admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:00.887666 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91536d3-1300-4edb-89ee-e9f0083e70be admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:00.887948 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91536d3-1300-4edb-89ee-e9f0083e70be admin admin] PATH_INFO: `/v3/projects/18a949c846e44ea5997013a1a973a5c4/users/0f8122a2172f4ed99d9e54cf966bb79e/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:00.902090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 990/1991] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:00 2022] POST /identity/v3/projects => generated 389 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:31:00.902949 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f68fe-1d26-40a7-96c5-4158b8587261 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:00.933805 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91536d3-1300-4edb-89ee-e9f0083e70be admin admin] RBAC: Authorizing `identity:create_grant(project_id=18a949c846e44ea5997013a1a973a5c4, user_id=0f8122a2172f4ed99d9e54cf966bb79e, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:00.936514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91536d3-1300-4edb-89ee-e9f0083e70be admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:00.987286 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1002/1992] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:00 2022] PUT /identity/v3/projects/18a949c846e44ea5997013a1a973a5c4/users/0f8122a2172f4ed99d9e54cf966bb79e/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:00.992602 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91536d3-1300-4edb-89ee-e9f0083e70be admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:01.018607 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f68fe-1d26-40a7-96c5-4158b8587261 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:01.101579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4f4c1-f190-43a3-96e8-48b4558664f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:01.102262 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4f4c1-f190-43a3-96e8-48b4558664f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:01.102548 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4f4c1-f190-43a3-96e8-48b4558664f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:01.102822 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4f4c1-f190-43a3-96e8-48b4558664f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:01.104898 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-03d4f4c1-f190-43a3-96e8-48b4558664f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:01.155483 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91536d3-1300-4edb-89ee-e9f0083e70be admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:01.167110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3120e-e640-4846-86de-1c878956ef70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:01.180510 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3120e-e640-4846-86de-1c878956ef70 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:01.180906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3120e-e640-4846-86de-1c878956ef70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:01.181260 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3120e-e640-4846-86de-1c878956ef70 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:01.181939 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3120e-e640-4846-86de-1c878956ef70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:01.184149 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3120e-e640-4846-86de-1c878956ef70 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:01.191390 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4f4c1-f190-43a3-96e8-48b4558664f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:01.193168 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4f4c1-f190-43a3-96e8-48b4558664f3 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:01.210903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 991/1993] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:01.212775 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4f4c1-f190-43a3-96e8-48b4558664f3 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:01.226047 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4f4c1-f190-43a3-96e8-48b4558664f3 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:01.233341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef490c35-2b88-4113-8efd-c3b94bdc38e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:01.234291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef490c35-2b88-4113-8efd-c3b94bdc38e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:01.234610 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef490c35-2b88-4113-8efd-c3b94bdc38e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:01.234995 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef490c35-2b88-4113-8efd-c3b94bdc38e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:01.235638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef490c35-2b88-4113-8efd-c3b94bdc38e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:01.239628 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef490c35-2b88-4113-8efd-c3b94bdc38e9 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:01.259436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 992/1994] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:01.260194 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1003/1995] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:00 2022] POST /identity/v3/users => generated 301 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:01.261042 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef490c35-2b88-4113-8efd-c3b94bdc38e9 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:01.261170 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3120e-e640-4846-86de-1c878956ef70 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:01.274260 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef490c35-2b88-4113-8efd-c3b94bdc38e9 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:01.280259 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf4d94-2dcc-4ebf-aef1-821d216b971e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:01.281372 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf4d94-2dcc-4ebf-aef1-821d216b971e admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:01.281857 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf4d94-2dcc-4ebf-aef1-821d216b971e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:01.282284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf4d94-2dcc-4ebf-aef1-821d216b971e admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:01.283097 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf4d94-2dcc-4ebf-aef1-821d216b971e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:01.285155 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf4d94-2dcc-4ebf-aef1-821d216b971e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:01.298207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3120e-e640-4846-86de-1c878956ef70 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:01.301473 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 993/1996] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:01.306626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf4d94-2dcc-4ebf-aef1-821d216b971e admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:01.319001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf4d94-2dcc-4ebf-aef1-821d216b971e admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:01.325974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef03e96-d84a-4151-afd8-9015dfedb19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:01.326654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef03e96-d84a-4151-afd8-9015dfedb19d admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:01.326928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef03e96-d84a-4151-afd8-9015dfedb19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:01.327337 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef03e96-d84a-4151-afd8-9015dfedb19d admin admin] PATH_INFO: `/v3/projects/18a949c846e44ea5997013a1a973a5c4/users/0f8122a2172f4ed99d9e54cf966bb79e/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:01.327669 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63474246-608e-4e51-a71f-f2f3a7a131c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:01.328620 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63474246-608e-4e51-a71f-f2f3a7a131c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:01.329105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63474246-608e-4e51-a71f-f2f3a7a131c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:01.329544 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63474246-608e-4e51-a71f-f2f3a7a131c0 admin admin] PATH_INFO: `/v3/projects/930a9629b5a946b8817b7fe3104fb6af/users/e24aa678b267435fa0d87b3b70c0d925/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:01.334704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef03e96-d84a-4151-afd8-9015dfedb19d admin admin] RBAC: Authorizing `identity:create_grant(project_id=18a949c846e44ea5997013a1a973a5c4, user_id=0f8122a2172f4ed99d9e54cf966bb79e, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:01.337599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef03e96-d84a-4151-afd8-9015dfedb19d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:01.371978 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63474246-608e-4e51-a71f-f2f3a7a131c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=930a9629b5a946b8817b7fe3104fb6af, user_id=e24aa678b267435fa0d87b3b70c0d925, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:01.374928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1004/1997] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:01 2022] PUT /identity/v3/projects/18a949c846e44ea5997013a1a973a5c4/users/0f8122a2172f4ed99d9e54cf966bb79e/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:01.376633 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55e434-25ff-4cfc-a510-92e321b95b43 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:01.377207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55e434-25ff-4cfc-a510-92e321b95b43 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:01.377666 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55e434-25ff-4cfc-a510-92e321b95b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:01.379185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63474246-608e-4e51-a71f-f2f3a7a131c0 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:01.413764 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-db55e434-25ff-4cfc-a510-92e321b95b43 None None] MFA Rules not processed for user `0f8122a2172f4ed99d9e54cf966bb79e`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:01.415093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-db55e434-25ff-4cfc-a510-92e321b95b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:01.415979 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 994/1998] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:01 2022] PUT /identity/v3/projects/930a9629b5a946b8817b7fe3104fb6af/users/e24aa678b267435fa0d87b3b70c0d925/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:01.420580 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63474246-608e-4e51-a71f-f2f3a7a131c0 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:01.460824 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:01.582853 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1005/1999] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:01.597578 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55e434-25ff-4cfc-a510-92e321b95b43 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:01.599506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-db55e434-25ff-4cfc-a510-92e321b95b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:01.636451 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63474246-608e-4e51-a71f-f2f3a7a131c0 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:01.649850 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e9fc0-ecc0-4dcf-8f64-0df3ed7bf39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:01.651716 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e9fc0-ecc0-4dcf-8f64-0df3ed7bf39a admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:01.652001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e9fc0-ecc0-4dcf-8f64-0df3ed7bf39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:01.652729 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e9fc0-ecc0-4dcf-8f64-0df3ed7bf39a admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:01.653808 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e9fc0-ecc0-4dcf-8f64-0df3ed7bf39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:01.662656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e9fc0-ecc0-4dcf-8f64-0df3ed7bf39a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:01.681064 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:01.702897 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 995/2000] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:01.704055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e9fc0-ecc0-4dcf-8f64-0df3ed7bf39a admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:01.730607 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e9fc0-ecc0-4dcf-8f64-0df3ed7bf39a admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:01.736905 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55e434-25ff-4cfc-a510-92e321b95b43 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:01.744772 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f7111-1f3e-44e5-9e45-0d1556942ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:01.745499 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f7111-1f3e-44e5-9e45-0d1556942ce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:01.745780 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f7111-1f3e-44e5-9e45-0d1556942ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:01.746051 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f7111-1f3e-44e5-9e45-0d1556942ce9 admin admin] PATH_INFO: `/v3/projects/930a9629b5a946b8817b7fe3104fb6af/users/e24aa678b267435fa0d87b3b70c0d925/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:01.746705 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90c2b0-ef67-453f-aead-b00648a00a99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:01.747347 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90c2b0-ef67-453f-aead-b00648a00a99 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:01.747775 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90c2b0-ef67-453f-aead-b00648a00a99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:01.748099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90c2b0-ef67-453f-aead-b00648a00a99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:01.753151 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f7111-1f3e-44e5-9e45-0d1556942ce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=930a9629b5a946b8817b7fe3104fb6af, user_id=e24aa678b267435fa0d87b3b70c0d925, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:01.764896 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f7111-1f3e-44e5-9e45-0d1556942ce9 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:01.778857 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90c2b0-ef67-453f-aead-b00648a00a99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:01.780477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90c2b0-ef67-453f-aead-b00648a00a99 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:01.800564 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1006/2001] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:01.830023 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 996/2002] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:01 2022] PUT /identity/v3/projects/930a9629b5a946b8817b7fe3104fb6af/users/e24aa678b267435fa0d87b3b70c0d925/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:01.831049 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e997d8-9f1e-43ba-b492-e52bfd50c02f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:01.831626 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e997d8-9f1e-43ba-b492-e52bfd50c02f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:01.831626 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e997d8-9f1e-43ba-b492-e52bfd50c02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:01.893294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-44e997d8-9f1e-43ba-b492-e52bfd50c02f None None] MFA Rules not processed for user `e24aa678b267435fa0d87b3b70c0d925`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:01.899100 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-44e997d8-9f1e-43ba-b492-e52bfd50c02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:01.939150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f7111-1f3e-44e5-9e45-0d1556942ce9 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:02.046071 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f7111-1f3e-44e5-9e45-0d1556942ce9 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:02.052783 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54da20-f094-48e7-9cd0-ec8cafa56db5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:02.053466 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54da20-f094-48e7-9cd0-ec8cafa56db5 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:02.054106 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54da20-f094-48e7-9cd0-ec8cafa56db5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:02.054392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54da20-f094-48e7-9cd0-ec8cafa56db5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:02.066591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1007/2003] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:01 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:02.077495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e997d8-9f1e-43ba-b492-e52bfd50c02f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:02.093151 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e997d8-9f1e-43ba-b492-e52bfd50c02f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:02.102888 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d66a7-ae69-4d22-8733-4b0493ab4ea5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:02.103966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d66a7-ae69-4d22-8733-4b0493ab4ea5 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:02.104433 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d66a7-ae69-4d22-8733-4b0493ab4ea5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:02.104889 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d66a7-ae69-4d22-8733-4b0493ab4ea5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:02.127954 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d66a7-ae69-4d22-8733-4b0493ab4ea5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:02.130136 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d66a7-ae69-4d22-8733-4b0493ab4ea5 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:02.135172 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54da20-f094-48e7-9cd0-ec8cafa56db5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:02.137963 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54da20-f094-48e7-9cd0-ec8cafa56db5 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:02.152873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1008/2005] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:02 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:31:02.153345 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 997/2005] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:31:02.997061 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d66a7-ae69-4d22-8733-4b0493ab4ea5 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:03.109642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d66a7-ae69-4d22-8733-4b0493ab4ea5 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:03.114776 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a4642-4528-45bb-bc0a-edb4aa3c3aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:03.115575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a4642-4528-45bb-bc0a-edb4aa3c3aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:03.115684 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a4642-4528-45bb-bc0a-edb4aa3c3aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:03.116029 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a4642-4528-45bb-bc0a-edb4aa3c3aa8 admin admin] PATH_INFO: `/v3/users/671c8d89bb1148b6a6a6668a9c7cc4f5` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:03.117831 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a4642-4528-45bb-bc0a-edb4aa3c3aa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=671c8d89bb1148b6a6a6668a9c7cc4f5)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:03.120527 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a4642-4528-45bb-bc0a-edb4aa3c3aa8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:03.208507 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cd4a4642-4528-45bb-bc0a-edb4aa3c3aa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '671c8d89bb1148b6a6a6668a9c7cc4f5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:03.226913 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:03.234460 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cd4a4642-4528-45bb-bc0a-edb4aa3c3aa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '671c8d89bb1148b6a6a6668a9c7cc4f5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:03.235419 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cd4a4642-4528-45bb-bc0a-edb4aa3c3aa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '671c8d89bb1148b6a6a6668a9c7cc4f5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:03.256881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cd4a4642-4528-45bb-bc0a-edb4aa3c3aa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '671c8d89bb1148b6a6a6668a9c7cc4f5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:03.267203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cd4a4642-4528-45bb-bc0a-edb4aa3c3aa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '671c8d89bb1148b6a6a6668a9c7cc4f5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:03.275902 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1009/2006] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:02 2022] DELETE /identity/v3/users/671c8d89bb1148b6a6a6668a9c7cc4f5 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:03.280543 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e01824-c68b-4539-8ef3-fe4e41eaaf75 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:03.281072 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e01824-c68b-4539-8ef3-fe4e41eaaf75 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:03.281158 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e01824-c68b-4539-8ef3-fe4e41eaaf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:03.310019 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-24e01824-c68b-4539-8ef3-fe4e41eaaf75 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:03.311309 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-24e01824-c68b-4539-8ef3-fe4e41eaaf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:03.323683 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a4642-4528-45bb-bc0a-edb4aa3c3aa8 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:03.325223 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cd4a4642-4528-45bb-bc0a-edb4aa3c3aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:03.360721 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:03.384426 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 998/2007] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:03.394372 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e01824-c68b-4539-8ef3-fe4e41eaaf75 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:03.395779 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-24e01824-c68b-4539-8ef3-fe4e41eaaf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:03.409275 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a4642-4528-45bb-bc0a-edb4aa3c3aa8 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:03.417106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0cb587-6dbc-4b00-abbe-d379b3cb1a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:03.418188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cb587-6dbc-4b00-abbe-d379b3cb1a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:03.418188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cb587-6dbc-4b00-abbe-d379b3cb1a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:03.418839 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0cb587-6dbc-4b00-abbe-d379b3cb1a49 admin admin] PATH_INFO: `/v3/users/73335f27406547629ec3135c96aa52fc` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:03.420119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0cb587-6dbc-4b00-abbe-d379b3cb1a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73335f27406547629ec3135c96aa52fc)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:03.422457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0cb587-6dbc-4b00-abbe-d379b3cb1a49 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:03.473650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e01824-c68b-4539-8ef3-fe4e41eaaf75 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:03.476904 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cb0cb587-6dbc-4b00-abbe-d379b3cb1a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73335f27406547629ec3135c96aa52fc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:03.480780 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0212e1-ee9c-4983-94a9-f0cd35e8d909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:03.481890 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0212e1-ee9c-4983-94a9-f0cd35e8d909 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:03.482414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0212e1-ee9c-4983-94a9-f0cd35e8d909 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:03.482710 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0212e1-ee9c-4983-94a9-f0cd35e8d909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:03.487073 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cb0cb587-6dbc-4b00-abbe-d379b3cb1a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73335f27406547629ec3135c96aa52fc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:03.487809 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cb0cb587-6dbc-4b00-abbe-d379b3cb1a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73335f27406547629ec3135c96aa52fc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:03.496312 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0212e1-ee9c-4983-94a9-f0cd35e8d909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:03.498166 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0212e1-ee9c-4983-94a9-f0cd35e8d909 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:03.506414 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cb0cb587-6dbc-4b00-abbe-d379b3cb1a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73335f27406547629ec3135c96aa52fc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:03.510072 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 999/2008] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:31:03.514723 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cb0cb587-6dbc-4b00-abbe-d379b3cb1a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73335f27406547629ec3135c96aa52fc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:03.521620 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1010/2009] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:03 2022] DELETE /identity/v3/users/73335f27406547629ec3135c96aa52fc => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:31:03.526580 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337db0b0-95b3-4631-b015-9db5a3719d5c None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:03.526872 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337db0b0-95b3-4631-b015-9db5a3719d5c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:03.527163 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337db0b0-95b3-4631-b015-9db5a3719d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:03.547580 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-337db0b0-95b3-4631-b015-9db5a3719d5c None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:03.549432 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-337db0b0-95b3-4631-b015-9db5a3719d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:03.635093 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1000/2010] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:03.641601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0cb587-6dbc-4b00-abbe-d379b3cb1a49 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:03.643025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cb0cb587-6dbc-4b00-abbe-d379b3cb1a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:03.725000 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:03.731173 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0cb587-6dbc-4b00-abbe-d379b3cb1a49 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:03.736927 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099740a7-e630-4d6c-8a92-66a15cdfbe44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:03.737839 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099740a7-e630-4d6c-8a92-66a15cdfbe44 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:03.738294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099740a7-e630-4d6c-8a92-66a15cdfbe44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:03.738727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099740a7-e630-4d6c-8a92-66a15cdfbe44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:03.748456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099740a7-e630-4d6c-8a92-66a15cdfbe44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:03.750149 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099740a7-e630-4d6c-8a92-66a15cdfbe44 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:03.763468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1011/2011] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:04.270071 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337db0b0-95b3-4631-b015-9db5a3719d5c None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:04.271536 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-337db0b0-95b3-4631-b015-9db5a3719d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:04.292598 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099740a7-e630-4d6c-8a92-66a15cdfbe44 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:04.294275 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-099740a7-e630-4d6c-8a92-66a15cdfbe44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:04.297336 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337db0b0-95b3-4631-b015-9db5a3719d5c None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:04.315077 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25678f8-abcb-43c3-b2e0-b4a75c3955e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:04.315742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25678f8-abcb-43c3-b2e0-b4a75c3955e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:04.316183 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25678f8-abcb-43c3-b2e0-b4a75c3955e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:04.316599 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25678f8-abcb-43c3-b2e0-b4a75c3955e8 admin admin] PATH_INFO: `/v3/users/e8d2af85238f4e70be3b061caba850b9` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:04.320603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25678f8-abcb-43c3-b2e0-b4a75c3955e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8d2af85238f4e70be3b061caba850b9)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:04.321843 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099740a7-e630-4d6c-8a92-66a15cdfbe44 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:04.326142 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25678f8-abcb-43c3-b2e0-b4a75c3955e8 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:04.336133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73df82-24d2-4549-b90d-7ff46352fce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:04.337050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73df82-24d2-4549-b90d-7ff46352fce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:04.338961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73df82-24d2-4549-b90d-7ff46352fce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:04.341489 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73df82-24d2-4549-b90d-7ff46352fce3 admin admin] PATH_INFO: `/v3/projects/c67790e8265149bf98d79a5f303da381` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:04.347280 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73df82-24d2-4549-b90d-7ff46352fce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c67790e8265149bf98d79a5f303da381)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:04.355550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73df82-24d2-4549-b90d-7ff46352fce3 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:04.445688 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f25678f8-abcb-43c3-b2e0-b4a75c3955e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8d2af85238f4e70be3b061caba850b9'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:04.470852 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f25678f8-abcb-43c3-b2e0-b4a75c3955e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8d2af85238f4e70be3b061caba850b9'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:04.494056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f25678f8-abcb-43c3-b2e0-b4a75c3955e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8d2af85238f4e70be3b061caba850b9'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:04.494829 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f25678f8-abcb-43c3-b2e0-b4a75c3955e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8d2af85238f4e70be3b061caba850b9'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:04.502906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cb73df82-24d2-4549-b90d-7ff46352fce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c67790e8265149bf98d79a5f303da381', 'request_id': 'req-cb73df82-24d2-4549-b90d-7ff46352fce3'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:04.523295 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cb73df82-24d2-4549-b90d-7ff46352fce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c67790e8265149bf98d79a5f303da381', 'request_id': 'req-cb73df82-24d2-4549-b90d-7ff46352fce3'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:04.530763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f25678f8-abcb-43c3-b2e0-b4a75c3955e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8d2af85238f4e70be3b061caba850b9'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:04.538981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:04.544854 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cb73df82-24d2-4549-b90d-7ff46352fce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c67790e8265149bf98d79a5f303da381', 'request_id': 'req-cb73df82-24d2-4549-b90d-7ff46352fce3'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:04.558790 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1001/2012] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:04 2022] DELETE /identity/v3/users/e8d2af85238f4e70be3b061caba850b9 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:04.558790 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25678f8-abcb-43c3-b2e0-b4a75c3955e8 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:04.559612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f25678f8-abcb-43c3-b2e0-b4a75c3955e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:04.572134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cb73df82-24d2-4549-b90d-7ff46352fce3 admin admin] The token cache is being invalidate because project c67790e8265149bf98d79a5f303da381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:04.572432 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cb73df82-24d2-4549-b90d-7ff46352fce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:04.574961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cb73df82-24d2-4549-b90d-7ff46352fce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:04.578962 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1012/2013] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:04 2022] DELETE /identity/v3/projects/c67790e8265149bf98d79a5f303da381 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:04.580949 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e1373-7b14-494e-81c8-637494be24ee None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:04.585509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e1373-7b14-494e-81c8-637494be24ee None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:04.586955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e1373-7b14-494e-81c8-637494be24ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:04.640766 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-437e1373-7b14-494e-81c8-637494be24ee None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:04.641941 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-437e1373-7b14-494e-81c8-637494be24ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:04.737051 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25678f8-abcb-43c3-b2e0-b4a75c3955e8 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:04.758719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa7a0d-4da1-4cb0-9fc9-778429b23d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:04.759517 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa7a0d-4da1-4cb0-9fc9-778429b23d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:04.759822 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa7a0d-4da1-4cb0-9fc9-778429b23d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:04.760060 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa7a0d-4da1-4cb0-9fc9-778429b23d03 admin admin] PATH_INFO: `/v3/projects/a2022154a846444cbd3ef356be7a8ece` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:04.761475 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa7a0d-4da1-4cb0-9fc9-778429b23d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2022154a846444cbd3ef356be7a8ece)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:04.766219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa7a0d-4da1-4cb0-9fc9-778429b23d03 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:04.798433 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1013/2014] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:04.798433 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e1373-7b14-494e-81c8-637494be24ee None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:04.798433 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-437e1373-7b14-494e-81c8-637494be24ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:04.812078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e1373-7b14-494e-81c8-637494be24ee None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:04.820531 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50e64d-bad6-4aad-973e-d8b97b3fe8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:04.821470 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50e64d-bad6-4aad-973e-d8b97b3fe8a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:04.821947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50e64d-bad6-4aad-973e-d8b97b3fe8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:04.822433 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50e64d-bad6-4aad-973e-d8b97b3fe8a9 admin admin] PATH_INFO: `/v3/users/e24aa678b267435fa0d87b3b70c0d925` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:04.824383 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50e64d-bad6-4aad-973e-d8b97b3fe8a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e24aa678b267435fa0d87b3b70c0d925)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:04.829549 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50e64d-bad6-4aad-973e-d8b97b3fe8a9 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:04.880098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-fffa7a0d-4da1-4cb0-9fc9-778429b23d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2022154a846444cbd3ef356be7a8ece', 'request_id': 'req-fffa7a0d-4da1-4cb0-9fc9-778429b23d03'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:04.895728 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-fffa7a0d-4da1-4cb0-9fc9-778429b23d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2022154a846444cbd3ef356be7a8ece', 'request_id': 'req-fffa7a0d-4da1-4cb0-9fc9-778429b23d03'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:04.933552 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-fffa7a0d-4da1-4cb0-9fc9-778429b23d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2022154a846444cbd3ef356be7a8ece', 'request_id': 'req-fffa7a0d-4da1-4cb0-9fc9-778429b23d03'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:04.955641 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4e50e64d-bad6-4aad-973e-d8b97b3fe8a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e24aa678b267435fa0d87b3b70c0d925'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:04.982196 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4e50e64d-bad6-4aad-973e-d8b97b3fe8a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e24aa678b267435fa0d87b3b70c0d925'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:04.984563 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4e50e64d-bad6-4aad-973e-d8b97b3fe8a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e24aa678b267435fa0d87b3b70c0d925'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:04.991014 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-fffa7a0d-4da1-4cb0-9fc9-778429b23d03 admin admin] The token cache is being invalidate because project a2022154a846444cbd3ef356be7a8ece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:04.991614 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-fffa7a0d-4da1-4cb0-9fc9-778429b23d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:04.993616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-fffa7a0d-4da1-4cb0-9fc9-778429b23d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:05.001114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1002/2015] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:04 2022] DELETE /identity/v3/projects/a2022154a846444cbd3ef356be7a8ece => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:05.002513 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa7a0d-4da1-4cb0-9fc9-778429b23d03 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:05.010290 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-fffa7a0d-4da1-4cb0-9fc9-778429b23d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:05.029293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:05.035052 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4e50e64d-bad6-4aad-973e-d8b97b3fe8a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e24aa678b267435fa0d87b3b70c0d925'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:05.055566 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4e50e64d-bad6-4aad-973e-d8b97b3fe8a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e24aa678b267435fa0d87b3b70c0d925'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:05.084697 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1014/2016] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:04 2022] DELETE /identity/v3/users/e24aa678b267435fa0d87b3b70c0d925 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:05.089675 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50e64d-bad6-4aad-973e-d8b97b3fe8a9 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:05.095477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4e50e64d-bad6-4aad-973e-d8b97b3fe8a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:05.112531 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa7a0d-4da1-4cb0-9fc9-778429b23d03 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:05.162801 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:05.170890 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd1ce9-651a-43e6-9bc1-e3d955f85205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:05.171532 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd1ce9-651a-43e6-9bc1-e3d955f85205 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:05.171979 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd1ce9-651a-43e6-9bc1-e3d955f85205 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:05.172115 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd1ce9-651a-43e6-9bc1-e3d955f85205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:05.174099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-89cd1ce9-651a-43e6-9bc1-e3d955f85205 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:05.249996 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd1ce9-651a-43e6-9bc1-e3d955f85205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:05.252063 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd1ce9-651a-43e6-9bc1-e3d955f85205 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:05.264954 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1003/2017] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:05.289890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50e64d-bad6-4aad-973e-d8b97b3fe8a9 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:05.298304 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5da49-b2c9-4d72-a9a4-c4c60a00da09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:05.299755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5da49-b2c9-4d72-a9a4-c4c60a00da09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:05.300188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5da49-b2c9-4d72-a9a4-c4c60a00da09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:05.300602 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5da49-b2c9-4d72-a9a4-c4c60a00da09 admin admin] PATH_INFO: `/v3/users/ead2e7dac1fb4c299b540158cfea6067` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:05.302916 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5da49-b2c9-4d72-a9a4-c4c60a00da09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ead2e7dac1fb4c299b540158cfea6067)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:05.305839 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5da49-b2c9-4d72-a9a4-c4c60a00da09 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:05.385115 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-efa5da49-b2c9-4d72-a9a4-c4c60a00da09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ead2e7dac1fb4c299b540158cfea6067'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:05.412994 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-efa5da49-b2c9-4d72-a9a4-c4c60a00da09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ead2e7dac1fb4c299b540158cfea6067'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:05.414313 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-efa5da49-b2c9-4d72-a9a4-c4c60a00da09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ead2e7dac1fb4c299b540158cfea6067'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:05.446395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-efa5da49-b2c9-4d72-a9a4-c4c60a00da09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ead2e7dac1fb4c299b540158cfea6067'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:05.467846 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-efa5da49-b2c9-4d72-a9a4-c4c60a00da09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ead2e7dac1fb4c299b540158cfea6067'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:05.477818 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1015/2018] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:05 2022] DELETE /identity/v3/users/ead2e7dac1fb4c299b540158cfea6067 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:05.924928 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd1ce9-651a-43e6-9bc1-e3d955f85205 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:05.927391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-89cd1ce9-651a-43e6-9bc1-e3d955f85205 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:05.952039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd1ce9-651a-43e6-9bc1-e3d955f85205 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:06.105899 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca9722-affa-438b-8bfd-11797651af79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:06.106566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca9722-affa-438b-8bfd-11797651af79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:06.106938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca9722-affa-438b-8bfd-11797651af79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:06.107116 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca9722-affa-438b-8bfd-11797651af79 admin admin] PATH_INFO: `/v3/projects/d011b9d961134d7999b8e8bb754bba19` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:06.108717 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca9722-affa-438b-8bfd-11797651af79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d011b9d961134d7999b8e8bb754bba19)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:06.110946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca9722-affa-438b-8bfd-11797651af79 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:06.229372 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-3cca9722-affa-438b-8bfd-11797651af79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd011b9d961134d7999b8e8bb754bba19', 'request_id': 'req-3cca9722-affa-438b-8bfd-11797651af79'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:06.238029 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-3cca9722-affa-438b-8bfd-11797651af79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd011b9d961134d7999b8e8bb754bba19', 'request_id': 'req-3cca9722-affa-438b-8bfd-11797651af79'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:06.253908 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-3cca9722-affa-438b-8bfd-11797651af79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd011b9d961134d7999b8e8bb754bba19', 'request_id': 'req-3cca9722-affa-438b-8bfd-11797651af79'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:06.271920 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-3cca9722-affa-438b-8bfd-11797651af79 admin admin] The token cache is being invalidate because project d011b9d961134d7999b8e8bb754bba19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:06.272309 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-3cca9722-affa-438b-8bfd-11797651af79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:06.273534 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-3cca9722-affa-438b-8bfd-11797651af79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:06.275276 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1004/2019] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:05 2022] DELETE /identity/v3/projects/d011b9d961134d7999b8e8bb754bba19 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:06.279606 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5da49-b2c9-4d72-a9a4-c4c60a00da09 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:06.281849 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-efa5da49-b2c9-4d72-a9a4-c4c60a00da09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:06.293719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca9722-affa-438b-8bfd-11797651af79 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:06.299485 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3cca9722-affa-438b-8bfd-11797651af79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:06.325436 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5da49-b2c9-4d72-a9a4-c4c60a00da09 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:06.372256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:06.431141 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca9722-affa-438b-8bfd-11797651af79 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:06.436905 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e335e-bf14-4121-acb8-beaaa7a819c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:06.437697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e335e-bf14-4121-acb8-beaaa7a819c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:06.438620 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e335e-bf14-4121-acb8-beaaa7a819c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:06.439064 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e335e-bf14-4121-acb8-beaaa7a819c1 admin admin] PATH_INFO: `/v3/projects/930a9629b5a946b8817b7fe3104fb6af` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:06.440842 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e335e-bf14-4121-acb8-beaaa7a819c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=930a9629b5a946b8817b7fe3104fb6af)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:06.443262 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e335e-bf14-4121-acb8-beaaa7a819c1 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:06.459153 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b29f4-4154-42d9-883a-91a02836f832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:06.460326 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b29f4-4154-42d9-883a-91a02836f832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:06.460612 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b29f4-4154-42d9-883a-91a02836f832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:06.460891 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b29f4-4154-42d9-883a-91a02836f832 admin admin] PATH_INFO: `/v3/users/e6a6558ca1734aaca6c9cfa5be287564` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:06.462628 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b29f4-4154-42d9-883a-91a02836f832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6a6558ca1734aaca6c9cfa5be287564)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:06.464689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b29f4-4154-42d9-883a-91a02836f832 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:06.477167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:06.522193 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-a14e335e-bf14-4121-acb8-beaaa7a819c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '930a9629b5a946b8817b7fe3104fb6af', 'request_id': 'req-a14e335e-bf14-4121-acb8-beaaa7a819c1'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:06.533256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-a14e335e-bf14-4121-acb8-beaaa7a819c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '930a9629b5a946b8817b7fe3104fb6af', 'request_id': 'req-a14e335e-bf14-4121-acb8-beaaa7a819c1'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:06.542997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-a14e335e-bf14-4121-acb8-beaaa7a819c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '930a9629b5a946b8817b7fe3104fb6af', 'request_id': 'req-a14e335e-bf14-4121-acb8-beaaa7a819c1'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:06.555250 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-db6b29f4-4154-42d9-883a-91a02836f832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6a6558ca1734aaca6c9cfa5be287564'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:06.558904 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-a14e335e-bf14-4121-acb8-beaaa7a819c1 admin admin] The token cache is being invalidate because project 930a9629b5a946b8817b7fe3104fb6af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:06.559815 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-a14e335e-bf14-4121-acb8-beaaa7a819c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:06.560538 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-a14e335e-bf14-4121-acb8-beaaa7a819c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:06.562794 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1005/2020] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:06 2022] DELETE /identity/v3/projects/930a9629b5a946b8817b7fe3104fb6af => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:06.563135 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e335e-bf14-4121-acb8-beaaa7a819c1 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:06.564824 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a14e335e-bf14-4121-acb8-beaaa7a819c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:06.569621 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-db6b29f4-4154-42d9-883a-91a02836f832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6a6558ca1734aaca6c9cfa5be287564'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:06.570656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-db6b29f4-4154-42d9-883a-91a02836f832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6a6558ca1734aaca6c9cfa5be287564'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:06.600010 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-db6b29f4-4154-42d9-883a-91a02836f832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6a6558ca1734aaca6c9cfa5be287564'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:06.612561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-db6b29f4-4154-42d9-883a-91a02836f832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6a6558ca1734aaca6c9cfa5be287564'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:06.620168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1016/2021] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:06 2022] DELETE /identity/v3/users/e6a6558ca1734aaca6c9cfa5be287564 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:06.621718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058617a-35d4-4cf3-94ce-73993bb6edbd None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:06.622151 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058617a-35d4-4cf3-94ce-73993bb6edbd None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:06.622428 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058617a-35d4-4cf3-94ce-73993bb6edbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:06.648539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a058617a-35d4-4cf3-94ce-73993bb6edbd None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:06.649807 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a058617a-35d4-4cf3-94ce-73993bb6edbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:06.653066 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e335e-bf14-4121-acb8-beaaa7a819c1 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:06.750548 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1017/2022] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:06.751296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebfd74-9126-4ed1-ab08-a3d82f1091ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:06.751825 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebfd74-9126-4ed1-ab08-a3d82f1091ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:06.752115 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebfd74-9126-4ed1-ab08-a3d82f1091ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:06.752391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebfd74-9126-4ed1-ab08-a3d82f1091ff admin admin] PATH_INFO: `/v3/projects/3dea4e8658d2403e854c1f46e6d04319` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:06.754652 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebfd74-9126-4ed1-ab08-a3d82f1091ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dea4e8658d2403e854c1f46e6d04319)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:06.758544 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aab95e-e19d-41d9-a1eb-ac0f4317cfb7 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:06.759073 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aab95e-e19d-41d9-a1eb-ac0f4317cfb7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:06.759443 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aab95e-e19d-41d9-a1eb-ac0f4317cfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:06.760220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebfd74-9126-4ed1-ab08-a3d82f1091ff admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:06.768563 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:06.802010 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-41aab95e-e19d-41d9-a1eb-ac0f4317cfb7 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:06.802369 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-41aab95e-e19d-41d9-a1eb-ac0f4317cfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:06.831435 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1018/2023] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:31:06.832960 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aab95e-e19d-41d9-a1eb-ac0f4317cfb7 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:06.849736 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aab95e-e19d-41d9-a1eb-ac0f4317cfb7 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:06.875437 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-72ebfd74-9126-4ed1-ab08-a3d82f1091ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dea4e8658d2403e854c1f46e6d04319', 'request_id': 'req-72ebfd74-9126-4ed1-ab08-a3d82f1091ff'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:06.893746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-72ebfd74-9126-4ed1-ab08-a3d82f1091ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dea4e8658d2403e854c1f46e6d04319', 'request_id': 'req-72ebfd74-9126-4ed1-ab08-a3d82f1091ff'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:06.914123 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-72ebfd74-9126-4ed1-ab08-a3d82f1091ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dea4e8658d2403e854c1f46e6d04319', 'request_id': 'req-72ebfd74-9126-4ed1-ab08-a3d82f1091ff'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:06.943711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-72ebfd74-9126-4ed1-ab08-a3d82f1091ff admin admin] The token cache is being invalidate because project 3dea4e8658d2403e854c1f46e6d04319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:06.946086 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baad1ee-d3d3-4721-b679-c4dafaf321e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:06.946708 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-72ebfd74-9126-4ed1-ab08-a3d82f1091ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:06.946826 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baad1ee-d3d3-4721-b679-c4dafaf321e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:06.947005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baad1ee-d3d3-4721-b679-c4dafaf321e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:06.947283 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baad1ee-d3d3-4721-b679-c4dafaf321e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:06.947959 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baad1ee-d3d3-4721-b679-c4dafaf321e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:31:06.948241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baad1ee-d3d3-4721-b679-c4dafaf321e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:06.948547 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-72ebfd74-9126-4ed1-ab08-a3d82f1091ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:06.949894 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baad1ee-d3d3-4721-b679-c4dafaf321e6 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:06.953939 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1006/2024] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:06 2022] DELETE /identity/v3/projects/3dea4e8658d2403e854c1f46e6d04319 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:06.955676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebfd74-9126-4ed1-ab08-a3d82f1091ff admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:06.961761 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-72ebfd74-9126-4ed1-ab08-a3d82f1091ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:06.969367 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1019/2025] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:31:06.972875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baad1ee-d3d3-4721-b679-c4dafaf321e6 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:06.975273 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7baad1ee-d3d3-4721-b679-c4dafaf321e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:06.993215 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baad1ee-d3d3-4721-b679-c4dafaf321e6 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:07.000056 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42c8e8-c963-4d5b-b660-00daee739f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:07.002283 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebfd74-9126-4ed1-ab08-a3d82f1091ff admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:07.002989 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42c8e8-c963-4d5b-b660-00daee739f7b admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:07.003278 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42c8e8-c963-4d5b-b660-00daee739f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:07.003555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42c8e8-c963-4d5b-b660-00daee739f7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:07.004726 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42c8e8-c963-4d5b-b660-00daee739f7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:07.008206 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42c8e8-c963-4d5b-b660-00daee739f7b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:07.018585 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9155e4-5293-4b88-b8ea-940a98ee144d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:07.019061 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9155e4-5293-4b88-b8ea-940a98ee144d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:07.019408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9155e4-5293-4b88-b8ea-940a98ee144d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:07.019689 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9155e4-5293-4b88-b8ea-940a98ee144d admin admin] PATH_INFO: `/v3/users/1b72ace5a399440588b9f91c0a1ed9d0` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:07.021541 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9155e4-5293-4b88-b8ea-940a98ee144d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b72ace5a399440588b9f91c0a1ed9d0)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:07.024048 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9155e4-5293-4b88-b8ea-940a98ee144d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:07.039694 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:07.080018 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1020/2026] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:06 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:07.080978 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42c8e8-c963-4d5b-b660-00daee739f7b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:07.083515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fc42c8e8-c963-4d5b-b660-00daee739f7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:07.138617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-ad9155e4-5293-4b88-b8ea-940a98ee144d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b72ace5a399440588b9f91c0a1ed9d0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:07.149413 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-ad9155e4-5293-4b88-b8ea-940a98ee144d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b72ace5a399440588b9f91c0a1ed9d0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:07.161087 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-ad9155e4-5293-4b88-b8ea-940a98ee144d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b72ace5a399440588b9f91c0a1ed9d0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:07.162401 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-ad9155e4-5293-4b88-b8ea-940a98ee144d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b72ace5a399440588b9f91c0a1ed9d0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:07.176827 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-ad9155e4-5293-4b88-b8ea-940a98ee144d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b72ace5a399440588b9f91c0a1ed9d0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:07.188531 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1007/2027] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:06 2022] DELETE /identity/v3/users/1b72ace5a399440588b9f91c0a1ed9d0 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:07.188531 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9155e4-5293-4b88-b8ea-940a98ee144d admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:07.188531 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ad9155e4-5293-4b88-b8ea-940a98ee144d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:07.235656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42c8e8-c963-4d5b-b660-00daee739f7b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:07.321688 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9155e4-5293-4b88-b8ea-940a98ee144d admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:07.328331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd1898-e455-476a-b0d7-e8850be3bfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:07.328985 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd1898-e455-476a-b0d7-e8850be3bfd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:07.329351 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd1898-e455-476a-b0d7-e8850be3bfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:07.329637 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd1898-e455-476a-b0d7-e8850be3bfd4 admin admin] PATH_INFO: `/v3/projects/44b703b6681b4e7ea27ec10646bd02d9` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:07.331384 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd1898-e455-476a-b0d7-e8850be3bfd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44b703b6681b4e7ea27ec10646bd02d9)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:07.333486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd1898-e455-476a-b0d7-e8850be3bfd4 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:07.344010 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:07.357681 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6bc9c-4615-49e0-922c-53f82a1b3b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:07.359615 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6bc9c-4615-49e0-922c-53f82a1b3b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:07.359951 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6bc9c-4615-49e0-922c-53f82a1b3b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:07.360356 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6bc9c-4615-49e0-922c-53f82a1b3b6f admin admin] PATH_INFO: `/v3/users/6ccf810bcc0f480193f6a2bed2b2b7d1` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:07.362922 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6bc9c-4615-49e0-922c-53f82a1b3b6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ccf810bcc0f480193f6a2bed2b2b7d1)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:07.367473 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6bc9c-4615-49e0-922c-53f82a1b3b6f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:07.393285 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e7dd1898-e455-476a-b0d7-e8850be3bfd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44b703b6681b4e7ea27ec10646bd02d9', 'request_id': 'req-e7dd1898-e455-476a-b0d7-e8850be3bfd4'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:07.399124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e7dd1898-e455-476a-b0d7-e8850be3bfd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44b703b6681b4e7ea27ec10646bd02d9', 'request_id': 'req-e7dd1898-e455-476a-b0d7-e8850be3bfd4'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:07.406263 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e7dd1898-e455-476a-b0d7-e8850be3bfd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44b703b6681b4e7ea27ec10646bd02d9', 'request_id': 'req-e7dd1898-e455-476a-b0d7-e8850be3bfd4'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:07.423242 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e7dd1898-e455-476a-b0d7-e8850be3bfd4 admin admin] The token cache is being invalidate because project 44b703b6681b4e7ea27ec10646bd02d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:07.423566 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e7dd1898-e455-476a-b0d7-e8850be3bfd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:07.424584 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-e7dd1898-e455-476a-b0d7-e8850be3bfd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:07.426965 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1008/2028] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:07 2022] DELETE /identity/v3/projects/44b703b6681b4e7ea27ec10646bd02d9 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:07.427898 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd1898-e455-476a-b0d7-e8850be3bfd4 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:07.430124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e7dd1898-e455-476a-b0d7-e8850be3bfd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:07.449323 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-38b6bc9c-4615-49e0-922c-53f82a1b3b6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ccf810bcc0f480193f6a2bed2b2b7d1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:07.459315 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-38b6bc9c-4615-49e0-922c-53f82a1b3b6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ccf810bcc0f480193f6a2bed2b2b7d1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:07.461252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-38b6bc9c-4615-49e0-922c-53f82a1b3b6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ccf810bcc0f480193f6a2bed2b2b7d1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:07.480048 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-38b6bc9c-4615-49e0-922c-53f82a1b3b6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ccf810bcc0f480193f6a2bed2b2b7d1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:07.493047 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-38b6bc9c-4615-49e0-922c-53f82a1b3b6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ccf810bcc0f480193f6a2bed2b2b7d1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:07.504122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1021/2029] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:07 2022] DELETE /identity/v3/users/6ccf810bcc0f480193f6a2bed2b2b7d1 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:07.505563 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08693db7-d797-4403-ba19-b1d3e6f9fe07 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:07.505854 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08693db7-d797-4403-ba19-b1d3e6f9fe07 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:07.506127 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08693db7-d797-4403-ba19-b1d3e6f9fe07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:07.529267 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd1898-e455-476a-b0d7-e8850be3bfd4 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:07.532660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-08693db7-d797-4403-ba19-b1d3e6f9fe07 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:07.534033 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-08693db7-d797-4403-ba19-b1d3e6f9fe07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:07.558519 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:07.621334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d26b81-493f-48bc-aafc-4f978d1fa73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:07.621959 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d26b81-493f-48bc-aafc-4f978d1fa73b admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:07.622248 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d26b81-493f-48bc-aafc-4f978d1fa73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:07.622525 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d26b81-493f-48bc-aafc-4f978d1fa73b admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:07.623386 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d26b81-493f-48bc-aafc-4f978d1fa73b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:07.625382 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d26b81-493f-48bc-aafc-4f978d1fa73b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:07.663679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1009/2030] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:07 2022] POST /identity/v3/users => generated 287 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:07.665265 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fada566-f989-41ba-9895-5836ca84fefd None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:07.665549 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fada566-f989-41ba-9895-5836ca84fefd None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:07.665749 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fada566-f989-41ba-9895-5836ca84fefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:07.677223 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1022/2031] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:07.679577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08693db7-d797-4403-ba19-b1d3e6f9fe07 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:07.681999 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-08693db7-d797-4403-ba19-b1d3e6f9fe07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:07.698612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-5fada566-f989-41ba-9895-5836ca84fefd None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:07.699903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5fada566-f989-41ba-9895-5836ca84fefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:07.700301 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08693db7-d797-4403-ba19-b1d3e6f9fe07 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:07.704983 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8334f40-50de-42d0-bace-bf643433c770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:07.705654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8334f40-50de-42d0-bace-bf643433c770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:07.705935 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8334f40-50de-42d0-bace-bf643433c770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:07.706208 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8334f40-50de-42d0-bace-bf643433c770 admin admin] PATH_INFO: `/v3/projects/72a750ed32dc41ae9a6be94a06be387b` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:07.707322 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8334f40-50de-42d0-bace-bf643433c770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72a750ed32dc41ae9a6be94a06be387b)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:07.709268 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8334f40-50de-42d0-bace-bf643433c770 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:07.712765 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1010/2032] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:07.712765 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fada566-f989-41ba-9895-5836ca84fefd None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:07.718385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5fada566-f989-41ba-9895-5836ca84fefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:07.746474 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fada566-f989-41ba-9895-5836ca84fefd None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:07.753768 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2350875-b79d-4032-8549-99c56ccc8bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:07.754818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2350875-b79d-4032-8549-99c56ccc8bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:07.755112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2350875-b79d-4032-8549-99c56ccc8bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:07.755500 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2350875-b79d-4032-8549-99c56ccc8bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:07.756206 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2350875-b79d-4032-8549-99c56ccc8bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:07.758199 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2350875-b79d-4032-8549-99c56ccc8bd6 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:07.769862 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1011/2033] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:07.769862 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbfa1d-55e6-4692-a95d-af73555536eb None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:07.769862 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbfa1d-55e6-4692-a95d-af73555536eb None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:07.769862 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbfa1d-55e6-4692-a95d-af73555536eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:07.773473 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e8334f40-50de-42d0-bace-bf643433c770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72a750ed32dc41ae9a6be94a06be387b', 'request_id': 'req-e8334f40-50de-42d0-bace-bf643433c770'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:07.784459 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e8334f40-50de-42d0-bace-bf643433c770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72a750ed32dc41ae9a6be94a06be387b', 'request_id': 'req-e8334f40-50de-42d0-bace-bf643433c770'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:07.794445 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-81bbfa1d-55e6-4692-a95d-af73555536eb None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:07.795692 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-81bbfa1d-55e6-4692-a95d-af73555536eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:07.798814 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e8334f40-50de-42d0-bace-bf643433c770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72a750ed32dc41ae9a6be94a06be387b', 'request_id': 'req-e8334f40-50de-42d0-bace-bf643433c770'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:07.806587 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:07.814916 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e8334f40-50de-42d0-bace-bf643433c770 admin admin] The token cache is being invalidate because project 72a750ed32dc41ae9a6be94a06be387b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:07.815211 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e8334f40-50de-42d0-bace-bf643433c770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:07.815860 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e8334f40-50de-42d0-bace-bf643433c770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:07.817428 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1023/2034] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:07 2022] DELETE /identity/v3/projects/72a750ed32dc41ae9a6be94a06be387b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:07.818193 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8334f40-50de-42d0-bace-bf643433c770 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:07.820138 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e8334f40-50de-42d0-bace-bf643433c770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:07.867110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1012/2035] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:07.869934 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbfa1d-55e6-4692-a95d-af73555536eb None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:07.871472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-81bbfa1d-55e6-4692-a95d-af73555536eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:07.884630 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbfa1d-55e6-4692-a95d-af73555536eb None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:07.889357 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c32e72-f81a-4928-a7ce-984d4107f73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:07.889968 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c32e72-f81a-4928-a7ce-984d4107f73a admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:07.890250 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c32e72-f81a-4928-a7ce-984d4107f73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:07.890524 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c32e72-f81a-4928-a7ce-984d4107f73a admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:07.891294 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c32e72-f81a-4928-a7ce-984d4107f73a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:07.892912 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c32e72-f81a-4928-a7ce-984d4107f73a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:07.896255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8334f40-50de-42d0-bace-bf643433c770 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:07.900810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdadf6-c57d-43e5-a1da-e57d8415404e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:07.901904 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdadf6-c57d-43e5-a1da-e57d8415404e service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:07.902319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdadf6-c57d-43e5-a1da-e57d8415404e service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:07.902656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdadf6-c57d-43e5-a1da-e57d8415404e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:07.904051 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1013/2036] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:07.905323 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc146f3-92ac-4f4c-98b3-6a8fc4c040ec None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:07.905611 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc146f3-92ac-4f4c-98b3-6a8fc4c040ec None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:07.905886 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc146f3-92ac-4f4c-98b3-6a8fc4c040ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:07.908129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-11fdadf6-c57d-43e5-a1da-e57d8415404e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:07.924213 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fdadf6-c57d-43e5-a1da-e57d8415404e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:07.926155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fdadf6-c57d-43e5-a1da-e57d8415404e service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:07.928214 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-7cc146f3-92ac-4f4c-98b3-6a8fc4c040ec None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:07.930169 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-7cc146f3-92ac-4f4c-98b3-6a8fc4c040ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:07.938624 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1014/2037] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:07.939350 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc146f3-92ac-4f4c-98b3-6a8fc4c040ec None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:07.948901 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1024/2038] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:07.949632 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdadf6-c57d-43e5-a1da-e57d8415404e service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:07.949759 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc146f3-92ac-4f4c-98b3-6a8fc4c040ec None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:07.954678 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ad781-9683-46ea-a9e2-553ad29374b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:07.955502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ad781-9683-46ea-a9e2-553ad29374b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:07.955661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ad781-9683-46ea-a9e2-553ad29374b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:07.956042 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ad781-9683-46ea-a9e2-553ad29374b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:07.956777 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ad781-9683-46ea-a9e2-553ad29374b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:31:07.957207 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ad781-9683-46ea-a9e2-553ad29374b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:07.959135 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ad781-9683-46ea-a9e2-553ad29374b7 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:07.962354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdadf6-c57d-43e5-a1da-e57d8415404e service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:07.968206 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656172cc-c69c-4c27-a375-39d65a55ed09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:07.970036 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656172cc-c69c-4c27-a375-39d65a55ed09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:07.970036 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656172cc-c69c-4c27-a375-39d65a55ed09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:07.970036 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656172cc-c69c-4c27-a375-39d65a55ed09 admin admin] PATH_INFO: `/v3/projects/094166335ac343b4a4107ad45d068311/users/76f7ebd282b5468994f6158ac893a660/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:07.976360 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1015/2039] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:31:07.976360 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416030e6-a8d4-4fe3-9b0a-b847f874b790 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:07.976360 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416030e6-a8d4-4fe3-9b0a-b847f874b790 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:07.976360 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416030e6-a8d4-4fe3-9b0a-b847f874b790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:08.002189 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656172cc-c69c-4c27-a375-39d65a55ed09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=094166335ac343b4a4107ad45d068311, user_id=76f7ebd282b5468994f6158ac893a660, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:08.003135 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-416030e6-a8d4-4fe3-9b0a-b847f874b790 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:08.004550 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-416030e6-a8d4-4fe3-9b0a-b847f874b790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:08.004987 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656172cc-c69c-4c27-a375-39d65a55ed09 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:08.017792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1016/2040] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:08.018778 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416030e6-a8d4-4fe3-9b0a-b847f874b790 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:08.024362 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1025/2041] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:07 2022] PUT /identity/v3/projects/094166335ac343b4a4107ad45d068311/users/76f7ebd282b5468994f6158ac893a660/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:08.026129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656172cc-c69c-4c27-a375-39d65a55ed09 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:08.029414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416030e6-a8d4-4fe3-9b0a-b847f874b790 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:08.051258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:08.117648 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4958c-e2d4-4fe3-9215-cc995d2fd2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:08.118114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4958c-e2d4-4fe3-9215-cc995d2fd2db admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:08.118980 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4958c-e2d4-4fe3-9215-cc995d2fd2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:08.119264 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4958c-e2d4-4fe3-9215-cc995d2fd2db admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:08.120115 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4958c-e2d4-4fe3-9215-cc995d2fd2db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:08.122637 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656172cc-c69c-4c27-a375-39d65a55ed09 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:08.123212 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4958c-e2d4-4fe3-9215-cc995d2fd2db admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:08.129507 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abbb23-7014-48c1-b4d6-e419916f9e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:08.130457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abbb23-7014-48c1-b4d6-e419916f9e67 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:08.130796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abbb23-7014-48c1-b4d6-e419916f9e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:08.131298 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abbb23-7014-48c1-b4d6-e419916f9e67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:08.133721 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abbb23-7014-48c1-b4d6-e419916f9e67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:31:08.134214 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abbb23-7014-48c1-b4d6-e419916f9e67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:08.136382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abbb23-7014-48c1-b4d6-e419916f9e67 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:08.164350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1026/2042] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:31:08.164350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8528a3-a139-4c76-a26f-319ffc558f24 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:08.164350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8528a3-a139-4c76-a26f-319ffc558f24 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:08.164350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8528a3-a139-4c76-a26f-319ffc558f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:08.175490 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1017/2043] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:08 2022] POST /identity/v3/projects => generated 401 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:08.176631 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4958c-e2d4-4fe3-9215-cc995d2fd2db admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:08.189304 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-bb8528a3-a139-4c76-a26f-319ffc558f24 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:08.191667 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bb8528a3-a139-4c76-a26f-319ffc558f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:08.257374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4958c-e2d4-4fe3-9215-cc995d2fd2db admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:08.263164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d7e71-ab94-4309-9ec8-a81fcfd1bce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:08.263953 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d7e71-ab94-4309-9ec8-a81fcfd1bce0 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:08.264239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d7e71-ab94-4309-9ec8-a81fcfd1bce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:08.264517 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d7e71-ab94-4309-9ec8-a81fcfd1bce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:08.265172 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d7e71-ab94-4309-9ec8-a81fcfd1bce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:08.267116 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1027/2044] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:08.267237 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d7e71-ab94-4309-9ec8-a81fcfd1bce0 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:08.271034 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8528a3-a139-4c76-a26f-319ffc558f24 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:08.278257 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:08.281907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8528a3-a139-4c76-a26f-319ffc558f24 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:08.287494 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9a060-ade9-4400-bd96-1ccd0d8c0d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:08.288904 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9a060-ade9-4400-bd96-1ccd0d8c0d3c admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:08.289441 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9a060-ade9-4400-bd96-1ccd0d8c0d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:08.290076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9a060-ade9-4400-bd96-1ccd0d8c0d3c admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:08.291259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9a060-ade9-4400-bd96-1ccd0d8c0d3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:08.294290 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9a060-ade9-4400-bd96-1ccd0d8c0d3c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:08.300954 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1018/2045] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:08 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:08.301887 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d7e71-ab94-4309-9ec8-a81fcfd1bce0 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:08.306301 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-040d7e71-ab94-4309-9ec8-a81fcfd1bce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:08.325127 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1028/2046] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:08 2022] POST /identity/v3/users => generated 301 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:08.326046 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9a060-ade9-4400-bd96-1ccd0d8c0d3c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:08.339472 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9a060-ade9-4400-bd96-1ccd0d8c0d3c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:08.377921 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d7e71-ab94-4309-9ec8-a81fcfd1bce0 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:08.381913 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316b35e-86f4-4842-b13e-2222415f39cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:08.382548 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316b35e-86f4-4842-b13e-2222415f39cd service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:08.382828 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316b35e-86f4-4842-b13e-2222415f39cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:08.383123 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316b35e-86f4-4842-b13e-2222415f39cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:08.409141 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f58ba-219e-4e43-ad30-6a2d63542020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:08.409762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f58ba-219e-4e43-ad30-6a2d63542020 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:08.410047 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f58ba-219e-4e43-ad30-6a2d63542020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:08.410320 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f58ba-219e-4e43-ad30-6a2d63542020 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:08.410961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f58ba-219e-4e43-ad30-6a2d63542020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:08.414680 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f58ba-219e-4e43-ad30-6a2d63542020 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:08.454721 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1029/2047] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:08 2022] POST /identity/v3/users => generated 291 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:08.454721 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f58ba-219e-4e43-ad30-6a2d63542020 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:08.454721 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2a3f58ba-219e-4e43-ad30-6a2d63542020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:08.461538 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316b35e-86f4-4842-b13e-2222415f39cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:08.461538 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316b35e-86f4-4842-b13e-2222415f39cd service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:08.467291 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f58ba-219e-4e43-ad30-6a2d63542020 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:08.472936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12a5ef-45e8-40dc-bec7-cbcef93b17d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:08.473655 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12a5ef-45e8-40dc-bec7-cbcef93b17d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:08.473939 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12a5ef-45e8-40dc-bec7-cbcef93b17d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:08.474263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12a5ef-45e8-40dc-bec7-cbcef93b17d1 admin admin] PATH_INFO: `/v3/projects/fa10a9a8556447e4b1974454f5132b3e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:08.474860 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1019/2048] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:08.475958 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12a5ef-45e8-40dc-bec7-cbcef93b17d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa10a9a8556447e4b1974454f5132b3e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:08.476064 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316b35e-86f4-4842-b13e-2222415f39cd service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:08.478004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12a5ef-45e8-40dc-bec7-cbcef93b17d1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:08.492658 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316b35e-86f4-4842-b13e-2222415f39cd service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:08.501600 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346fe31-03d9-48d5-9d1c-8fd271e1b01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:08.502082 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346fe31-03d9-48d5-9d1c-8fd271e1b01e admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:08.502442 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346fe31-03d9-48d5-9d1c-8fd271e1b01e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:08.502909 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346fe31-03d9-48d5-9d1c-8fd271e1b01e admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:08.503766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346fe31-03d9-48d5-9d1c-8fd271e1b01e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:08.505537 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346fe31-03d9-48d5-9d1c-8fd271e1b01e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:08.509266 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:08.518964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1020/2049] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:08.520539 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346fe31-03d9-48d5-9d1c-8fd271e1b01e admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:08.538364 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346fe31-03d9-48d5-9d1c-8fd271e1b01e admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:08.551258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ff12a5ef-45e8-40dc-bec7-cbcef93b17d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa10a9a8556447e4b1974454f5132b3e', 'request_id': 'req-ff12a5ef-45e8-40dc-bec7-cbcef93b17d1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:08.562354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ff12a5ef-45e8-40dc-bec7-cbcef93b17d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa10a9a8556447e4b1974454f5132b3e', 'request_id': 'req-ff12a5ef-45e8-40dc-bec7-cbcef93b17d1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:08.571390 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ff12a5ef-45e8-40dc-bec7-cbcef93b17d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa10a9a8556447e4b1974454f5132b3e', 'request_id': 'req-ff12a5ef-45e8-40dc-bec7-cbcef93b17d1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:08.588835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ff12a5ef-45e8-40dc-bec7-cbcef93b17d1 admin admin] The token cache is being invalidate because project fa10a9a8556447e4b1974454f5132b3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:08.589350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ff12a5ef-45e8-40dc-bec7-cbcef93b17d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:08.590295 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ff12a5ef-45e8-40dc-bec7-cbcef93b17d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:08.592172 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1030/2050] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:08 2022] DELETE /identity/v3/projects/fa10a9a8556447e4b1974454f5132b3e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:08.592773 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12a5ef-45e8-40dc-bec7-cbcef93b17d1 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:08.596041 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ff12a5ef-45e8-40dc-bec7-cbcef93b17d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:08.613462 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7428e37-6c3c-442c-bd50-04e14e9812f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:08.614086 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7428e37-6c3c-442c-bd50-04e14e9812f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:08.614521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7428e37-6c3c-442c-bd50-04e14e9812f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:08.615227 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7428e37-6c3c-442c-bd50-04e14e9812f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:08.615452 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7428e37-6c3c-442c-bd50-04e14e9812f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:08.618313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7428e37-6c3c-442c-bd50-04e14e9812f9 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:08.629629 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1021/2051] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:08.630763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7428e37-6c3c-442c-bd50-04e14e9812f9 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:08.632685 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b7428e37-6c3c-442c-bd50-04e14e9812f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:08.646851 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7428e37-6c3c-442c-bd50-04e14e9812f9 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:08.652598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890baaa-e4d0-48b9-bbfb-c5d2f90470f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:08.653396 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890baaa-e4d0-48b9-bbfb-c5d2f90470f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:08.653676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890baaa-e4d0-48b9-bbfb-c5d2f90470f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:08.654004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890baaa-e4d0-48b9-bbfb-c5d2f90470f5 admin admin] PATH_INFO: `/v3/users/43bf989f9b5749f187afb7c814ff0ac6` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:08.655288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890baaa-e4d0-48b9-bbfb-c5d2f90470f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43bf989f9b5749f187afb7c814ff0ac6)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:08.657397 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890baaa-e4d0-48b9-bbfb-c5d2f90470f5 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:08.700106 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:08.713713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12a5ef-45e8-40dc-bec7-cbcef93b17d1 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:08.726594 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e48fd-3b9b-4c21-8aa7-2839056e7690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:08.728636 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e48fd-3b9b-4c21-8aa7-2839056e7690 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:08.729269 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e48fd-3b9b-4c21-8aa7-2839056e7690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:08.729746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e48fd-3b9b-4c21-8aa7-2839056e7690 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:08.730836 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e48fd-3b9b-4c21-8aa7-2839056e7690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:08.736952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e48fd-3b9b-4c21-8aa7-2839056e7690 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:08.741932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c890baaa-e4d0-48b9-bbfb-c5d2f90470f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43bf989f9b5749f187afb7c814ff0ac6'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:08.755427 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1031/2052] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:08.755427 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e48fd-3b9b-4c21-8aa7-2839056e7690 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:08.757014 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9d7e48fd-3b9b-4c21-8aa7-2839056e7690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:08.759970 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c890baaa-e4d0-48b9-bbfb-c5d2f90470f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43bf989f9b5749f187afb7c814ff0ac6'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:08.769502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c890baaa-e4d0-48b9-bbfb-c5d2f90470f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43bf989f9b5749f187afb7c814ff0ac6'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:08.770327 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c890baaa-e4d0-48b9-bbfb-c5d2f90470f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43bf989f9b5749f187afb7c814ff0ac6'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:08.771227 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e48fd-3b9b-4c21-8aa7-2839056e7690 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:08.777161 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f6a1e-e8f9-4e5b-9092-c546de32d740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:08.777873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f6a1e-e8f9-4e5b-9092-c546de32d740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:08.778080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f6a1e-e8f9-4e5b-9092-c546de32d740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:08.778351 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f6a1e-e8f9-4e5b-9092-c546de32d740 admin admin] PATH_INFO: `/v3/users/c1d5a28f090140edabc10af3f615e784` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:08.779738 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f6a1e-e8f9-4e5b-9092-c546de32d740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1d5a28f090140edabc10af3f615e784)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:08.781704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f6a1e-e8f9-4e5b-9092-c546de32d740 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:08.789978 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c890baaa-e4d0-48b9-bbfb-c5d2f90470f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43bf989f9b5749f187afb7c814ff0ac6'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:08.798596 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1022/2053] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:08 2022] DELETE /identity/v3/users/43bf989f9b5749f187afb7c814ff0ac6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:08.799601 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890baaa-e4d0-48b9-bbfb-c5d2f90470f5 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:08.804249 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c890baaa-e4d0-48b9-bbfb-c5d2f90470f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:08.841985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9f2f6a1e-e8f9-4e5b-9092-c546de32d740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1d5a28f090140edabc10af3f615e784'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:08.851568 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9f2f6a1e-e8f9-4e5b-9092-c546de32d740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1d5a28f090140edabc10af3f615e784'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:08.852670 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9f2f6a1e-e8f9-4e5b-9092-c546de32d740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1d5a28f090140edabc10af3f615e784'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:08.867334 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9f2f6a1e-e8f9-4e5b-9092-c546de32d740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1d5a28f090140edabc10af3f615e784'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:08.875903 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9f2f6a1e-e8f9-4e5b-9092-c546de32d740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1d5a28f090140edabc10af3f615e784'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:08.885790 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1032/2054] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:08 2022] DELETE /identity/v3/users/c1d5a28f090140edabc10af3f615e784 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:08.887014 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f6a1e-e8f9-4e5b-9092-c546de32d740 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:08.889529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9f2f6a1e-e8f9-4e5b-9092-c546de32d740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:08.900759 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890baaa-e4d0-48b9-bbfb-c5d2f90470f5 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:08.917338 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:08.985379 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f6a1e-e8f9-4e5b-9092-c546de32d740 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:08.994358 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270cbf6-c484-41e5-8940-1a2f9fa9c10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:08.995898 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270cbf6-c484-41e5-8940-1a2f9fa9c10d admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:08.996480 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270cbf6-c484-41e5-8940-1a2f9fa9c10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:08.996658 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e7bab-f573-4cf1-908d-855c381941ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:08.997932 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270cbf6-c484-41e5-8940-1a2f9fa9c10d admin admin] PATH_INFO: `/v3/projects/76c27c6696974e5b9a00b8421ce7351e/users/398800a4690e41459ebe59d3bc44d985/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:08.998831 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e7bab-f573-4cf1-908d-855c381941ae admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:08.999201 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e7bab-f573-4cf1-908d-855c381941ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:08.999839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e7bab-f573-4cf1-908d-855c381941ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:09.001755 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e7bab-f573-4cf1-908d-855c381941ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:09.003388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e7bab-f573-4cf1-908d-855c381941ae admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:09.019497 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1023/2055] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:09.021680 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1f9f3-4639-4105-9d61-9bfe722a5344 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:09.022789 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1f9f3-4639-4105-9d61-9bfe722a5344 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:09.023259 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1f9f3-4639-4105-9d61-9bfe722a5344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:09.045483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-10d1f9f3-4639-4105-9d61-9bfe722a5344 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:09.046915 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-10d1f9f3-4639-4105-9d61-9bfe722a5344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:09.058678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270cbf6-c484-41e5-8940-1a2f9fa9c10d admin admin] RBAC: Authorizing `identity:create_grant(project_id=76c27c6696974e5b9a00b8421ce7351e, user_id=398800a4690e41459ebe59d3bc44d985, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:09.059475 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1024/2056] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:09.060256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1f9f3-4639-4105-9d61-9bfe722a5344 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:09.062100 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-10d1f9f3-4639-4105-9d61-9bfe722a5344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:09.063593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270cbf6-c484-41e5-8940-1a2f9fa9c10d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:09.080974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1f9f3-4639-4105-9d61-9bfe722a5344 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:09.085767 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1033/2057] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:08 2022] PUT /identity/v3/projects/76c27c6696974e5b9a00b8421ce7351e/users/398800a4690e41459ebe59d3bc44d985/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:09.087069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270cbf6-c484-41e5-8940-1a2f9fa9c10d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:09.100597 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3270cbf6-c484-41e5-8940-1a2f9fa9c10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:09.159838 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:09.192494 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270cbf6-c484-41e5-8940-1a2f9fa9c10d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:09.197542 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8000517-6c09-479b-a23e-23fcd2b96c3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:09.198220 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8000517-6c09-479b-a23e-23fcd2b96c3f service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:09.198479 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8000517-6c09-479b-a23e-23fcd2b96c3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:09.198908 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8000517-6c09-479b-a23e-23fcd2b96c3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:09.204010 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541dd53f-fc0d-4b98-a1df-2916a94c9abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:09.205053 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dd53f-fc0d-4b98-a1df-2916a94c9abb admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:09.205484 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dd53f-fc0d-4b98-a1df-2916a94c9abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:09.206406 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dd53f-fc0d-4b98-a1df-2916a94c9abb admin admin] PATH_INFO: `/v3/projects/9cc6386eee264d4b976820fb0a7c5fb0/users/fa34520ea4304e2e990709e2d8e704a3/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:09.210850 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8000517-6c09-479b-a23e-23fcd2b96c3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:09.212473 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8000517-6c09-479b-a23e-23fcd2b96c3f service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:09.226962 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541dd53f-fc0d-4b98-a1df-2916a94c9abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc6386eee264d4b976820fb0a7c5fb0, user_id=fa34520ea4304e2e990709e2d8e704a3, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:09.231207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1034/2058] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:09.232446 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541dd53f-fc0d-4b98-a1df-2916a94c9abb admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:09.232688 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a302a-f850-4419-838b-5e99cd9b804c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:09.232961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a302a-f850-4419-838b-5e99cd9b804c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:09.233352 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a302a-f850-4419-838b-5e99cd9b804c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:09.261125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1025/2059] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:09 2022] PUT /identity/v3/projects/9cc6386eee264d4b976820fb0a7c5fb0/users/fa34520ea4304e2e990709e2d8e704a3/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:09.265047 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7f88b-f48f-4237-9b4d-e86febff2175 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:09.265365 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7f88b-f48f-4237-9b4d-e86febff2175 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:09.265640 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7f88b-f48f-4237-9b4d-e86febff2175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:09.277562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-425a302a-f850-4419-838b-5e99cd9b804c None None] MFA Rules not processed for user `398800a4690e41459ebe59d3bc44d985`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:09.279015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-425a302a-f850-4419-838b-5e99cd9b804c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:09.305109 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-fcb7f88b-f48f-4237-9b4d-e86febff2175 None None] MFA Rules not processed for user `fa34520ea4304e2e990709e2d8e704a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:09.306577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-fcb7f88b-f48f-4237-9b4d-e86febff2175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:09.384848 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1035/2060] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:09 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:09.386017 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a302a-f850-4419-838b-5e99cd9b804c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:09.394647 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1026/2061] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:31:09.395632 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7f88b-f48f-4237-9b4d-e86febff2175 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:09.451570 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:09.476999 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7f88b-f48f-4237-9b4d-e86febff2175 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:09.482427 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082668cb-374b-45b6-a7ee-3438e87ddec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:09.483061 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082668cb-374b-45b6-a7ee-3438e87ddec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:09.483340 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082668cb-374b-45b6-a7ee-3438e87ddec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:09.483610 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082668cb-374b-45b6-a7ee-3438e87ddec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:09.484699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082668cb-374b-45b6-a7ee-3438e87ddec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:09.486862 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082668cb-374b-45b6-a7ee-3438e87ddec1 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:09.504845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a302a-f850-4419-838b-5e99cd9b804c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:09.518491 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad327302-0941-4bc4-bfa0-ab9a401cd118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:09.519923 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad327302-0941-4bc4-bfa0-ab9a401cd118 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:09.520206 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad327302-0941-4bc4-bfa0-ab9a401cd118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:09.520900 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad327302-0941-4bc4-bfa0-ab9a401cd118 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:09.521570 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad327302-0941-4bc4-bfa0-ab9a401cd118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:09.526626 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad327302-0941-4bc4-bfa0-ab9a401cd118 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:09.537621 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1027/2062] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:09 2022] POST /identity/v3/projects => generated 381 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:09.542111 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082668cb-374b-45b6-a7ee-3438e87ddec1 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:09.591917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1036/2063] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:09 2022] POST /identity/v3/projects => generated 399 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:09.597393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad327302-0941-4bc4-bfa0-ab9a401cd118 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:09.616829 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:09.669817 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082668cb-374b-45b6-a7ee-3438e87ddec1 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:09.740611 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f9b77-052e-4834-9034-07446e2d1ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:09.741797 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f9b77-052e-4834-9034-07446e2d1ffb admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:09.742098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f9b77-052e-4834-9034-07446e2d1ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:09.742463 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f9b77-052e-4834-9034-07446e2d1ffb admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:09.743099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f9b77-052e-4834-9034-07446e2d1ffb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:09.745267 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f9b77-052e-4834-9034-07446e2d1ffb admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:09.776399 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1028/2064] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:09 2022] POST /identity/v3/users => generated 297 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:09.778112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919df34-6b21-4f97-872c-a621daf984e6 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:09.778461 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919df34-6b21-4f97-872c-a621daf984e6 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:09.778739 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919df34-6b21-4f97-872c-a621daf984e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:09.781174 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad327302-0941-4bc4-bfa0-ab9a401cd118 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:09.786400 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc67f2a-bc95-4ab5-87d3-0a38a74b7bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:09.787132 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc67f2a-bc95-4ab5-87d3-0a38a74b7bfd admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:09.787484 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc67f2a-bc95-4ab5-87d3-0a38a74b7bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:09.787913 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc67f2a-bc95-4ab5-87d3-0a38a74b7bfd admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:09.788954 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc67f2a-bc95-4ab5-87d3-0a38a74b7bfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:09.791105 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc67f2a-bc95-4ab5-87d3-0a38a74b7bfd admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:09.816029 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-8919df34-6b21-4f97-872c-a621daf984e6 None None] MFA Rules not processed for user `76f7ebd282b5468994f6158ac893a660`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:09.818816 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8919df34-6b21-4f97-872c-a621daf984e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:09.829000 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1037/2065] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:09 2022] POST /identity/v3/users => generated 306 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:09.829000 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc67f2a-bc95-4ab5-87d3-0a38a74b7bfd admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:09.829287 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0bc67f2a-bc95-4ab5-87d3-0a38a74b7bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:09.842954 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc67f2a-bc95-4ab5-87d3-0a38a74b7bfd admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:09.848197 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4e8b7-bbe5-402b-84dc-292c10c35a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:09.848496 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4e8b7-bbe5-402b-84dc-292c10c35a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:09.848782 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4e8b7-bbe5-402b-84dc-292c10c35a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:09.849074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4e8b7-bbe5-402b-84dc-292c10c35a6c admin admin] PATH_INFO: `/v3/projects/41b782200ed64f99a225319d2bb14dc7` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:09.850590 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4e8b7-bbe5-402b-84dc-292c10c35a6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=41b782200ed64f99a225319d2bb14dc7)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:09.852624 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4e8b7-bbe5-402b-84dc-292c10c35a6c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:09.919991 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b6d4e8b7-bbe5-402b-84dc-292c10c35a6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41b782200ed64f99a225319d2bb14dc7', 'request_id': 'req-b6d4e8b7-bbe5-402b-84dc-292c10c35a6c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:09.928307 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b6d4e8b7-bbe5-402b-84dc-292c10c35a6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41b782200ed64f99a225319d2bb14dc7', 'request_id': 'req-b6d4e8b7-bbe5-402b-84dc-292c10c35a6c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:09.936091 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b6d4e8b7-bbe5-402b-84dc-292c10c35a6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41b782200ed64f99a225319d2bb14dc7', 'request_id': 'req-b6d4e8b7-bbe5-402b-84dc-292c10c35a6c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:09.949209 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1029/2066] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:09.950986 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919df34-6b21-4f97-872c-a621daf984e6 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:09.952935 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8919df34-6b21-4f97-872c-a621daf984e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:09.955961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b6d4e8b7-bbe5-402b-84dc-292c10c35a6c admin admin] The token cache is being invalidate because project 41b782200ed64f99a225319d2bb14dc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:09.956430 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b6d4e8b7-bbe5-402b-84dc-292c10c35a6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:09.957741 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-b6d4e8b7-bbe5-402b-84dc-292c10c35a6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:09.962742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1038/2067] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:09 2022] DELETE /identity/v3/projects/41b782200ed64f99a225319d2bb14dc7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:09.962742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4e8b7-bbe5-402b-84dc-292c10c35a6c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:09.963551 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b6d4e8b7-bbe5-402b-84dc-292c10c35a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:09.969316 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919df34-6b21-4f97-872c-a621daf984e6 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:10.001055 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:10.040001 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4e8b7-bbe5-402b-84dc-292c10c35a6c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:10.041652 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:10.048259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8cdd2-356e-4cf1-8554-315b1ac2809e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:10.048525 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe82df6-5c10-4220-96bd-d9915cc2aa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:10.049244 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8cdd2-356e-4cf1-8554-315b1ac2809e admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:10.049416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe82df6-5c10-4220-96bd-d9915cc2aa1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:10.049841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8cdd2-356e-4cf1-8554-315b1ac2809e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:10.049952 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe82df6-5c10-4220-96bd-d9915cc2aa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:10.050141 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8cdd2-356e-4cf1-8554-315b1ac2809e admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:10.050331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe82df6-5c10-4220-96bd-d9915cc2aa1c admin admin] PATH_INFO: `/v3/projects/c6bd84a041ae4a56b2f1ed8052eee319` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:10.051009 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8cdd2-356e-4cf1-8554-315b1ac2809e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:10.051929 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe82df6-5c10-4220-96bd-d9915cc2aa1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6bd84a041ae4a56b2f1ed8052eee319)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:10.052740 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8cdd2-356e-4cf1-8554-315b1ac2809e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:10.054067 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe82df6-5c10-4220-96bd-d9915cc2aa1c admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:10.063871 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1039/2068] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:10.064973 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8cdd2-356e-4cf1-8554-315b1ac2809e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:10.067099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-04c8cdd2-356e-4cf1-8554-315b1ac2809e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:10.086703 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8cdd2-356e-4cf1-8554-315b1ac2809e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:10.092448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8d7bb-06a5-4333-ba93-b99490ef5711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:10.093154 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8d7bb-06a5-4333-ba93-b99490ef5711 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:10.093438 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8d7bb-06a5-4333-ba93-b99490ef5711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:10.093712 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8d7bb-06a5-4333-ba93-b99490ef5711 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:10.094356 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8d7bb-06a5-4333-ba93-b99490ef5711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:10.096401 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8d7bb-06a5-4333-ba93-b99490ef5711 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:10.107483 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1040/2069] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:10.110183 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-cbe82df6-5c10-4220-96bd-d9915cc2aa1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6bd84a041ae4a56b2f1ed8052eee319', 'request_id': 'req-cbe82df6-5c10-4220-96bd-d9915cc2aa1c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:10.111470 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8d7bb-06a5-4333-ba93-b99490ef5711 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:10.113395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9ee8d7bb-06a5-4333-ba93-b99490ef5711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:10.117628 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-cbe82df6-5c10-4220-96bd-d9915cc2aa1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6bd84a041ae4a56b2f1ed8052eee319', 'request_id': 'req-cbe82df6-5c10-4220-96bd-d9915cc2aa1c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:10.124891 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-cbe82df6-5c10-4220-96bd-d9915cc2aa1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6bd84a041ae4a56b2f1ed8052eee319', 'request_id': 'req-cbe82df6-5c10-4220-96bd-d9915cc2aa1c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:10.127426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8d7bb-06a5-4333-ba93-b99490ef5711 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:10.139249 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-cbe82df6-5c10-4220-96bd-d9915cc2aa1c admin admin] The token cache is being invalidate because project c6bd84a041ae4a56b2f1ed8052eee319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:10.139546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-cbe82df6-5c10-4220-96bd-d9915cc2aa1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:10.140195 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-cbe82df6-5c10-4220-96bd-d9915cc2aa1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:10.141977 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1030/2070] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:09 2022] DELETE /identity/v3/projects/c6bd84a041ae4a56b2f1ed8052eee319 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:10.142638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe82df6-5c10-4220-96bd-d9915cc2aa1c admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:10.143925 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-cbe82df6-5c10-4220-96bd-d9915cc2aa1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:10.192135 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272f3e1-f703-4710-b3dd-bce5ace0fcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:10.192741 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272f3e1-f703-4710-b3dd-bce5ace0fcf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:10.193044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272f3e1-f703-4710-b3dd-bce5ace0fcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:10.193323 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272f3e1-f703-4710-b3dd-bce5ace0fcf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:10.194516 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272f3e1-f703-4710-b3dd-bce5ace0fcf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:10.196630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272f3e1-f703-4710-b3dd-bce5ace0fcf5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:10.215060 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe82df6-5c10-4220-96bd-d9915cc2aa1c admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:10.220817 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c27e52-a948-4b8d-868d-0f5ca78bbd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:10.221784 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c27e52-a948-4b8d-868d-0f5ca78bbd75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:10.221903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c27e52-a948-4b8d-868d-0f5ca78bbd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:10.222193 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c27e52-a948-4b8d-868d-0f5ca78bbd75 admin admin] PATH_INFO: `/v3/users/0f8122a2172f4ed99d9e54cf966bb79e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:10.223577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c27e52-a948-4b8d-868d-0f5ca78bbd75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f8122a2172f4ed99d9e54cf966bb79e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:10.225742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c27e52-a948-4b8d-868d-0f5ca78bbd75 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:10.236876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1041/2071] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:10 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:10.237936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272f3e1-f703-4710-b3dd-bce5ace0fcf5 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:10.241928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2272f3e1-f703-4710-b3dd-bce5ace0fcf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:10.282938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f6c27e52-a948-4b8d-868d-0f5ca78bbd75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f8122a2172f4ed99d9e54cf966bb79e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:10.291353 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f6c27e52-a948-4b8d-868d-0f5ca78bbd75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f8122a2172f4ed99d9e54cf966bb79e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:10.300544 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f6c27e52-a948-4b8d-868d-0f5ca78bbd75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f8122a2172f4ed99d9e54cf966bb79e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:10.301287 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f6c27e52-a948-4b8d-868d-0f5ca78bbd75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f8122a2172f4ed99d9e54cf966bb79e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:10.315067 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272f3e1-f703-4710-b3dd-bce5ace0fcf5 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:10.315538 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f6c27e52-a948-4b8d-868d-0f5ca78bbd75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f8122a2172f4ed99d9e54cf966bb79e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:10.320769 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413891b-9ad1-4e64-b429-52f564346fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:10.321456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413891b-9ad1-4e64-b429-52f564346fda admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:10.321740 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413891b-9ad1-4e64-b429-52f564346fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:10.322016 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413891b-9ad1-4e64-b429-52f564346fda admin admin] PATH_INFO: `/v3/projects/0cda5891343c43c88eccf4b814f51daa/users/db4ceacf140b41958fa2ce75c6459e3b/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:10.326237 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1031/2072] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:10 2022] DELETE /identity/v3/users/0f8122a2172f4ed99d9e54cf966bb79e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:10.326237 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c27e52-a948-4b8d-868d-0f5ca78bbd75 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:10.326237 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f6c27e52-a948-4b8d-868d-0f5ca78bbd75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:10.336823 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:10.338457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413891b-9ad1-4e64-b429-52f564346fda admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cda5891343c43c88eccf4b814f51daa, user_id=db4ceacf140b41958fa2ce75c6459e3b, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:10.342943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413891b-9ad1-4e64-b429-52f564346fda admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:10.359601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1042/2073] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:10 2022] PUT /identity/v3/projects/0cda5891343c43c88eccf4b814f51daa/users/db4ceacf140b41958fa2ce75c6459e3b/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:10.362554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7240e3-64ac-4d76-b4ab-acad390779d4 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:10.362554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7240e3-64ac-4d76-b4ab-acad390779d4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:10.362554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7240e3-64ac-4d76-b4ab-acad390779d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:10.386615 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2d7240e3-64ac-4d76-b4ab-acad390779d4 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:10.387412 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2d7240e3-64ac-4d76-b4ab-acad390779d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:10.410918 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:10.442410 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c27e52-a948-4b8d-868d-0f5ca78bbd75 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:10.473823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1043/2074] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:10.474818 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7240e3-64ac-4d76-b4ab-acad390779d4 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:10.481625 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2d7240e3-64ac-4d76-b4ab-acad390779d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:10.501273 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7240e3-64ac-4d76-b4ab-acad390779d4 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:10.507918 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907a61a-e9ca-48c9-8d4d-b14d41f23630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:10.507918 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907a61a-e9ca-48c9-8d4d-b14d41f23630 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:10.508316 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907a61a-e9ca-48c9-8d4d-b14d41f23630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:10.508743 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907a61a-e9ca-48c9-8d4d-b14d41f23630 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:10.509383 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907a61a-e9ca-48c9-8d4d-b14d41f23630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:10.512470 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907a61a-e9ca-48c9-8d4d-b14d41f23630 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:10.541833 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969b484-2d5d-4cee-b8c9-170e32cda3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:10.542743 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969b484-2d5d-4cee-b8c9-170e32cda3ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:10.543932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969b484-2d5d-4cee-b8c9-170e32cda3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:10.544313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969b484-2d5d-4cee-b8c9-170e32cda3ed admin admin] PATH_INFO: `/v3/projects/44e632a7774947d29a32e2ca0532aa2c/users/246efa46b934472f9b0e56ecca7a7689/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:10.548059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1044/2075] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:10 2022] POST /identity/v3/users => generated 293 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:10.548968 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907a61a-e9ca-48c9-8d4d-b14d41f23630 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:10.550816 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5907a61a-e9ca-48c9-8d4d-b14d41f23630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:10.568113 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907a61a-e9ca-48c9-8d4d-b14d41f23630 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:10.568875 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969b484-2d5d-4cee-b8c9-170e32cda3ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=44e632a7774947d29a32e2ca0532aa2c, user_id=246efa46b934472f9b0e56ecca7a7689, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:10.571872 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969b484-2d5d-4cee-b8c9-170e32cda3ed admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:10.581584 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c87e1-81a4-4990-a296-e7800ef91972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:10.582441 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c87e1-81a4-4990-a296-e7800ef91972 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:10.582914 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c87e1-81a4-4990-a296-e7800ef91972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:10.583706 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c87e1-81a4-4990-a296-e7800ef91972 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:10.584588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c87e1-81a4-4990-a296-e7800ef91972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:10.586506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c87e1-81a4-4990-a296-e7800ef91972 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:10.591556 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1032/2076] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:10 2022] PUT /identity/v3/projects/44e632a7774947d29a32e2ca0532aa2c/users/246efa46b934472f9b0e56ecca7a7689/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:10.593730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d4b27-dfba-4572-b41e-f7554bdfbff6 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:10.594248 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d4b27-dfba-4572-b41e-f7554bdfbff6 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:10.595257 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d4b27-dfba-4572-b41e-f7554bdfbff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:10.603127 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1045/2077] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:10.604522 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c87e1-81a4-4990-a296-e7800ef91972 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:10.616763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c87e1-81a4-4990-a296-e7800ef91972 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:10.625006 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-bb0d4b27-dfba-4572-b41e-f7554bdfbff6 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:10.627004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-bb0d4b27-dfba-4572-b41e-f7554bdfbff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:10.749851 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcb82c-1d76-40ae-8ca6-2784cf4572cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:10.750870 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcb82c-1d76-40ae-8ca6-2784cf4572cb admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:10.752341 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcb82c-1d76-40ae-8ca6-2784cf4572cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:10.752632 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcb82c-1d76-40ae-8ca6-2784cf4572cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:10.753339 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcb82c-1d76-40ae-8ca6-2784cf4572cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:10.755141 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcb82c-1d76-40ae-8ca6-2784cf4572cb admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:10.758807 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1033/2078] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:10.759951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d4b27-dfba-4572-b41e-f7554bdfbff6 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:10.770672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d4b27-dfba-4572-b41e-f7554bdfbff6 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:10.771206 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1046/2079] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:10.772254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcb82c-1d76-40ae-8ca6-2784cf4572cb admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:10.777508 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce140dd-485c-4d25-9b04-abf7390a6561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:10.778426 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce140dd-485c-4d25-9b04-abf7390a6561 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:10.778913 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce140dd-485c-4d25-9b04-abf7390a6561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:10.779396 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce140dd-485c-4d25-9b04-abf7390a6561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:10.780252 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce140dd-485c-4d25-9b04-abf7390a6561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:10.782091 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce140dd-485c-4d25-9b04-abf7390a6561 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:10.784094 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcb82c-1d76-40ae-8ca6-2784cf4572cb admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:10.789783 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeada86d-5775-4eff-891b-baf446ece365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:10.790440 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeada86d-5775-4eff-891b-baf446ece365 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:10.790721 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeada86d-5775-4eff-891b-baf446ece365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:10.791044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeada86d-5775-4eff-891b-baf446ece365 admin admin] PATH_INFO: `/v3/projects/0cda5891343c43c88eccf4b814f51daa/users/db4ceacf140b41958fa2ce75c6459e3b/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:10.793047 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeada86d-5775-4eff-891b-baf446ece365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cda5891343c43c88eccf4b814f51daa, user_id=db4ceacf140b41958fa2ce75c6459e3b, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:10.795665 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeada86d-5775-4eff-891b-baf446ece365 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:10.797837 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1034/2080] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:10.798828 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce140dd-485c-4d25-9b04-abf7390a6561 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:10.800794 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5ce140dd-485c-4d25-9b04-abf7390a6561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:10.812175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1047/2081] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:10 2022] PUT /identity/v3/projects/0cda5891343c43c88eccf4b814f51daa/users/db4ceacf140b41958fa2ce75c6459e3b/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:10.812789 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeada86d-5775-4eff-891b-baf446ece365 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:10.816767 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce140dd-485c-4d25-9b04-abf7390a6561 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:10.849231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:10.886620 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373ca69-9fec-49e1-97f7-22a02179cb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:10.887500 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373ca69-9fec-49e1-97f7-22a02179cb33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:10.887777 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373ca69-9fec-49e1-97f7-22a02179cb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:10.888169 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373ca69-9fec-49e1-97f7-22a02179cb33 admin admin] PATH_INFO: `/v3/projects/18a949c846e44ea5997013a1a973a5c4` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:10.889377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373ca69-9fec-49e1-97f7-22a02179cb33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18a949c846e44ea5997013a1a973a5c4)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:10.891082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeada86d-5775-4eff-891b-baf446ece365 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:10.891418 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373ca69-9fec-49e1-97f7-22a02179cb33 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:10.899661 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9b203-a024-48df-b0e9-d46bb8c276a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:10.900428 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9b203-a024-48df-b0e9-d46bb8c276a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:10.900712 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9b203-a024-48df-b0e9-d46bb8c276a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:10.901445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9b203-a024-48df-b0e9-d46bb8c276a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:10.902113 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9b203-a024-48df-b0e9-d46bb8c276a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:31:10.902428 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9b203-a024-48df-b0e9-d46bb8c276a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:10.904057 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9b203-a024-48df-b0e9-d46bb8c276a0 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:10.919148 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1048/2082] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:31:10.922226 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9b203-a024-48df-b0e9-d46bb8c276a0 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:10.934348 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9b203-a024-48df-b0e9-d46bb8c276a0 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:10.945561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:10.947261 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9373ca69-9fec-49e1-97f7-22a02179cb33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18a949c846e44ea5997013a1a973a5c4', 'request_id': 'req-9373ca69-9fec-49e1-97f7-22a02179cb33'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:10.953597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9373ca69-9fec-49e1-97f7-22a02179cb33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18a949c846e44ea5997013a1a973a5c4', 'request_id': 'req-9373ca69-9fec-49e1-97f7-22a02179cb33'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:10.960407 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9373ca69-9fec-49e1-97f7-22a02179cb33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18a949c846e44ea5997013a1a973a5c4', 'request_id': 'req-9373ca69-9fec-49e1-97f7-22a02179cb33'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:10.975733 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9373ca69-9fec-49e1-97f7-22a02179cb33 admin admin] The token cache is being invalidate because project 18a949c846e44ea5997013a1a973a5c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:10.976079 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9373ca69-9fec-49e1-97f7-22a02179cb33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:10.978845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9373ca69-9fec-49e1-97f7-22a02179cb33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:10.985289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1035/2083] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:10 2022] DELETE /identity/v3/projects/18a949c846e44ea5997013a1a973a5c4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:10.985289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373ca69-9fec-49e1-97f7-22a02179cb33 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:10.985289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9373ca69-9fec-49e1-97f7-22a02179cb33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:11.011424 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b683e-5c85-4018-971b-04d9a4e71e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:11.012089 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b683e-5c85-4018-971b-04d9a4e71e05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:11.012641 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b683e-5c85-4018-971b-04d9a4e71e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:11.012641 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b683e-5c85-4018-971b-04d9a4e71e05 admin admin] PATH_INFO: `/v3/projects/9c334faace8d4e428935147e4247c1b3/users/31f2d947412c43b1b6336f911eae7a89/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:11.028165 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b683e-5c85-4018-971b-04d9a4e71e05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c334faace8d4e428935147e4247c1b3, user_id=31f2d947412c43b1b6336f911eae7a89, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:11.031505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b683e-5c85-4018-971b-04d9a4e71e05 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:11.049503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1049/2084] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:10 2022] PUT /identity/v3/projects/9c334faace8d4e428935147e4247c1b3/users/31f2d947412c43b1b6336f911eae7a89/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:11.049503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d88aa-632f-4b86-b2c1-a21f0b5954d7 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:11.049503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d88aa-632f-4b86-b2c1-a21f0b5954d7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:11.049503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d88aa-632f-4b86-b2c1-a21f0b5954d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:11.071134 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373ca69-9fec-49e1-97f7-22a02179cb33 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:11.082640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-575d88aa-632f-4b86-b2c1-a21f0b5954d7 None None] MFA Rules not processed for user `db4ceacf140b41958fa2ce75c6459e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:11.084009 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-575d88aa-632f-4b86-b2c1-a21f0b5954d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:11.157636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb2686-536a-4a62-b7ab-eec13abc0e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:11.158266 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb2686-536a-4a62-b7ab-eec13abc0e6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:11.158548 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb2686-536a-4a62-b7ab-eec13abc0e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:11.158823 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb2686-536a-4a62-b7ab-eec13abc0e6e admin admin] PATH_INFO: `/v3/projects/44e632a7774947d29a32e2ca0532aa2c/users/246efa46b934472f9b0e56ecca7a7689/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:11.163821 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb2686-536a-4a62-b7ab-eec13abc0e6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=44e632a7774947d29a32e2ca0532aa2c, user_id=246efa46b934472f9b0e56ecca7a7689, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:11.165802 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1050/2085] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:11.166610 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d88aa-632f-4b86-b2c1-a21f0b5954d7 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:11.168243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb2686-536a-4a62-b7ab-eec13abc0e6e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:11.168358 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-575d88aa-632f-4b86-b2c1-a21f0b5954d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:11.184829 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:11.192713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d88aa-632f-4b86-b2c1-a21f0b5954d7 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:11.197538 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1036/2086] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:10 2022] PUT /identity/v3/projects/44e632a7774947d29a32e2ca0532aa2c/users/246efa46b934472f9b0e56ecca7a7689/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:11.208765 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e9332-6d9f-4c84-9cad-8f53ac5e0cff None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:11.210034 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e9332-6d9f-4c84-9cad-8f53ac5e0cff None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:11.210700 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e9332-6d9f-4c84-9cad-8f53ac5e0cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:11.233520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-f89e9332-6d9f-4c84-9cad-8f53ac5e0cff None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:11.235038 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f89e9332-6d9f-4c84-9cad-8f53ac5e0cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:11.286463 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89956662-06fc-42e7-85b9-bf1cf26fcb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:11.288090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89956662-06fc-42e7-85b9-bf1cf26fcb68 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:11.288603 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89956662-06fc-42e7-85b9-bf1cf26fcb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:11.289147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89956662-06fc-42e7-85b9-bf1cf26fcb68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:11.290697 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89956662-06fc-42e7-85b9-bf1cf26fcb68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:11.294090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89956662-06fc-42e7-85b9-bf1cf26fcb68 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:11.313989 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1037/2087] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:11.315211 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e9332-6d9f-4c84-9cad-8f53ac5e0cff None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:11.316800 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f89e9332-6d9f-4c84-9cad-8f53ac5e0cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:11.331525 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e9332-6d9f-4c84-9cad-8f53ac5e0cff None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:11.333233 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1051/2088] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:11 2022] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:11.334327 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89956662-06fc-42e7-85b9-bf1cf26fcb68 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:11.338764 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-89956662-06fc-42e7-85b9-bf1cf26fcb68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:11.352353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:11.402606 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93f843-9919-4ec3-806f-7ed7caaf21ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:11.403248 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93f843-9919-4ec3-806f-7ed7caaf21ba admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:11.403591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93f843-9919-4ec3-806f-7ed7caaf21ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:11.403876 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93f843-9919-4ec3-806f-7ed7caaf21ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:11.404873 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93f843-9919-4ec3-806f-7ed7caaf21ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:11.406799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93f843-9919-4ec3-806f-7ed7caaf21ba admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:11.420910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1038/2089] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:11.420910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a552f3f-8d32-4566-9d66-e771c3ede4f9 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:11.420910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a552f3f-8d32-4566-9d66-e771c3ede4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:11.420910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a552f3f-8d32-4566-9d66-e771c3ede4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:11.430616 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89956662-06fc-42e7-85b9-bf1cf26fcb68 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:11.435785 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b451027-1572-41b0-aa5e-8e3d89839e56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:11.436995 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b451027-1572-41b0-aa5e-8e3d89839e56 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:11.437448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b451027-1572-41b0-aa5e-8e3d89839e56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:11.437885 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b451027-1572-41b0-aa5e-8e3d89839e56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:11.453397 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-4a552f3f-8d32-4566-9d66-e771c3ede4f9 None None] MFA Rules not processed for user `246efa46b934472f9b0e56ecca7a7689`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:11.455010 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4a552f3f-8d32-4566-9d66-e771c3ede4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:11.517445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b451027-1572-41b0-aa5e-8e3d89839e56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:11.519168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b451027-1572-41b0-aa5e-8e3d89839e56 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:11.536680 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1052/2090] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:11 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:11.538153 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814716e-5c45-4ef4-80d2-b50cf651cee2 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:11.538438 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814716e-5c45-4ef4-80d2-b50cf651cee2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:11.538711 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814716e-5c45-4ef4-80d2-b50cf651cee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:11.561050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-4814716e-5c45-4ef4-80d2-b50cf651cee2 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:11.562304 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4814716e-5c45-4ef4-80d2-b50cf651cee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:11.571078 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1039/2091] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:11 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:11.573597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a552f3f-8d32-4566-9d66-e771c3ede4f9 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:11.574086 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1053/2092] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:11.574966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814716e-5c45-4ef4-80d2-b50cf651cee2 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:11.585946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814716e-5c45-4ef4-80d2-b50cf651cee2 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:11.586858 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a552f3f-8d32-4566-9d66-e771c3ede4f9 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:11.590993 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0310fc-0097-470f-b606-ad40927b8afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:11.591779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0310fc-0097-470f-b606-ad40927b8afd admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:11.592062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0310fc-0097-470f-b606-ad40927b8afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:11.592328 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62daae67-e06a-47b1-8e05-45a39fcac73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:11.592473 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0310fc-0097-470f-b606-ad40927b8afd admin admin] PATH_INFO: `/v3/projects/9c334faace8d4e428935147e4247c1b3/users/31f2d947412c43b1b6336f911eae7a89/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:11.593117 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daae67-e06a-47b1-8e05-45a39fcac73b admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:11.593435 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daae67-e06a-47b1-8e05-45a39fcac73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:11.593776 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daae67-e06a-47b1-8e05-45a39fcac73b admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:11.594273 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0310fc-0097-470f-b606-ad40927b8afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c334faace8d4e428935147e4247c1b3, user_id=31f2d947412c43b1b6336f911eae7a89, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:11.594524 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62daae67-e06a-47b1-8e05-45a39fcac73b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:11.597327 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0310fc-0097-470f-b606-ad40927b8afd admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:11.597951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62daae67-e06a-47b1-8e05-45a39fcac73b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:11.613620 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1054/2093] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:11 2022] PUT /identity/v3/projects/9c334faace8d4e428935147e4247c1b3/users/31f2d947412c43b1b6336f911eae7a89/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:11.614836 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0310fc-0097-470f-b606-ad40927b8afd admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:11.626526 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1040/2094] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:11 2022] POST /identity/v3/users => generated 287 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:11.627691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62daae67-e06a-47b1-8e05-45a39fcac73b admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:11.629722 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-62daae67-e06a-47b1-8e05-45a39fcac73b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:11.638108 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:11.644580 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62daae67-e06a-47b1-8e05-45a39fcac73b admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:11.770502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0310fc-0097-470f-b606-ad40927b8afd admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:11.777490 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71fbc8-1130-48a7-80d5-4d034f777422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:11.778195 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71fbc8-1130-48a7-80d5-4d034f777422 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:11.778544 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71fbc8-1130-48a7-80d5-4d034f777422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:11.778883 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71fbc8-1130-48a7-80d5-4d034f777422 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:11.780123 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71fbc8-1130-48a7-80d5-4d034f777422 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:31:11.780123 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71fbc8-1130-48a7-80d5-4d034f777422 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:11.782089 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71fbc8-1130-48a7-80d5-4d034f777422 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:11.785162 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717acbe-7890-43fe-a58c-f9d9aa28d3e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:11.785868 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717acbe-7890-43fe-a58c-f9d9aa28d3e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:11.786219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717acbe-7890-43fe-a58c-f9d9aa28d3e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:11.786713 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717acbe-7890-43fe-a58c-f9d9aa28d3e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:11.797772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1055/2095] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:31:11.798958 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71fbc8-1130-48a7-80d5-4d034f777422 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:11.814086 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71fbc8-1130-48a7-80d5-4d034f777422 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:11.820724 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d296006-d1d5-43c9-9d31-8cc087071505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:11.821496 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d296006-d1d5-43c9-9d31-8cc087071505 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:11.821834 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d296006-d1d5-43c9-9d31-8cc087071505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:11.822182 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d296006-d1d5-43c9-9d31-8cc087071505 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:11.823039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d296006-d1d5-43c9-9d31-8cc087071505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:11.826147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d296006-d1d5-43c9-9d31-8cc087071505 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:11.840057 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1056/2096] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:11.841003 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d296006-d1d5-43c9-9d31-8cc087071505 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:11.854104 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d296006-d1d5-43c9-9d31-8cc087071505 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:11.859583 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8cf89-74d9-49fd-acc7-b99d3108d5ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:11.860722 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8cf89-74d9-49fd-acc7-b99d3108d5ba service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:11.861192 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8cf89-74d9-49fd-acc7-b99d3108d5ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:11.861464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8cf89-74d9-49fd-acc7-b99d3108d5ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:11.863604 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bee8cf89-74d9-49fd-acc7-b99d3108d5ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:11.887585 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717acbe-7890-43fe-a58c-f9d9aa28d3e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:11.889203 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717acbe-7890-43fe-a58c-f9d9aa28d3e7 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:11.893590 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:11.900576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1041/2097] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:11 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:11.901631 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717acbe-7890-43fe-a58c-f9d9aa28d3e7 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:11.918856 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717acbe-7890-43fe-a58c-f9d9aa28d3e7 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:11.931280 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e09b8-ece3-4a9f-bb72-68b54721a17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:11.932589 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e09b8-ece3-4a9f-bb72-68b54721a17e admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:11.933335 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e09b8-ece3-4a9f-bb72-68b54721a17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:11.933335 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e09b8-ece3-4a9f-bb72-68b54721a17e admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:11.934337 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e09b8-ece3-4a9f-bb72-68b54721a17e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:11.939101 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e09b8-ece3-4a9f-bb72-68b54721a17e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:11.978991 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee8cf89-74d9-49fd-acc7-b99d3108d5ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:11.982766 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee8cf89-74d9-49fd-acc7-b99d3108d5ba service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:12.005376 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1042/2098] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:11 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:12.005376 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e09b8-ece3-4a9f-bb72-68b54721a17e admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:12.005632 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1057/2099] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:12.009095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8cf89-74d9-49fd-acc7-b99d3108d5ba service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:12.033624 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8cf89-74d9-49fd-acc7-b99d3108d5ba service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:12.172221 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605b3af-0217-42ea-9eae-a0d2930f8276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:12.172851 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605b3af-0217-42ea-9eae-a0d2930f8276 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:12.173370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605b3af-0217-42ea-9eae-a0d2930f8276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:12.173734 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605b3af-0217-42ea-9eae-a0d2930f8276 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:12.174577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605b3af-0217-42ea-9eae-a0d2930f8276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:12.186275 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e09b8-ece3-4a9f-bb72-68b54721a17e admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:12.191725 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605b3af-0217-42ea-9eae-a0d2930f8276 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:12.204224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da322623-1abc-4926-8d8f-9c792e0d4380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:12.213390 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da322623-1abc-4926-8d8f-9c792e0d4380 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:12.214935 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da322623-1abc-4926-8d8f-9c792e0d4380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:12.215503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da322623-1abc-4926-8d8f-9c792e0d4380 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:12.217694 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da322623-1abc-4926-8d8f-9c792e0d4380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:12.222154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da322623-1abc-4926-8d8f-9c792e0d4380 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:12.256938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1043/2100] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:12.258915 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da322623-1abc-4926-8d8f-9c792e0d4380 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:12.264529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1058/2101] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:12 2022] POST /identity/v3/users => generated 290 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:12.265786 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605b3af-0217-42ea-9eae-a0d2930f8276 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:12.292480 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605b3af-0217-42ea-9eae-a0d2930f8276 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:12.312814 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:12.316887 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57e6c8-ec24-4ca6-a2fe-d1416cfd060d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:12.317657 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57e6c8-ec24-4ca6-a2fe-d1416cfd060d admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:12.317943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57e6c8-ec24-4ca6-a2fe-d1416cfd060d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:12.318220 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57e6c8-ec24-4ca6-a2fe-d1416cfd060d admin admin] PATH_INFO: `/v3/projects/f81d7160ee7748f7bc3a5f151591d6c4/users/9add5093067e4da990785354f686d7f2/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:12.348613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57e6c8-ec24-4ca6-a2fe-d1416cfd060d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f81d7160ee7748f7bc3a5f151591d6c4, user_id=9add5093067e4da990785354f686d7f2, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:12.352291 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57e6c8-ec24-4ca6-a2fe-d1416cfd060d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:12.359542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da322623-1abc-4926-8d8f-9c792e0d4380 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:12.364278 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cf1cf-7660-4d2a-8fb6-ffdf906d8042 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:12.365100 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cf1cf-7660-4d2a-8fb6-ffdf906d8042 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:12.365487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cf1cf-7660-4d2a-8fb6-ffdf906d8042 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:12.365890 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cf1cf-7660-4d2a-8fb6-ffdf906d8042 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:12.367881 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e90cf1cf-7660-4d2a-8fb6-ffdf906d8042 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:12.371439 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1059/2102] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:12 2022] PUT /identity/v3/projects/f81d7160ee7748f7bc3a5f151591d6c4/users/9add5093067e4da990785354f686d7f2/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:12.375836 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57e6c8-ec24-4ca6-a2fe-d1416cfd060d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:12.464316 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90cf1cf-7660-4d2a-8fb6-ffdf906d8042 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:12.465882 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90cf1cf-7660-4d2a-8fb6-ffdf906d8042 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:12.466418 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57e6c8-ec24-4ca6-a2fe-d1416cfd060d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:12.474890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539dd82-cac9-48f0-ad7d-8a63de39df03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:12.476359 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539dd82-cac9-48f0-ad7d-8a63de39df03 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:12.476742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539dd82-cac9-48f0-ad7d-8a63de39df03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:12.477353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539dd82-cac9-48f0-ad7d-8a63de39df03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:12.477461 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1044/2103] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:12 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:12.478562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1c892-8c70-42b6-82c1-90916ce16789 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:12.478886 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1c892-8c70-42b6-82c1-90916ce16789 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:12.479162 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1c892-8c70-42b6-82c1-90916ce16789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:12.486182 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539dd82-cac9-48f0-ad7d-8a63de39df03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:12.489883 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539dd82-cac9-48f0-ad7d-8a63de39df03 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:12.500880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-efd1c892-8c70-42b6-82c1-90916ce16789 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:12.502144 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-efd1c892-8c70-42b6-82c1-90916ce16789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:12.503356 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1060/2104] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:12.506033 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539dd82-cac9-48f0-ad7d-8a63de39df03 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:12.509283 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3539dd82-cac9-48f0-ad7d-8a63de39df03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:12.515405 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1045/2105] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:12.516158 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1c892-8c70-42b6-82c1-90916ce16789 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:12.528578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1c892-8c70-42b6-82c1-90916ce16789 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:12.532418 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539dd82-cac9-48f0-ad7d-8a63de39df03 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:12.534844 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8c868-3dfc-4897-abec-f96faa1a1558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:12.535425 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8c868-3dfc-4897-abec-f96faa1a1558 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:12.535707 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8c868-3dfc-4897-abec-f96faa1a1558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:12.535979 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8c868-3dfc-4897-abec-f96faa1a1558 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:12.536644 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8c868-3dfc-4897-abec-f96faa1a1558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:12.539109 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8c868-3dfc-4897-abec-f96faa1a1558 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:12.544204 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a9d2e-7431-46dc-8903-98e96e8ebc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:12.544852 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a9d2e-7431-46dc-8903-98e96e8ebc1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:12.545246 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a9d2e-7431-46dc-8903-98e96e8ebc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:12.545518 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a9d2e-7431-46dc-8903-98e96e8ebc1f admin admin] PATH_INFO: `/v3/users/fa34520ea4304e2e990709e2d8e704a3` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:12.548611 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a9d2e-7431-46dc-8903-98e96e8ebc1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa34520ea4304e2e990709e2d8e704a3)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:12.550660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a9d2e-7431-46dc-8903-98e96e8ebc1f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:12.553696 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1046/2106] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:12.554539 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8c868-3dfc-4897-abec-f96faa1a1558 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:12.556256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c8a8c868-3dfc-4897-abec-f96faa1a1558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:12.573476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:12.647785 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c07a9d2e-7431-46dc-8903-98e96e8ebc1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa34520ea4304e2e990709e2d8e704a3'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:12.665681 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c07a9d2e-7431-46dc-8903-98e96e8ebc1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa34520ea4304e2e990709e2d8e704a3'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:12.667642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c07a9d2e-7431-46dc-8903-98e96e8ebc1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa34520ea4304e2e990709e2d8e704a3'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:12.682703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8c868-3dfc-4897-abec-f96faa1a1558 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:12.687650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686bd48-354d-406e-a23f-5b18e6e2b116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:12.688384 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686bd48-354d-406e-a23f-5b18e6e2b116 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:12.688667 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686bd48-354d-406e-a23f-5b18e6e2b116 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:12.688938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686bd48-354d-406e-a23f-5b18e6e2b116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:12.691416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1686bd48-354d-406e-a23f-5b18e6e2b116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:12.697434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c07a9d2e-7431-46dc-8903-98e96e8ebc1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa34520ea4304e2e990709e2d8e704a3'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:12.707294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c07a9d2e-7431-46dc-8903-98e96e8ebc1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa34520ea4304e2e990709e2d8e704a3'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:12.707810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1686bd48-354d-406e-a23f-5b18e6e2b116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:12.710016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1686bd48-354d-406e-a23f-5b18e6e2b116 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:12.721590 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1061/2107] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:12 2022] DELETE /identity/v3/users/fa34520ea4304e2e990709e2d8e704a3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:12.722598 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a9d2e-7431-46dc-8903-98e96e8ebc1f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:12.727529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c07a9d2e-7431-46dc-8903-98e96e8ebc1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:12.731192 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1047/2108] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:12.732643 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03877e5-2f89-419f-b8b7-9b5c15f6cc51 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:12.732981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03877e5-2f89-419f-b8b7-9b5c15f6cc51 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:12.733287 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03877e5-2f89-419f-b8b7-9b5c15f6cc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:12.762104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a03877e5-2f89-419f-b8b7-9b5c15f6cc51 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:12.763426 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a03877e5-2f89-419f-b8b7-9b5c15f6cc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:12.856217 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a9d2e-7431-46dc-8903-98e96e8ebc1f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:12.869851 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7ed9f-ee1a-4c02-8b62-e244904d2175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:12.872647 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7ed9f-ee1a-4c02-8b62-e244904d2175 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:12.873808 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7ed9f-ee1a-4c02-8b62-e244904d2175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:12.874512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7ed9f-ee1a-4c02-8b62-e244904d2175 admin admin] PATH_INFO: `/v3/projects/9bc87c50cc4347aa8b118233c8ef6faf/users/781990ffdc6c4b53bbd560ae332925e7/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:12.901779 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1048/2109] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:12.907353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7ed9f-ee1a-4c02-8b62-e244904d2175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc87c50cc4347aa8b118233c8ef6faf, user_id=781990ffdc6c4b53bbd560ae332925e7, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:12.911354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7ed9f-ee1a-4c02-8b62-e244904d2175 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:12.921139 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03877e5-2f89-419f-b8b7-9b5c15f6cc51 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:12.924713 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a03877e5-2f89-419f-b8b7-9b5c15f6cc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:12.945108 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1062/2110] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:12 2022] PUT /identity/v3/projects/9bc87c50cc4347aa8b118233c8ef6faf/users/781990ffdc6c4b53bbd560ae332925e7/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:12.949483 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a46e3-daa3-4114-8d43-ee391bff1c3f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:12.952235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:12.952735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a46e3-daa3-4114-8d43-ee391bff1c3f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:12.953474 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a46e3-daa3-4114-8d43-ee391bff1c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:13.009730 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-cd2a46e3-daa3-4114-8d43-ee391bff1c3f None None] MFA Rules not processed for user `781990ffdc6c4b53bbd560ae332925e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:13.011372 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cd2a46e3-daa3-4114-8d43-ee391bff1c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:13.166747 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03877e5-2f89-419f-b8b7-9b5c15f6cc51 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:13.236961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1063/2111] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:13.239584 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085cfdd-e29b-4f62-9376-d2e24712f307 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:13.249651 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085cfdd-e29b-4f62-9376-d2e24712f307 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:13.250237 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085cfdd-e29b-4f62-9376-d2e24712f307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:13.263348 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:13.293922 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1520b06-3d28-4e1f-b231-9e2f43c15d8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:13.294473 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b085cfdd-e29b-4f62-9376-d2e24712f307 None None] MFA Rules not processed for user `31f2d947412c43b1b6336f911eae7a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:13.295478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b085cfdd-e29b-4f62-9376-d2e24712f307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:13.295942 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1520b06-3d28-4e1f-b231-9e2f43c15d8f service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:13.296399 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1520b06-3d28-4e1f-b231-9e2f43c15d8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:13.296816 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1520b06-3d28-4e1f-b231-9e2f43c15d8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:13.384559 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1520b06-3d28-4e1f-b231-9e2f43c15d8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:13.384559 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1520b06-3d28-4e1f-b231-9e2f43c15d8f service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:13.403697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1049/2112] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:13.404762 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1520b06-3d28-4e1f-b231-9e2f43c15d8f service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:13.420956 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1520b06-3d28-4e1f-b231-9e2f43c15d8f service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:13.437400 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4790c-37a7-4cbb-aca0-70997581e534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:13.438468 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4790c-37a7-4cbb-aca0-70997581e534 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:13.438848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4790c-37a7-4cbb-aca0-70997581e534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:13.439638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4790c-37a7-4cbb-aca0-70997581e534 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:13.443253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4790c-37a7-4cbb-aca0-70997581e534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:13.446776 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4790c-37a7-4cbb-aca0-70997581e534 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:13.460269 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1064/2113] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:13.473589 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e457f8-77b9-4e32-b362-61998240756f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:13.474141 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e457f8-77b9-4e32-b362-61998240756f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:13.474729 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e457f8-77b9-4e32-b362-61998240756f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:13.495941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1050/2114] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:13 2022] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:13.497650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4790c-37a7-4cbb-aca0-70997581e534 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:13.517812 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-50e457f8-77b9-4e32-b362-61998240756f None None] MFA Rules not processed for user `76f7ebd282b5468994f6158ac893a660`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:13.519376 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-50e457f8-77b9-4e32-b362-61998240756f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:13.589719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:13.614306 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4790c-37a7-4cbb-aca0-70997581e534 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:13.623266 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f1272-dbba-4fe3-b446-17ef66e99390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:13.624844 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f1272-dbba-4fe3-b446-17ef66e99390 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:13.625195 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f1272-dbba-4fe3-b446-17ef66e99390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:13.625478 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f1272-dbba-4fe3-b446-17ef66e99390 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:13.626414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f1272-dbba-4fe3-b446-17ef66e99390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:13.628721 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f1272-dbba-4fe3-b446-17ef66e99390 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:13.645232 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1065/2115] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:31:13.655779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e457f8-77b9-4e32-b362-61998240756f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:13.657525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-50e457f8-77b9-4e32-b362-61998240756f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:13.673654 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1051/2116] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:13 2022] POST /identity/v3/users => generated 296 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:13.675136 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f1272-dbba-4fe3-b446-17ef66e99390 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:13.726166 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f1272-dbba-4fe3-b446-17ef66e99390 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:13.733505 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd608f-629b-4f02-87cb-9b6f35deae4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:13.735128 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd608f-629b-4f02-87cb-9b6f35deae4b admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:13.735940 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd608f-629b-4f02-87cb-9b6f35deae4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:13.737908 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd608f-629b-4f02-87cb-9b6f35deae4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:13.739122 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd608f-629b-4f02-87cb-9b6f35deae4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:13.741615 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd608f-629b-4f02-87cb-9b6f35deae4b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:13.765381 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1052/2117] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:13.767318 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd608f-629b-4f02-87cb-9b6f35deae4b admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:13.784291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd608f-629b-4f02-87cb-9b6f35deae4b admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:13.793829 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56d14c-35ab-4efe-b1b0-090a735c0c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:13.795040 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56d14c-35ab-4efe-b1b0-090a735c0c44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:13.795439 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56d14c-35ab-4efe-b1b0-090a735c0c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:13.796242 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56d14c-35ab-4efe-b1b0-090a735c0c44 admin admin] PATH_INFO: `/v3/projects/14b2f61cfc5f4eaf9cf10eea99afa80f/users/9ba85332dcf648dda9bcc2b4cc62a485/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:13.836238 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e457f8-77b9-4e32-b362-61998240756f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:13.851363 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56d14c-35ab-4efe-b1b0-090a735c0c44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14b2f61cfc5f4eaf9cf10eea99afa80f, user_id=9ba85332dcf648dda9bcc2b4cc62a485, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:13.856422 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5c039-5228-4e93-969b-79a59390566e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:13.857959 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5c039-5228-4e93-969b-79a59390566e service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:13.858074 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56d14c-35ab-4efe-b1b0-090a735c0c44 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:13.859048 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5c039-5228-4e93-969b-79a59390566e service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:13.859918 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5c039-5228-4e93-969b-79a59390566e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:13.863870 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5ab5c039-5228-4e93-969b-79a59390566e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:13.878265 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5c039-5228-4e93-969b-79a59390566e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:13.880170 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5c039-5228-4e93-969b-79a59390566e service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:13.888946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1053/2118] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:13 2022] PUT /identity/v3/projects/14b2f61cfc5f4eaf9cf10eea99afa80f/users/9ba85332dcf648dda9bcc2b4cc62a485/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:13.893080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56d14c-35ab-4efe-b1b0-090a735c0c44 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:13.913576 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1066/2119] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:31:13.925215 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1d655-7da7-4afc-a973-55da3017147b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:13.926494 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1d655-7da7-4afc-a973-55da3017147b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:13.926991 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1d655-7da7-4afc-a973-55da3017147b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:14.004290 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a1e1d655-7da7-4afc-a973-55da3017147b None None] MFA Rules not processed for user `9add5093067e4da990785354f686d7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:14.005910 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a1e1d655-7da7-4afc-a973-55da3017147b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:14.031275 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:14.034967 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56d14c-35ab-4efe-b1b0-090a735c0c44 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:14.047551 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79d931-89fc-4c44-8341-2600ee4652fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:14.048180 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79d931-89fc-4c44-8341-2600ee4652fa admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:14.048472 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79d931-89fc-4c44-8341-2600ee4652fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:14.048904 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79d931-89fc-4c44-8341-2600ee4652fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:14.049427 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79d931-89fc-4c44-8341-2600ee4652fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:14.051054 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79d931-89fc-4c44-8341-2600ee4652fa admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:14.077833 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1054/2120] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:14.079003 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79d931-89fc-4c44-8341-2600ee4652fa admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:14.098416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79d931-89fc-4c44-8341-2600ee4652fa admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:14.109341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058f034-d22c-483f-860d-b7992558cba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:14.110028 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058f034-d22c-483f-860d-b7992558cba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:14.110312 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058f034-d22c-483f-860d-b7992558cba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:14.110593 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058f034-d22c-483f-860d-b7992558cba2 admin admin] PATH_INFO: `/v3/projects/14b2f61cfc5f4eaf9cf10eea99afa80f/users/9ba85332dcf648dda9bcc2b4cc62a485/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:14.112054 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1067/2121] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:31:14.125587 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058f034-d22c-483f-860d-b7992558cba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14b2f61cfc5f4eaf9cf10eea99afa80f, user_id=9ba85332dcf648dda9bcc2b4cc62a485, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:14.126220 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1d655-7da7-4afc-a973-55da3017147b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:14.128576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058f034-d22c-483f-860d-b7992558cba2 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:14.128952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a1e1d655-7da7-4afc-a973-55da3017147b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:14.163875 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1055/2122] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:14 2022] PUT /identity/v3/projects/14b2f61cfc5f4eaf9cf10eea99afa80f/users/9ba85332dcf648dda9bcc2b4cc62a485/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:31:14.163875 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058f034-d22c-483f-860d-b7992558cba2 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:14.163875 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e058f034-d22c-483f-860d-b7992558cba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:14.277951 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1d655-7da7-4afc-a973-55da3017147b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:14.304611 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058f034-d22c-483f-860d-b7992558cba2 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:14.320821 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128aee6a-00b8-4bd4-9984-68b9000dd53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:14.321295 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128aee6a-00b8-4bd4-9984-68b9000dd53b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:14.322703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128aee6a-00b8-4bd4-9984-68b9000dd53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:14.322703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128aee6a-00b8-4bd4-9984-68b9000dd53b admin admin] PATH_INFO: `/v3/projects/9cc6386eee264d4b976820fb0a7c5fb0` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:14.324122 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128aee6a-00b8-4bd4-9984-68b9000dd53b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cc6386eee264d4b976820fb0a7c5fb0)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:14.330986 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128aee6a-00b8-4bd4-9984-68b9000dd53b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:14.371331 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba899b3-37c1-4449-bfe1-3656b445bc3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:14.372352 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba899b3-37c1-4449-bfe1-3656b445bc3b service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:14.373500 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba899b3-37c1-4449-bfe1-3656b445bc3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:14.374610 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba899b3-37c1-4449-bfe1-3656b445bc3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:14.404990 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:14.439596 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-128aee6a-00b8-4bd4-9984-68b9000dd53b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cc6386eee264d4b976820fb0a7c5fb0', 'request_id': 'req-128aee6a-00b8-4bd4-9984-68b9000dd53b'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:14.443497 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-128aee6a-00b8-4bd4-9984-68b9000dd53b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cc6386eee264d4b976820fb0a7c5fb0', 'request_id': 'req-128aee6a-00b8-4bd4-9984-68b9000dd53b'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:14.452517 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-128aee6a-00b8-4bd4-9984-68b9000dd53b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cc6386eee264d4b976820fb0a7c5fb0', 'request_id': 'req-128aee6a-00b8-4bd4-9984-68b9000dd53b'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:14.469261 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-128aee6a-00b8-4bd4-9984-68b9000dd53b admin admin] The token cache is being invalidate because project 9cc6386eee264d4b976820fb0a7c5fb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:14.469507 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba899b3-37c1-4449-bfe1-3656b445bc3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:14.470013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-128aee6a-00b8-4bd4-9984-68b9000dd53b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:14.471031 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba899b3-37c1-4449-bfe1-3656b445bc3b service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:14.471666 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-128aee6a-00b8-4bd4-9984-68b9000dd53b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:14.474317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1056/2123] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:14 2022] DELETE /identity/v3/projects/9cc6386eee264d4b976820fb0a7c5fb0 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:14.476742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b3377-289f-4c13-9e41-57e76ed9f9c0 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:14.477211 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b3377-289f-4c13-9e41-57e76ed9f9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:14.477734 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b3377-289f-4c13-9e41-57e76ed9f9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:14.500732 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1068/2124] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:14.503869 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba899b3-37c1-4449-bfe1-3656b445bc3b service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:14.525385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba899b3-37c1-4449-bfe1-3656b445bc3b service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:14.547475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:14.547970 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-112b3377-289f-4c13-9e41-57e76ed9f9c0 None None] MFA Rules not processed for user `9ba85332dcf648dda9bcc2b4cc62a485`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:14.552925 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-112b3377-289f-4c13-9e41-57e76ed9f9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:14.647420 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2007ac3-30ae-41f8-97ca-2ae378698a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:14.648189 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2007ac3-30ae-41f8-97ca-2ae378698a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:14.648581 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2007ac3-30ae-41f8-97ca-2ae378698a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:14.649212 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2007ac3-30ae-41f8-97ca-2ae378698a13 admin admin] PATH_INFO: `/v3/users/db4ceacf140b41958fa2ce75c6459e3b` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:14.652234 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2007ac3-30ae-41f8-97ca-2ae378698a13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db4ceacf140b41958fa2ce75c6459e3b)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:14.654561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2007ac3-30ae-41f8-97ca-2ae378698a13 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:14.716985 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1057/2125] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:14 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:14.718710 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b3377-289f-4c13-9e41-57e76ed9f9c0 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:14.723267 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-112b3377-289f-4c13-9e41-57e76ed9f9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:14.756639 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a2007ac3-30ae-41f8-97ca-2ae378698a13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db4ceacf140b41958fa2ce75c6459e3b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:14.760028 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b3377-289f-4c13-9e41-57e76ed9f9c0 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:14.769482 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a2007ac3-30ae-41f8-97ca-2ae378698a13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db4ceacf140b41958fa2ce75c6459e3b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:14.770135 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a2007ac3-30ae-41f8-97ca-2ae378698a13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db4ceacf140b41958fa2ce75c6459e3b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:14.778854 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99e072-d87a-4aa8-b6e0-ba0adf63b9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:14.779544 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99e072-d87a-4aa8-b6e0-ba0adf63b9cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:14.779839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99e072-d87a-4aa8-b6e0-ba0adf63b9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:14.782498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99e072-d87a-4aa8-b6e0-ba0adf63b9cd admin admin] PATH_INFO: `/v3/users/74066ca220c8440c820728722f979f88` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:14.783322 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99e072-d87a-4aa8-b6e0-ba0adf63b9cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=74066ca220c8440c820728722f979f88)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:14.785451 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99e072-d87a-4aa8-b6e0-ba0adf63b9cd admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:14.795925 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a2007ac3-30ae-41f8-97ca-2ae378698a13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db4ceacf140b41958fa2ce75c6459e3b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:14.808705 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a2007ac3-30ae-41f8-97ca-2ae378698a13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db4ceacf140b41958fa2ce75c6459e3b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:14.821803 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1069/2126] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:14 2022] DELETE /identity/v3/users/db4ceacf140b41958fa2ce75c6459e3b => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:14.823256 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2007ac3-30ae-41f8-97ca-2ae378698a13 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:14.824810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a2007ac3-30ae-41f8-97ca-2ae378698a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:14.877090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-af99e072-d87a-4aa8-b6e0-ba0adf63b9cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74066ca220c8440c820728722f979f88'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:14.885462 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-af99e072-d87a-4aa8-b6e0-ba0adf63b9cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74066ca220c8440c820728722f979f88'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:14.895822 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-af99e072-d87a-4aa8-b6e0-ba0adf63b9cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74066ca220c8440c820728722f979f88'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:14.901049 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-af99e072-d87a-4aa8-b6e0-ba0adf63b9cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74066ca220c8440c820728722f979f88'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:14.924251 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-af99e072-d87a-4aa8-b6e0-ba0adf63b9cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74066ca220c8440c820728722f979f88'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:14.932116 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2007ac3-30ae-41f8-97ca-2ae378698a13 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:14.934618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1058/2127] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:14 2022] DELETE /identity/v3/users/74066ca220c8440c820728722f979f88 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:15.044329 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a1f73-aeda-4d1c-8f10-eac3ddfc7045 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:15.044951 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a1f73-aeda-4d1c-8f10-eac3ddfc7045 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:15.045309 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a1f73-aeda-4d1c-8f10-eac3ddfc7045 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:15.045833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a1f73-aeda-4d1c-8f10-eac3ddfc7045 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:15.048181 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c05a1f73-aeda-4d1c-8f10-eac3ddfc7045 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:15.080293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:15.153428 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a1f73-aeda-4d1c-8f10-eac3ddfc7045 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:15.155675 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a1f73-aeda-4d1c-8f10-eac3ddfc7045 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:15.168997 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1070/2128] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:15.317845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99e072-d87a-4aa8-b6e0-ba0adf63b9cd admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:15.319812 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-af99e072-d87a-4aa8-b6e0-ba0adf63b9cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:15.347893 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a1f73-aeda-4d1c-8f10-eac3ddfc7045 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:15.349451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c05a1f73-aeda-4d1c-8f10-eac3ddfc7045 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:15.367153 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:15.465035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99e072-d87a-4aa8-b6e0-ba0adf63b9cd admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:15.465921 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a1f73-aeda-4d1c-8f10-eac3ddfc7045 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:15.475733 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002024a0-5842-49ec-b3d4-4c4be208c6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:15.476393 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002024a0-5842-49ec-b3d4-4c4be208c6b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:15.476830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002024a0-5842-49ec-b3d4-4c4be208c6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:15.477131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002024a0-5842-49ec-b3d4-4c4be208c6b0 admin admin] PATH_INFO: `/v3/projects/08f21e666aca41eba8d9161b57a14e36` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:15.478328 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002024a0-5842-49ec-b3d4-4c4be208c6b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08f21e666aca41eba8d9161b57a14e36)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:15.478451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32f39d-66c0-4146-8fc3-f9a168f3f3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:15.479025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32f39d-66c0-4146-8fc3-f9a168f3f3fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:15.479305 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32f39d-66c0-4146-8fc3-f9a168f3f3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:15.479574 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32f39d-66c0-4146-8fc3-f9a168f3f3fe admin admin] PATH_INFO: `/v3/projects/0cda5891343c43c88eccf4b814f51daa` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:15.480585 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002024a0-5842-49ec-b3d4-4c4be208c6b0 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:15.480715 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32f39d-66c0-4146-8fc3-f9a168f3f3fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cda5891343c43c88eccf4b814f51daa)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:15.482660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32f39d-66c0-4146-8fc3-f9a168f3f3fe admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:15.547402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-002024a0-5842-49ec-b3d4-4c4be208c6b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08f21e666aca41eba8d9161b57a14e36', 'request_id': 'req-002024a0-5842-49ec-b3d4-4c4be208c6b0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:15.551320 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1d32f39d-66c0-4146-8fc3-f9a168f3f3fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cda5891343c43c88eccf4b814f51daa', 'request_id': 'req-1d32f39d-66c0-4146-8fc3-f9a168f3f3fe'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:15.560345 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1d32f39d-66c0-4146-8fc3-f9a168f3f3fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cda5891343c43c88eccf4b814f51daa', 'request_id': 'req-1d32f39d-66c0-4146-8fc3-f9a168f3f3fe'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:15.560578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-002024a0-5842-49ec-b3d4-4c4be208c6b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08f21e666aca41eba8d9161b57a14e36', 'request_id': 'req-002024a0-5842-49ec-b3d4-4c4be208c6b0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:15.570395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1d32f39d-66c0-4146-8fc3-f9a168f3f3fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cda5891343c43c88eccf4b814f51daa', 'request_id': 'req-1d32f39d-66c0-4146-8fc3-f9a168f3f3fe'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:15.571268 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-002024a0-5842-49ec-b3d4-4c4be208c6b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08f21e666aca41eba8d9161b57a14e36', 'request_id': 'req-002024a0-5842-49ec-b3d4-4c4be208c6b0'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:15.586480 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-002024a0-5842-49ec-b3d4-4c4be208c6b0 admin admin] The token cache is being invalidate because project 08f21e666aca41eba8d9161b57a14e36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:15.586782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-002024a0-5842-49ec-b3d4-4c4be208c6b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:15.587573 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-002024a0-5842-49ec-b3d4-4c4be208c6b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:15.589431 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1059/2129] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:15 2022] DELETE /identity/v3/projects/08f21e666aca41eba8d9161b57a14e36 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:15.589738 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1d32f39d-66c0-4146-8fc3-f9a168f3f3fe admin admin] The token cache is being invalidate because project 0cda5891343c43c88eccf4b814f51daa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:15.590098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1d32f39d-66c0-4146-8fc3-f9a168f3f3fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:15.591159 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-1d32f39d-66c0-4146-8fc3-f9a168f3f3fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:15.592939 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1071/2130] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:15 2022] DELETE /identity/v3/projects/0cda5891343c43c88eccf4b814f51daa => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:31:15.594737 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a345ec-bcb0-44a8-b1e8-699b2001584b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:15.595923 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a345ec-bcb0-44a8-b1e8-699b2001584b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:15.595923 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a345ec-bcb0-44a8-b1e8-699b2001584b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:15.598391 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e978f-07b2-4a91-9598-27d1ec9d16cc None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:15.598773 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e978f-07b2-4a91-9598-27d1ec9d16cc None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:15.599695 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e978f-07b2-4a91-9598-27d1ec9d16cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:15.623448 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-06a345ec-bcb0-44a8-b1e8-699b2001584b None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:15.624622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-085e978f-07b2-4a91-9598-27d1ec9d16cc None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:15.624748 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-06a345ec-bcb0-44a8-b1e8-699b2001584b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:15.626696 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-085e978f-07b2-4a91-9598-27d1ec9d16cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:15.670236 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:15.717368 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1072/2131] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:15.722740 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e978f-07b2-4a91-9598-27d1ec9d16cc None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:15.724206 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-085e978f-07b2-4a91-9598-27d1ec9d16cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:15.726211 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1060/2132] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:15.731878 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348913e-2464-42a5-a207-b4ec417d98b6 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:15.732575 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348913e-2464-42a5-a207-b4ec417d98b6 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:15.733067 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348913e-2464-42a5-a207-b4ec417d98b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:15.739196 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e978f-07b2-4a91-9598-27d1ec9d16cc None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:15.745334 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdf570-3d54-4b93-a7c4-5ad5034f829f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:15.746053 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdf570-3d54-4b93-a7c4-5ad5034f829f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:15.746409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdf570-3d54-4b93-a7c4-5ad5034f829f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:15.746770 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdf570-3d54-4b93-a7c4-5ad5034f829f admin admin] PATH_INFO: `/v3/users/781990ffdc6c4b53bbd560ae332925e7` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:15.748053 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdf570-3d54-4b93-a7c4-5ad5034f829f admin admin] RBAC: Authorizing `identity:delete_user(user_id=781990ffdc6c4b53bbd560ae332925e7)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:15.752339 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdf570-3d54-4b93-a7c4-5ad5034f829f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:15.759242 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-d348913e-2464-42a5-a207-b4ec417d98b6 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:15.760869 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d348913e-2464-42a5-a207-b4ec417d98b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:15.774677 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1061/2133] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:15.776267 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f95b3-7a8c-4049-8c00-de8b35456a6d None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:15.776738 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f95b3-7a8c-4049-8c00-de8b35456a6d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:15.777209 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f95b3-7a8c-4049-8c00-de8b35456a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:15.802755 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-e28f95b3-7a8c-4049-8c00-de8b35456a6d None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:15.805291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e28f95b3-7a8c-4049-8c00-de8b35456a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:15.813765 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1062/2134] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:15.814461 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f95b3-7a8c-4049-8c00-de8b35456a6d None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:15.815735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4dbdf570-3d54-4b93-a7c4-5ad5034f829f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '781990ffdc6c4b53bbd560ae332925e7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:15.825751 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f95b3-7a8c-4049-8c00-de8b35456a6d None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:15.826642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4dbdf570-3d54-4b93-a7c4-5ad5034f829f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '781990ffdc6c4b53bbd560ae332925e7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:15.827821 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4dbdf570-3d54-4b93-a7c4-5ad5034f829f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '781990ffdc6c4b53bbd560ae332925e7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:15.833826 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1c28a-4378-4d94-b3f0-d3c130f59b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:15.834643 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1c28a-4378-4d94-b3f0-d3c130f59b1a admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:15.834943 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1c28a-4378-4d94-b3f0-d3c130f59b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:15.835215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1c28a-4378-4d94-b3f0-d3c130f59b1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:15.836222 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1c28a-4378-4d94-b3f0-d3c130f59b1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:31:15.836532 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1c28a-4378-4d94-b3f0-d3c130f59b1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:15.838445 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1c28a-4378-4d94-b3f0-d3c130f59b1a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:15.844695 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4dbdf570-3d54-4b93-a7c4-5ad5034f829f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '781990ffdc6c4b53bbd560ae332925e7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:15.856117 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4dbdf570-3d54-4b93-a7c4-5ad5034f829f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '781990ffdc6c4b53bbd560ae332925e7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:15.856284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1063/2135] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:31:15.857323 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1c28a-4378-4d94-b3f0-d3c130f59b1a admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:15.859865 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-dbf1c28a-4378-4d94-b3f0-d3c130f59b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:15.871464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1073/2136] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:15 2022] DELETE /identity/v3/users/781990ffdc6c4b53bbd560ae332925e7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:31:15.872277 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdf570-3d54-4b93-a7c4-5ad5034f829f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:15.873681 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4dbdf570-3d54-4b93-a7c4-5ad5034f829f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:15.876319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1c28a-4378-4d94-b3f0-d3c130f59b1a admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:15.894997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:15.950952 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aff73e-cd12-40a1-8b92-55ec9628e445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:15.951746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aff73e-cd12-40a1-8b92-55ec9628e445 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:15.952025 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aff73e-cd12-40a1-8b92-55ec9628e445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:15.952296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aff73e-cd12-40a1-8b92-55ec9628e445 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:15.952947 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aff73e-cd12-40a1-8b92-55ec9628e445 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:31:15.953312 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aff73e-cd12-40a1-8b92-55ec9628e445 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:15.954943 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aff73e-cd12-40a1-8b92-55ec9628e445 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:15.960614 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdf570-3d54-4b93-a7c4-5ad5034f829f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:15.970946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d5cd3-6c33-4294-9206-c947d5eb5c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:15.971733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d5cd3-6c33-4294-9206-c947d5eb5c86 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:15.972107 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d5cd3-6c33-4294-9206-c947d5eb5c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:15.972475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d5cd3-6c33-4294-9206-c947d5eb5c86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:15.973382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d5cd3-6c33-4294-9206-c947d5eb5c86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:15.978610 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d5cd3-6c33-4294-9206-c947d5eb5c86 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:15.982079 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1064/2137] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:31:15.985595 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0392049-5669-4d82-a0c3-297e3281375a None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:15.987390 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0392049-5669-4d82-a0c3-297e3281375a None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:15.987670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0392049-5669-4d82-a0c3-297e3281375a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:16.013304 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1074/2138] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:15 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:16.014146 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d5cd3-6c33-4294-9206-c947d5eb5c86 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:16.020605 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-f0392049-5669-4d82-a0c3-297e3281375a None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:16.022487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f0392049-5669-4d82-a0c3-297e3281375a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:16.071536 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:16.117407 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1065/2139] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:16.118336 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0392049-5669-4d82-a0c3-297e3281375a None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:16.127178 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d5cd3-6c33-4294-9206-c947d5eb5c86 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:16.132848 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34606a95-f756-4059-8033-d8d74b930258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:16.133766 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34606a95-f756-4059-8033-d8d74b930258 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:16.134050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34606a95-f756-4059-8033-d8d74b930258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:16.134324 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34606a95-f756-4059-8033-d8d74b930258 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:16.134955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34606a95-f756-4059-8033-d8d74b930258 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:16.136488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0392049-5669-4d82-a0c3-297e3281375a None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:16.136879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34606a95-f756-4059-8033-d8d74b930258 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:16.141221 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac12a80-7b9d-4414-aa5b-8efe4f37d987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:16.141845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac12a80-7b9d-4414-aa5b-8efe4f37d987 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:16.142128 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac12a80-7b9d-4414-aa5b-8efe4f37d987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:16.142402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac12a80-7b9d-4414-aa5b-8efe4f37d987 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:16.143517 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac12a80-7b9d-4414-aa5b-8efe4f37d987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:16.144981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac12a80-7b9d-4414-aa5b-8efe4f37d987 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:16.165891 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1075/2140] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:16 2022] POST /identity/v3/projects => generated 393 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:16.166740 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34606a95-f756-4059-8033-d8d74b930258 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:16.168330 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-34606a95-f756-4059-8033-d8d74b930258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:16.169243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1066/2141] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:16 2022] POST /identity/v3/users => generated 293 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:16.172213 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a533353-ae48-45ac-a8cd-0acc26e673f3 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:16.172213 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a533353-ae48-45ac-a8cd-0acc26e673f3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:16.172213 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a533353-ae48-45ac-a8cd-0acc26e673f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:16.190307 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-6a533353-ae48-45ac-a8cd-0acc26e673f3 None None] MFA Rules not processed for user `9add5093067e4da990785354f686d7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:16.191679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6a533353-ae48-45ac-a8cd-0acc26e673f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:16.231111 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34606a95-f756-4059-8033-d8d74b930258 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:16.235947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27086224-a49d-4e62-9907-dcb28effb57e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:16.236549 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27086224-a49d-4e62-9907-dcb28effb57e service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:16.236825 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27086224-a49d-4e62-9907-dcb28effb57e service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:16.237242 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27086224-a49d-4e62-9907-dcb28effb57e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:16.255439 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1067/2142] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:16.255439 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a533353-ae48-45ac-a8cd-0acc26e673f3 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:16.316245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27086224-a49d-4e62-9907-dcb28effb57e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:16.318024 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27086224-a49d-4e62-9907-dcb28effb57e service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:16.325691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:16.334821 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1076/2143] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:16.335847 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27086224-a49d-4e62-9907-dcb28effb57e service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:16.346478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27086224-a49d-4e62-9907-dcb28effb57e service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:16.352850 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea79f33-1c9a-45fd-ac92-b70c5b5835b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:16.353595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea79f33-1c9a-45fd-ac92-b70c5b5835b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:16.353891 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea79f33-1c9a-45fd-ac92-b70c5b5835b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:16.354167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea79f33-1c9a-45fd-ac92-b70c5b5835b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:16.354825 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea79f33-1c9a-45fd-ac92-b70c5b5835b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:16.356865 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea79f33-1c9a-45fd-ac92-b70c5b5835b1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:16.372152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1077/2144] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:16.376865 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea79f33-1c9a-45fd-ac92-b70c5b5835b1 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:16.397786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a533353-ae48-45ac-a8cd-0acc26e673f3 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:16.400342 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea79f33-1c9a-45fd-ac92-b70c5b5835b1 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:16.403669 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780e426-9c27-499a-b447-3b88bbf39412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:16.404467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780e426-9c27-499a-b447-3b88bbf39412 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:16.404896 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780e426-9c27-499a-b447-3b88bbf39412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:16.405465 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780e426-9c27-499a-b447-3b88bbf39412 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:16.406412 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780e426-9c27-499a-b447-3b88bbf39412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:16.407826 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c596cc-60a7-4194-aa18-5ea3206d318d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:16.408546 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c596cc-60a7-4194-aa18-5ea3206d318d admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:16.408835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c596cc-60a7-4194-aa18-5ea3206d318d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:16.409155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c596cc-60a7-4194-aa18-5ea3206d318d admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:16.410035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780e426-9c27-499a-b447-3b88bbf39412 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:16.410240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c596cc-60a7-4194-aa18-5ea3206d318d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:16.413064 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c596cc-60a7-4194-aa18-5ea3206d318d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:16.431170 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1078/2145] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:31:16.435841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c596cc-60a7-4194-aa18-5ea3206d318d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:16.439882 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1068/2146] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:16 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:16.447157 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780e426-9c27-499a-b447-3b88bbf39412 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:16.448716 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c596cc-60a7-4194-aa18-5ea3206d318d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:16.456025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a1372-a248-44bf-a7e7-f6563b44ce92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:16.456704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a1372-a248-44bf-a7e7-f6563b44ce92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:16.457046 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a1372-a248-44bf-a7e7-f6563b44ce92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:16.457334 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a1372-a248-44bf-a7e7-f6563b44ce92 admin admin] PATH_INFO: `/v3/projects/f9200e419f2948a089bb32442942a7c3/users/d6f8e71e47754c1fb395de995dd08217/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:16.463906 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780e426-9c27-499a-b447-3b88bbf39412 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:16.477690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40b814-8b91-42ee-90f6-d1bdaef3e483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:16.478318 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40b814-8b91-42ee-90f6-d1bdaef3e483 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:16.478605 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40b814-8b91-42ee-90f6-d1bdaef3e483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:16.478880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40b814-8b91-42ee-90f6-d1bdaef3e483 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:16.480777 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a1372-a248-44bf-a7e7-f6563b44ce92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9200e419f2948a089bb32442942a7c3, user_id=d6f8e71e47754c1fb395de995dd08217, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:16.481116 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40b814-8b91-42ee-90f6-d1bdaef3e483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:16.485609 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40b814-8b91-42ee-90f6-d1bdaef3e483 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:16.485946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a1372-a248-44bf-a7e7-f6563b44ce92 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:16.504424 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1069/2147] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:31:16.509907 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40b814-8b91-42ee-90f6-d1bdaef3e483 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:16.511015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1079/2148] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:16 2022] PUT /identity/v3/projects/f9200e419f2948a089bb32442942a7c3/users/d6f8e71e47754c1fb395de995dd08217/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:31:16.529368 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40b814-8b91-42ee-90f6-d1bdaef3e483 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:16.531326 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36384bea-e6d2-4383-8e56-b31c888d013e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:16.532199 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36384bea-e6d2-4383-8e56-b31c888d013e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:16.532614 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36384bea-e6d2-4383-8e56-b31c888d013e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:16.588662 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-36384bea-e6d2-4383-8e56-b31c888d013e None None] MFA Rules not processed for user `d6f8e71e47754c1fb395de995dd08217`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:16.590491 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-36384bea-e6d2-4383-8e56-b31c888d013e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:16.611058 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:16.633377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300b93d-a314-45ff-b87b-313175d2c1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:16.634017 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300b93d-a314-45ff-b87b-313175d2c1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:16.634423 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300b93d-a314-45ff-b87b-313175d2c1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:16.634718 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300b93d-a314-45ff-b87b-313175d2c1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:16.635611 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300b93d-a314-45ff-b87b-313175d2c1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:16.638151 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300b93d-a314-45ff-b87b-313175d2c1d1 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:16.654100 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1070/2149] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:16.659530 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300b93d-a314-45ff-b87b-313175d2c1d1 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:16.676813 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300b93d-a314-45ff-b87b-313175d2c1d1 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:16.682496 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caecf4b-fb9b-4a4a-8f77-c80184ff223f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:16.683145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caecf4b-fb9b-4a4a-8f77-c80184ff223f admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:16.683970 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caecf4b-fb9b-4a4a-8f77-c80184ff223f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:16.683970 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caecf4b-fb9b-4a4a-8f77-c80184ff223f admin admin] PATH_INFO: `/v3/projects/f3310fae1a8b4eb2a3a16eef007cf57b/users/2d8ebcd7b7cc43ad87dfff3d91a4d679/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:16.702608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caecf4b-fb9b-4a4a-8f77-c80184ff223f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3310fae1a8b4eb2a3a16eef007cf57b, user_id=2d8ebcd7b7cc43ad87dfff3d91a4d679, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:16.705691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caecf4b-fb9b-4a4a-8f77-c80184ff223f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:16.724784 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1071/2150] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:16 2022] PUT /identity/v3/projects/f3310fae1a8b4eb2a3a16eef007cf57b/users/2d8ebcd7b7cc43ad87dfff3d91a4d679/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:16.732296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b60847-aad0-4bbb-9f4d-b27ba7ad9ef1 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:16.732794 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b60847-aad0-4bbb-9f4d-b27ba7ad9ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:16.733303 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b60847-aad0-4bbb-9f4d-b27ba7ad9ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:16.738633 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1080/2151] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:16.743158 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36384bea-e6d2-4383-8e56-b31c888d013e None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:16.755901 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36384bea-e6d2-4383-8e56-b31c888d013e None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:16.757469 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-38b60847-aad0-4bbb-9f4d-b27ba7ad9ef1 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:16.758553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-38b60847-aad0-4bbb-9f4d-b27ba7ad9ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:16.869559 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7f3cd-2b32-4858-af7e-d307ca72868f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:16.870947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7f3cd-2b32-4858-af7e-d307ca72868f admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:16.871250 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7f3cd-2b32-4858-af7e-d307ca72868f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:16.871610 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7f3cd-2b32-4858-af7e-d307ca72868f admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:16.872153 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7f3cd-2b32-4858-af7e-d307ca72868f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:16.874583 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7f3cd-2b32-4858-af7e-d307ca72868f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:16.876859 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1072/2152] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:16.882558 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b60847-aad0-4bbb-9f4d-b27ba7ad9ef1 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:16.884229 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-38b60847-aad0-4bbb-9f4d-b27ba7ad9ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:16.899282 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b60847-aad0-4bbb-9f4d-b27ba7ad9ef1 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:16.906123 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eccb45-c06c-495e-bb20-9c5243c506e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:16.906904 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eccb45-c06c-495e-bb20-9c5243c506e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:16.907253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eccb45-c06c-495e-bb20-9c5243c506e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:16.907560 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eccb45-c06c-495e-bb20-9c5243c506e4 admin admin] PATH_INFO: `/v3/projects/9bc87c50cc4347aa8b118233c8ef6faf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:16.911271 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1081/2153] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:16 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:31:16.911411 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eccb45-c06c-495e-bb20-9c5243c506e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bc87c50cc4347aa8b118233c8ef6faf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:16.911509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7f3cd-2b32-4858-af7e-d307ca72868f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:16.912655 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eccb45-c06c-495e-bb20-9c5243c506e4 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:16.981883 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:17.003936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7f3cd-2b32-4858-af7e-d307ca72868f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:17.014654 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-05eccb45-c06c-495e-bb20-9c5243c506e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bc87c50cc4347aa8b118233c8ef6faf', 'request_id': 'req-05eccb45-c06c-495e-bb20-9c5243c506e4'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:17.027215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-05eccb45-c06c-495e-bb20-9c5243c506e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bc87c50cc4347aa8b118233c8ef6faf', 'request_id': 'req-05eccb45-c06c-495e-bb20-9c5243c506e4'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:17.038331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-05eccb45-c06c-495e-bb20-9c5243c506e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bc87c50cc4347aa8b118233c8ef6faf', 'request_id': 'req-05eccb45-c06c-495e-bb20-9c5243c506e4'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:17.057362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-05eccb45-c06c-495e-bb20-9c5243c506e4 admin admin] The token cache is being invalidate because project 9bc87c50cc4347aa8b118233c8ef6faf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:17.057923 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-05eccb45-c06c-495e-bb20-9c5243c506e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:17.059193 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-05eccb45-c06c-495e-bb20-9c5243c506e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:17.061253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1073/2154] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:16 2022] DELETE /identity/v3/projects/9bc87c50cc4347aa8b118233c8ef6faf => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:17.063569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eccb45-c06c-495e-bb20-9c5243c506e4 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:17.063841 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-05eccb45-c06c-495e-bb20-9c5243c506e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:17.084070 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306c6a3-d625-40ce-a14d-cea2990386a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:17.084776 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306c6a3-d625-40ce-a14d-cea2990386a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:17.085166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306c6a3-d625-40ce-a14d-cea2990386a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:17.085543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306c6a3-d625-40ce-a14d-cea2990386a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:17.087474 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0306c6a3-d625-40ce-a14d-cea2990386a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:17.096243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:17.172603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eccb45-c06c-495e-bb20-9c5243c506e4 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:17.178990 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20a155-1bf6-4803-a392-fe79dc1525cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:17.179761 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20a155-1bf6-4803-a392-fe79dc1525cb admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:17.180421 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20a155-1bf6-4803-a392-fe79dc1525cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:17.180705 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20a155-1bf6-4803-a392-fe79dc1525cb admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:17.181740 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20a155-1bf6-4803-a392-fe79dc1525cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:17.187282 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20a155-1bf6-4803-a392-fe79dc1525cb admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:17.201415 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306c6a3-d625-40ce-a14d-cea2990386a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:17.203712 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306c6a3-d625-40ce-a14d-cea2990386a1 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:17.221431 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1082/2155] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:17.222583 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306c6a3-d625-40ce-a14d-cea2990386a1 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:17.225478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0306c6a3-d625-40ce-a14d-cea2990386a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:17.225721 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1074/2156] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:17 2022] POST /identity/v3/users => generated 299 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:17.230096 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20a155-1bf6-4803-a392-fe79dc1525cb admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:17.241929 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306c6a3-d625-40ce-a14d-cea2990386a1 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:17.252748 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20a155-1bf6-4803-a392-fe79dc1525cb admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:17.261289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247e232-9e38-4735-bece-254df73df95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:17.261956 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247e232-9e38-4735-bece-254df73df95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:17.262295 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247e232-9e38-4735-bece-254df73df95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:17.262577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247e232-9e38-4735-bece-254df73df95f admin admin] PATH_INFO: `/v3/users/9ba85332dcf648dda9bcc2b4cc62a485` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:17.263746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247e232-9e38-4735-bece-254df73df95f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ba85332dcf648dda9bcc2b4cc62a485)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:17.265559 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830e831-bee1-4175-ba95-b2265c8c26c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:17.265888 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247e232-9e38-4735-bece-254df73df95f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:17.267025 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830e831-bee1-4175-ba95-b2265c8c26c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:17.267317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830e831-bee1-4175-ba95-b2265c8c26c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:17.267594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830e831-bee1-4175-ba95-b2265c8c26c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:17.268259 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830e831-bee1-4175-ba95-b2265c8c26c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:17.274772 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830e831-bee1-4175-ba95-b2265c8c26c2 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:17.308999 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1075/2157] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:31:17.313517 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830e831-bee1-4175-ba95-b2265c8c26c2 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:17.327844 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830e831-bee1-4175-ba95-b2265c8c26c2 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:17.339779 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0fe81-0f92-4c31-97fb-edf81dbd511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:17.340451 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0fe81-0f92-4c31-97fb-edf81dbd511d admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:17.340734 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0fe81-0f92-4c31-97fb-edf81dbd511d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:17.341010 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0fe81-0f92-4c31-97fb-edf81dbd511d admin admin] PATH_INFO: `/v3/projects/967d3cb44c1d4d0ead9d9a0d7de79cbf/users/1dc6a697d4ff42f2b1db149f02dc751c/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:17.370596 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0fe81-0f92-4c31-97fb-edf81dbd511d admin admin] RBAC: Authorizing `identity:create_grant(project_id=967d3cb44c1d4d0ead9d9a0d7de79cbf, user_id=1dc6a697d4ff42f2b1db149f02dc751c, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:17.374773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0fe81-0f92-4c31-97fb-edf81dbd511d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:17.379381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9247e232-9e38-4735-bece-254df73df95f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ba85332dcf648dda9bcc2b4cc62a485'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:17.397128 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9247e232-9e38-4735-bece-254df73df95f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ba85332dcf648dda9bcc2b4cc62a485'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:17.397992 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9247e232-9e38-4735-bece-254df73df95f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ba85332dcf648dda9bcc2b4cc62a485'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:17.413627 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1076/2158] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:17 2022] PUT /identity/v3/projects/967d3cb44c1d4d0ead9d9a0d7de79cbf/users/1dc6a697d4ff42f2b1db149f02dc751c/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:17.415368 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9247e232-9e38-4735-bece-254df73df95f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ba85332dcf648dda9bcc2b4cc62a485'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:17.423727 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9247e232-9e38-4735-bece-254df73df95f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ba85332dcf648dda9bcc2b4cc62a485'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:17.431031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0fe81-0f92-4c31-97fb-edf81dbd511d admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:17.433091 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1083/2159] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:17 2022] DELETE /identity/v3/users/9ba85332dcf648dda9bcc2b4cc62a485 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:17.438936 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-11a0fe81-0f92-4c31-97fb-edf81dbd511d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:17.442414 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247e232-9e38-4735-bece-254df73df95f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:17.445290 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9247e232-9e38-4735-bece-254df73df95f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:17.544012 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247e232-9e38-4735-bece-254df73df95f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:17.555243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0fe81-0f92-4c31-97fb-edf81dbd511d admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:17.563569 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885f973-dd38-43d3-a9ce-f70d89ac4b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:17.565208 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885f973-dd38-43d3-a9ce-f70d89ac4b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:17.566498 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885f973-dd38-43d3-a9ce-f70d89ac4b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:17.567275 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885f973-dd38-43d3-a9ce-f70d89ac4b5e admin admin] PATH_INFO: `/v3/users/398800a4690e41459ebe59d3bc44d985` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:17.570664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885f973-dd38-43d3-a9ce-f70d89ac4b5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=398800a4690e41459ebe59d3bc44d985)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:17.572750 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93eeba-c7a0-4a65-8f48-52b011be163b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:17.574103 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93eeba-c7a0-4a65-8f48-52b011be163b admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:17.574411 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93eeba-c7a0-4a65-8f48-52b011be163b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:17.574691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93eeba-c7a0-4a65-8f48-52b011be163b admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:17.577429 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93eeba-c7a0-4a65-8f48-52b011be163b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:17.580439 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93eeba-c7a0-4a65-8f48-52b011be163b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:17.588848 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885f973-dd38-43d3-a9ce-f70d89ac4b5e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:17.603968 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1077/2160] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:17.607785 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93eeba-c7a0-4a65-8f48-52b011be163b admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:17.615041 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:17.633987 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93eeba-c7a0-4a65-8f48-52b011be163b admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:17.651269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527de86e-535a-4526-a2f0-354e270f5da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:17.652086 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527de86e-535a-4526-a2f0-354e270f5da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:17.652376 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527de86e-535a-4526-a2f0-354e270f5da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:17.652644 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527de86e-535a-4526-a2f0-354e270f5da1 admin admin] PATH_INFO: `/v3/projects/967d3cb44c1d4d0ead9d9a0d7de79cbf/users/1dc6a697d4ff42f2b1db149f02dc751c/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:17.660703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527de86e-535a-4526-a2f0-354e270f5da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=967d3cb44c1d4d0ead9d9a0d7de79cbf, user_id=1dc6a697d4ff42f2b1db149f02dc751c, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:17.663868 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527de86e-535a-4526-a2f0-354e270f5da1 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:17.665847 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9885f973-dd38-43d3-a9ce-f70d89ac4b5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '398800a4690e41459ebe59d3bc44d985'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:17.668545 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:17.683270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1078/2161] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:17 2022] PUT /identity/v3/projects/967d3cb44c1d4d0ead9d9a0d7de79cbf/users/1dc6a697d4ff42f2b1db149f02dc751c/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:17.692594 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9885f973-dd38-43d3-a9ce-f70d89ac4b5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '398800a4690e41459ebe59d3bc44d985'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:17.693876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9885f973-dd38-43d3-a9ce-f70d89ac4b5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '398800a4690e41459ebe59d3bc44d985'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:17.700032 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ac0ed-7c27-443f-a548-dedca260595b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:17.700357 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ac0ed-7c27-443f-a548-dedca260595b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:17.700635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ac0ed-7c27-443f-a548-dedca260595b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:17.747360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9885f973-dd38-43d3-a9ce-f70d89ac4b5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '398800a4690e41459ebe59d3bc44d985'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:17.769340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-9885f973-dd38-43d3-a9ce-f70d89ac4b5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '398800a4690e41459ebe59d3bc44d985'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:17.779961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1084/2162] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:17 2022] DELETE /identity/v3/users/398800a4690e41459ebe59d3bc44d985 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:17.794030 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944eef47-e91d-4129-89fa-1869e6ddc3ce None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:17.794610 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944eef47-e91d-4129-89fa-1869e6ddc3ce None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:17.795137 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944eef47-e91d-4129-89fa-1869e6ddc3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:17.798649 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-057ac0ed-7c27-443f-a548-dedca260595b None None] MFA Rules not processed for user `1dc6a697d4ff42f2b1db149f02dc751c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:17.800503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-057ac0ed-7c27-443f-a548-dedca260595b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:17.828817 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-944eef47-e91d-4129-89fa-1869e6ddc3ce None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:17.830215 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-944eef47-e91d-4129-89fa-1869e6ddc3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:17.910817 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1079/2163] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:17.911698 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ac0ed-7c27-443f-a548-dedca260595b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:17.913762 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-057ac0ed-7c27-443f-a548-dedca260595b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:17.930658 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1085/2164] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:17.930658 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944eef47-e91d-4129-89fa-1869e6ddc3ce None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:17.931154 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-944eef47-e91d-4129-89fa-1869e6ddc3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:18.015834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ac0ed-7c27-443f-a548-dedca260595b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:18.022905 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd5da4-08a2-4882-b3e1-bc559a84ae9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:18.023765 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd5da4-08a2-4882-b3e1-bc559a84ae9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:18.024078 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd5da4-08a2-4882-b3e1-bc559a84ae9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:18.024393 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd5da4-08a2-4882-b3e1-bc559a84ae9e admin admin] PATH_INFO: `/v3/projects/14b2f61cfc5f4eaf9cf10eea99afa80f` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:18.025779 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd5da4-08a2-4882-b3e1-bc559a84ae9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=14b2f61cfc5f4eaf9cf10eea99afa80f)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:18.027976 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd5da4-08a2-4882-b3e1-bc559a84ae9e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:18.031689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944eef47-e91d-4129-89fa-1869e6ddc3ce None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:18.035990 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2836f9-ea02-497d-bf59-bb6df4cfdc96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:18.036609 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2836f9-ea02-497d-bf59-bb6df4cfdc96 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:18.037190 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2836f9-ea02-497d-bf59-bb6df4cfdc96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:18.037472 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2836f9-ea02-497d-bf59-bb6df4cfdc96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:18.039680 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7b2836f9-ea02-497d-bf59-bb6df4cfdc96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:18.088029 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6cbd5da4-08a2-4882-b3e1-bc559a84ae9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14b2f61cfc5f4eaf9cf10eea99afa80f', 'request_id': 'req-6cbd5da4-08a2-4882-b3e1-bc559a84ae9e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:18.095520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6cbd5da4-08a2-4882-b3e1-bc559a84ae9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14b2f61cfc5f4eaf9cf10eea99afa80f', 'request_id': 'req-6cbd5da4-08a2-4882-b3e1-bc559a84ae9e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:18.106556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:18.108347 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6cbd5da4-08a2-4882-b3e1-bc559a84ae9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14b2f61cfc5f4eaf9cf10eea99afa80f', 'request_id': 'req-6cbd5da4-08a2-4882-b3e1-bc559a84ae9e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:18.121407 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2836f9-ea02-497d-bf59-bb6df4cfdc96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:18.123300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2836f9-ea02-497d-bf59-bb6df4cfdc96 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:18.132881 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6cbd5da4-08a2-4882-b3e1-bc559a84ae9e admin admin] The token cache is being invalidate because project 14b2f61cfc5f4eaf9cf10eea99afa80f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:18.133948 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6cbd5da4-08a2-4882-b3e1-bc559a84ae9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:18.136119 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-6cbd5da4-08a2-4882-b3e1-bc559a84ae9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:18.138617 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1086/2165] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:18.139315 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1080/2166] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:17 2022] DELETE /identity/v3/projects/14b2f61cfc5f4eaf9cf10eea99afa80f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:18.139653 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2836f9-ea02-497d-bf59-bb6df4cfdc96 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:18.143880 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7b2836f9-ea02-497d-bf59-bb6df4cfdc96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:18.160890 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba2bd2-62ea-4845-a95f-0b0b07ccef80 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:18.161322 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba2bd2-62ea-4845-a95f-0b0b07ccef80 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:18.162653 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba2bd2-62ea-4845-a95f-0b0b07ccef80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:18.210668 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-40ba2bd2-62ea-4845-a95f-0b0b07ccef80 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:18.212238 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-40ba2bd2-62ea-4845-a95f-0b0b07ccef80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:18.223816 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:18.314887 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2836f9-ea02-497d-bf59-bb6df4cfdc96 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:18.353945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1081/2167] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:18.366502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd82d0a-9a3c-42cf-8c7d-fdb10935fa6d None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:18.366724 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd82d0a-9a3c-42cf-8c7d-fdb10935fa6d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:18.366964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd82d0a-9a3c-42cf-8c7d-fdb10935fa6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:18.396213 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-5fd82d0a-9a3c-42cf-8c7d-fdb10935fa6d None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:18.398061 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5fd82d0a-9a3c-42cf-8c7d-fdb10935fa6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:18.413082 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1082/2168] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:18.414758 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd82d0a-9a3c-42cf-8c7d-fdb10935fa6d None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:18.432022 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd82d0a-9a3c-42cf-8c7d-fdb10935fa6d None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:18.439118 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca34838-5b29-4593-9a75-ac818f2b4f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:18.447779 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca34838-5b29-4593-9a75-ac818f2b4f3a admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:18.454302 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca34838-5b29-4593-9a75-ac818f2b4f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:18.454600 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca34838-5b29-4593-9a75-ac818f2b4f3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:18.455872 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca34838-5b29-4593-9a75-ac818f2b4f3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:31:18.455872 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca34838-5b29-4593-9a75-ac818f2b4f3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:18.456099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e572eda-0630-4ff8-8578-36e676e0ba8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:18.457047 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e572eda-0630-4ff8-8578-36e676e0ba8f service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:18.459567 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e572eda-0630-4ff8-8578-36e676e0ba8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:18.459956 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e572eda-0630-4ff8-8578-36e676e0ba8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:18.467699 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4e572eda-0630-4ff8-8578-36e676e0ba8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:18.472141 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca34838-5b29-4593-9a75-ac818f2b4f3a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:18.493321 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1083/2169] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:31:18.496041 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca34838-5b29-4593-9a75-ac818f2b4f3a admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:18.496647 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e572eda-0630-4ff8-8578-36e676e0ba8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:18.498566 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e572eda-0630-4ff8-8578-36e676e0ba8f service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:18.513067 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca34838-5b29-4593-9a75-ac818f2b4f3a admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:18.523361 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33e385-e8ed-4178-8be3-020c28abe641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:18.524152 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33e385-e8ed-4178-8be3-020c28abe641 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:18.524535 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33e385-e8ed-4178-8be3-020c28abe641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:18.524903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33e385-e8ed-4178-8be3-020c28abe641 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:18.525961 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33e385-e8ed-4178-8be3-020c28abe641 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:18.528865 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c33e385-e8ed-4178-8be3-020c28abe641 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:18.533906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1087/2170] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:18.572612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1084/2171] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:18 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:18.576342 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e572eda-0630-4ff8-8578-36e676e0ba8f service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:18.588078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e572eda-0630-4ff8-8578-36e676e0ba8f service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:18.718906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5ba49-c469-4f97-9308-2ad86e0d7a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:18.719698 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5ba49-c469-4f97-9308-2ad86e0d7a38 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:18.720059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5ba49-c469-4f97-9308-2ad86e0d7a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:18.720447 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5ba49-c469-4f97-9308-2ad86e0d7a38 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:18.722103 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5ba49-c469-4f97-9308-2ad86e0d7a38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:18.724320 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5ba49-c469-4f97-9308-2ad86e0d7a38 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:18.769778 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33e385-e8ed-4178-8be3-020c28abe641 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:18.773580 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1088/2172] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:18 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:18.790475 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33e385-e8ed-4178-8be3-020c28abe641 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:18.813826 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe15ad3-8b6e-4395-96a8-820bf87ed7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:18.815487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe15ad3-8b6e-4395-96a8-820bf87ed7ad admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:18.815978 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe15ad3-8b6e-4395-96a8-820bf87ed7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:18.821194 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe15ad3-8b6e-4395-96a8-820bf87ed7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:18.822444 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe15ad3-8b6e-4395-96a8-820bf87ed7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:18.824783 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe15ad3-8b6e-4395-96a8-820bf87ed7ad admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:18.853405 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1085/2173] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:18.854561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5ba49-c469-4f97-9308-2ad86e0d7a38 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:18.872143 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5ba49-c469-4f97-9308-2ad86e0d7a38 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:18.886999 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f6756-e655-4acc-b4f9-981e6c036436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:18.887733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f6756-e655-4acc-b4f9-981e6c036436 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:18.888095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f6756-e655-4acc-b4f9-981e6c036436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:18.888281 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f6756-e655-4acc-b4f9-981e6c036436 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:18.908249 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f6756-e655-4acc-b4f9-981e6c036436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:18.913168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f6756-e655-4acc-b4f9-981e6c036436 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:18.942150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1089/2174] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:18.944661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe15ad3-8b6e-4395-96a8-820bf87ed7ad admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:18.966229 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe15ad3-8b6e-4395-96a8-820bf87ed7ad admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:18.982460 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc96656-7c24-4bf9-b0af-209b9f1494cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:18.983771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc96656-7c24-4bf9-b0af-209b9f1494cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:18.984299 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc96656-7c24-4bf9-b0af-209b9f1494cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:18.984776 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc96656-7c24-4bf9-b0af-209b9f1494cd admin admin] PATH_INFO: `/v3/projects/abc5c5f1329243c5bb72d5d02d1f44be/users/c4ab5ec176b54202a587c4545e27b7f9/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:19.011324 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc96656-7c24-4bf9-b0af-209b9f1494cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc5c5f1329243c5bb72d5d02d1f44be, user_id=c4ab5ec176b54202a587c4545e27b7f9, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:19.014425 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc96656-7c24-4bf9-b0af-209b9f1494cd admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:19.040423 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1086/2175] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:18 2022] PUT /identity/v3/projects/abc5c5f1329243c5bb72d5d02d1f44be/users/c4ab5ec176b54202a587c4545e27b7f9/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:19.056409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc82fbc-8aff-435c-8397-896d54fb30f8 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:19.056409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc82fbc-8aff-435c-8397-896d54fb30f8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:19.056409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc82fbc-8aff-435c-8397-896d54fb30f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:19.089079 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8fc82fbc-8aff-435c-8397-896d54fb30f8 None None] MFA Rules not processed for user `c4ab5ec176b54202a587c4545e27b7f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:19.090847 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8fc82fbc-8aff-435c-8397-896d54fb30f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:19.113798 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:19.211186 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1090/2176] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:19.218203 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc96656-7c24-4bf9-b0af-209b9f1494cd admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:19.220927 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6cc96656-7c24-4bf9-b0af-209b9f1494cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:19.339638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc96656-7c24-4bf9-b0af-209b9f1494cd admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:19.344646 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32044eef-d6e4-4a9f-a985-e13f2f729054 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:19.345546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32044eef-d6e4-4a9f-a985-e13f2f729054 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:19.357732 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32044eef-d6e4-4a9f-a985-e13f2f729054 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:19.358721 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32044eef-d6e4-4a9f-a985-e13f2f729054 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:19.378179 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32044eef-d6e4-4a9f-a985-e13f2f729054 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:19.379909 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32044eef-d6e4-4a9f-a985-e13f2f729054 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:19.391471 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1087/2177] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:19.560398 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc82fbc-8aff-435c-8397-896d54fb30f8 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:19.561982 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8fc82fbc-8aff-435c-8397-896d54fb30f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:19.692588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc82fbc-8aff-435c-8397-896d54fb30f8 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:19.699235 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df56f5c-6f38-47d0-b199-fdaf54f7c125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:19.699981 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df56f5c-6f38-47d0-b199-fdaf54f7c125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:19.700270 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df56f5c-6f38-47d0-b199-fdaf54f7c125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:19.701050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df56f5c-6f38-47d0-b199-fdaf54f7c125 admin admin] PATH_INFO: `/v3/projects/76c27c6696974e5b9a00b8421ce7351e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:19.703693 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df56f5c-6f38-47d0-b199-fdaf54f7c125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76c27c6696974e5b9a00b8421ce7351e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:19.706189 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df56f5c-6f38-47d0-b199-fdaf54f7c125 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:19.784974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6df56f5c-6f38-47d0-b199-fdaf54f7c125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76c27c6696974e5b9a00b8421ce7351e', 'request_id': 'req-6df56f5c-6f38-47d0-b199-fdaf54f7c125'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:19.801894 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6df56f5c-6f38-47d0-b199-fdaf54f7c125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76c27c6696974e5b9a00b8421ce7351e', 'request_id': 'req-6df56f5c-6f38-47d0-b199-fdaf54f7c125'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:19.813171 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6df56f5c-6f38-47d0-b199-fdaf54f7c125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76c27c6696974e5b9a00b8421ce7351e', 'request_id': 'req-6df56f5c-6f38-47d0-b199-fdaf54f7c125'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:19.839662 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6df56f5c-6f38-47d0-b199-fdaf54f7c125 admin admin] The token cache is being invalidate because project 76c27c6696974e5b9a00b8421ce7351e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:19.840853 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6df56f5c-6f38-47d0-b199-fdaf54f7c125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:19.840853 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-6df56f5c-6f38-47d0-b199-fdaf54f7c125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:19.842558 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1091/2178] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:19 2022] DELETE /identity/v3/projects/76c27c6696974e5b9a00b8421ce7351e => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:19.847052 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32044eef-d6e4-4a9f-a985-e13f2f729054 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:19.872854 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32044eef-d6e4-4a9f-a985-e13f2f729054 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:20.013312 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:20.080499 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb51be-753d-4f3f-9c0e-bfa7db40497e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:20.081184 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb51be-753d-4f3f-9c0e-bfa7db40497e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:20.084832 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb51be-753d-4f3f-9c0e-bfa7db40497e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:20.085141 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb51be-753d-4f3f-9c0e-bfa7db40497e admin admin] PATH_INFO: `/v3/users/246efa46b934472f9b0e56ecca7a7689` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:20.086367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb51be-753d-4f3f-9c0e-bfa7db40497e admin admin] RBAC: Authorizing `identity:delete_user(user_id=246efa46b934472f9b0e56ecca7a7689)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:20.093209 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb51be-753d-4f3f-9c0e-bfa7db40497e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:20.197226 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-feeb51be-753d-4f3f-9c0e-bfa7db40497e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '246efa46b934472f9b0e56ecca7a7689'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:20.215973 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-feeb51be-753d-4f3f-9c0e-bfa7db40497e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '246efa46b934472f9b0e56ecca7a7689'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:20.238342 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-feeb51be-753d-4f3f-9c0e-bfa7db40497e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '246efa46b934472f9b0e56ecca7a7689'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:20.239033 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-feeb51be-753d-4f3f-9c0e-bfa7db40497e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '246efa46b934472f9b0e56ecca7a7689'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:20.274308 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-feeb51be-753d-4f3f-9c0e-bfa7db40497e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '246efa46b934472f9b0e56ecca7a7689'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:20.284628 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1088/2179] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:19 2022] DELETE /identity/v3/users/246efa46b934472f9b0e56ecca7a7689 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:21.170426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df56f5c-6f38-47d0-b199-fdaf54f7c125 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:21.171563 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6df56f5c-6f38-47d0-b199-fdaf54f7c125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:21.198155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df56f5c-6f38-47d0-b199-fdaf54f7c125 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:21.304415 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:21.324156 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181085c9-4fb9-4aa6-8c7b-b5a9c4cb84d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:21.325276 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181085c9-4fb9-4aa6-8c7b-b5a9c4cb84d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:21.326287 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181085c9-4fb9-4aa6-8c7b-b5a9c4cb84d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:21.326800 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181085c9-4fb9-4aa6-8c7b-b5a9c4cb84d1 admin admin] PATH_INFO: `/v3/projects/44e632a7774947d29a32e2ca0532aa2c` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:21.328160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181085c9-4fb9-4aa6-8c7b-b5a9c4cb84d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44e632a7774947d29a32e2ca0532aa2c)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:21.331321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181085c9-4fb9-4aa6-8c7b-b5a9c4cb84d1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:21.421959 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-181085c9-4fb9-4aa6-8c7b-b5a9c4cb84d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44e632a7774947d29a32e2ca0532aa2c', 'request_id': 'req-181085c9-4fb9-4aa6-8c7b-b5a9c4cb84d1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:21.434773 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-181085c9-4fb9-4aa6-8c7b-b5a9c4cb84d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44e632a7774947d29a32e2ca0532aa2c', 'request_id': 'req-181085c9-4fb9-4aa6-8c7b-b5a9c4cb84d1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:21.451077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-181085c9-4fb9-4aa6-8c7b-b5a9c4cb84d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44e632a7774947d29a32e2ca0532aa2c', 'request_id': 'req-181085c9-4fb9-4aa6-8c7b-b5a9c4cb84d1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:21.484859 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-181085c9-4fb9-4aa6-8c7b-b5a9c4cb84d1 admin admin] The token cache is being invalidate because project 44e632a7774947d29a32e2ca0532aa2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:21.485275 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-181085c9-4fb9-4aa6-8c7b-b5a9c4cb84d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:21.487739 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-181085c9-4fb9-4aa6-8c7b-b5a9c4cb84d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:21.498745 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1092/2180] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:21 2022] DELETE /identity/v3/projects/44e632a7774947d29a32e2ca0532aa2c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:21.501815 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f9bf8-2bd4-4952-a94e-0d55f379f8f7 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:21.502466 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f9bf8-2bd4-4952-a94e-0d55f379f8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:21.502466 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f9bf8-2bd4-4952-a94e-0d55f379f8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:21.532805 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-538f9bf8-2bd4-4952-a94e-0d55f379f8f7 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:21.534293 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-538f9bf8-2bd4-4952-a94e-0d55f379f8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:21.684630 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1089/2181] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:21.700059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73e14f-4fee-41a2-a780-f1c2f5df50cf None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:21.701911 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73e14f-4fee-41a2-a780-f1c2f5df50cf None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:21.703032 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73e14f-4fee-41a2-a780-f1c2f5df50cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:21.765355 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8c73e14f-4fee-41a2-a780-f1c2f5df50cf None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:21.780752 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8c73e14f-4fee-41a2-a780-f1c2f5df50cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:21.809629 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1093/2182] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:21.818747 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f9bf8-2bd4-4952-a94e-0d55f379f8f7 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:21.854293 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f9bf8-2bd4-4952-a94e-0d55f379f8f7 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:21.863849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60712e-58cf-43e0-aebf-7ce8c11d90fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:21.864560 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60712e-58cf-43e0-aebf-7ce8c11d90fa admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:21.864911 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60712e-58cf-43e0-aebf-7ce8c11d90fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:21.866125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60712e-58cf-43e0-aebf-7ce8c11d90fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:21.866871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60712e-58cf-43e0-aebf-7ce8c11d90fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:31:21.867251 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60712e-58cf-43e0-aebf-7ce8c11d90fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:21.868981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60712e-58cf-43e0-aebf-7ce8c11d90fa admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:21.900754 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1090/2183] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:31:21.903753 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73e14f-4fee-41a2-a780-f1c2f5df50cf None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:21.921680 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73e14f-4fee-41a2-a780-f1c2f5df50cf None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:21.933162 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb1dd8-1549-4ec2-8c7a-cef9c84feded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:21.933881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb1dd8-1549-4ec2-8c7a-cef9c84feded admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:21.934173 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb1dd8-1549-4ec2-8c7a-cef9c84feded admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:21.934449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb1dd8-1549-4ec2-8c7a-cef9c84feded admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:21.935093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb1dd8-1549-4ec2-8c7a-cef9c84feded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:21.941919 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb1dd8-1549-4ec2-8c7a-cef9c84feded admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:22.005235 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1094/2184] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:21 2022] POST /identity/v3/projects => generated 407 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:22.010019 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60712e-58cf-43e0-aebf-7ce8c11d90fa admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:22.033229 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60712e-58cf-43e0-aebf-7ce8c11d90fa admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:22.143582 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:22.189648 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310225cb-3544-4fce-969b-64c3f230f762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:22.190528 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310225cb-3544-4fce-969b-64c3f230f762 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:22.190820 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310225cb-3544-4fce-969b-64c3f230f762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:22.191222 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310225cb-3544-4fce-969b-64c3f230f762 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:22.191965 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310225cb-3544-4fce-969b-64c3f230f762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:22.194962 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310225cb-3544-4fce-969b-64c3f230f762 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:22.258253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1091/2185] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:22 2022] POST /identity/v3/users => generated 304 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:22.259520 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb1dd8-1549-4ec2-8c7a-cef9c84feded admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:22.275645 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb1dd8-1549-4ec2-8c7a-cef9c84feded admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:22.289336 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90a868-d602-46cb-833f-23041ec9233b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:22.292325 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90a868-d602-46cb-833f-23041ec9233b admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:22.292621 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90a868-d602-46cb-833f-23041ec9233b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:22.294523 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90a868-d602-46cb-833f-23041ec9233b admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:22.297438 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90a868-d602-46cb-833f-23041ec9233b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:22.299902 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90a868-d602-46cb-833f-23041ec9233b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:22.349943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1095/2186] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:22.354245 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310225cb-3544-4fce-969b-64c3f230f762 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:22.373170 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310225cb-3544-4fce-969b-64c3f230f762 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:22.387704 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb21158-7ab6-40e3-ab58-3fa91fb36dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:22.388297 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb21158-7ab6-40e3-ab58-3fa91fb36dfe admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:22.388718 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb21158-7ab6-40e3-ab58-3fa91fb36dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:22.389428 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb21158-7ab6-40e3-ab58-3fa91fb36dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:22.390226 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb21158-7ab6-40e3-ab58-3fa91fb36dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:22.393190 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb21158-7ab6-40e3-ab58-3fa91fb36dfe admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:22.423432 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1092/2187] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:22.428981 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90a868-d602-46cb-833f-23041ec9233b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:22.445966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90a868-d602-46cb-833f-23041ec9233b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:22.461262 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770df8a3-cd59-434d-9c77-8797228df063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:22.462200 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770df8a3-cd59-434d-9c77-8797228df063 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:22.462917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770df8a3-cd59-434d-9c77-8797228df063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:22.464166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770df8a3-cd59-434d-9c77-8797228df063 admin admin] PATH_INFO: `/v3/projects/434f17be084245ef95e7b33dc4b5d75e/users/969602870241447795b782f0b11d78c6/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:22.516312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770df8a3-cd59-434d-9c77-8797228df063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=434f17be084245ef95e7b33dc4b5d75e, user_id=969602870241447795b782f0b11d78c6, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:22.520329 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770df8a3-cd59-434d-9c77-8797228df063 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:22.556403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1096/2188] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:22 2022] PUT /identity/v3/projects/434f17be084245ef95e7b33dc4b5d75e/users/969602870241447795b782f0b11d78c6/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:22.563150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3bd24-9efc-4a67-b677-f48199385e01 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:22.563613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3bd24-9efc-4a67-b677-f48199385e01 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:22.563706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3bd24-9efc-4a67-b677-f48199385e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:22.643416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-15e3bd24-9efc-4a67-b677-f48199385e01 None None] MFA Rules not processed for user `969602870241447795b782f0b11d78c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:22.644688 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-15e3bd24-9efc-4a67-b677-f48199385e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:22.803848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1093/2189] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:22 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:22.805119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770df8a3-cd59-434d-9c77-8797228df063 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:22.917768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770df8a3-cd59-434d-9c77-8797228df063 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:22.924854 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72684d-668e-41be-805d-a40c88f502cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:22.926223 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72684d-668e-41be-805d-a40c88f502cd admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:22.926740 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72684d-668e-41be-805d-a40c88f502cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:22.927235 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72684d-668e-41be-805d-a40c88f502cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:22.928972 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72684d-668e-41be-805d-a40c88f502cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:22.931385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72684d-668e-41be-805d-a40c88f502cd admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:22.974181 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:22.993978 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1097/2190] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:22 2022] POST /identity/v3/projects => generated 405 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:22.999388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3bd24-9efc-4a67-b677-f48199385e01 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:23.016403 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3bd24-9efc-4a67-b677-f48199385e01 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:23.137182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57028187-3776-42f6-af82-423aaf733d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:23.137854 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57028187-3776-42f6-af82-423aaf733d26 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:23.138153 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57028187-3776-42f6-af82-423aaf733d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:23.138359 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57028187-3776-42f6-af82-423aaf733d26 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:23.139147 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57028187-3776-42f6-af82-423aaf733d26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:23.141139 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57028187-3776-42f6-af82-423aaf733d26 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:23.170554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1094/2191] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:22 2022] POST /identity/v3/users => generated 309 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:23.175230 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72684d-668e-41be-805d-a40c88f502cd admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:23.193890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72684d-668e-41be-805d-a40c88f502cd admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:23.211967 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b127ed-07ef-4a01-bdc5-718658354998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:23.212613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b127ed-07ef-4a01-bdc5-718658354998 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:23.212899 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b127ed-07ef-4a01-bdc5-718658354998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:23.213664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b127ed-07ef-4a01-bdc5-718658354998 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:23.214205 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b127ed-07ef-4a01-bdc5-718658354998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:23.217522 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b127ed-07ef-4a01-bdc5-718658354998 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:23.232189 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1098/2192] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:23.237312 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57028187-3776-42f6-af82-423aaf733d26 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:23.252683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57028187-3776-42f6-af82-423aaf733d26 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:23.257852 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba2815-c4b9-4f27-a361-f53e12080944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:23.258606 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba2815-c4b9-4f27-a361-f53e12080944 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:23.258963 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba2815-c4b9-4f27-a361-f53e12080944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:23.259426 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba2815-c4b9-4f27-a361-f53e12080944 admin admin] PATH_INFO: `/v3/projects/473e8865891448759aa4d11fa2eed485/users/7f30c5bdcb774cee8e0c6fe79ac33fc1/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:23.277829 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba2815-c4b9-4f27-a361-f53e12080944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=473e8865891448759aa4d11fa2eed485, user_id=7f30c5bdcb774cee8e0c6fe79ac33fc1, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:23.280509 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba2815-c4b9-4f27-a361-f53e12080944 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:23.295692 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1095/2193] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:23 2022] PUT /identity/v3/projects/473e8865891448759aa4d11fa2eed485/users/7f30c5bdcb774cee8e0c6fe79ac33fc1/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:23.309237 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b127ed-07ef-4a01-bdc5-718658354998 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:23.313502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b127ed-07ef-4a01-bdc5-718658354998 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:23.385445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4be422-dd48-4e2d-aea7-a31cdd1593d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:23.386576 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4be422-dd48-4e2d-aea7-a31cdd1593d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:23.386576 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4be422-dd48-4e2d-aea7-a31cdd1593d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:23.386763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4be422-dd48-4e2d-aea7-a31cdd1593d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:23.387484 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4be422-dd48-4e2d-aea7-a31cdd1593d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:23.389241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4be422-dd48-4e2d-aea7-a31cdd1593d6 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:23.405801 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba2815-c4b9-4f27-a361-f53e12080944 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:23.411608 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1099/2194] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:23.418820 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba2815-c4b9-4f27-a361-f53e12080944 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:23.426428 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21c913-6d8e-415b-8ee1-1224130b8e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:23.427308 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21c913-6d8e-415b-8ee1-1224130b8e4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:23.428248 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21c913-6d8e-415b-8ee1-1224130b8e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:23.428630 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21c913-6d8e-415b-8ee1-1224130b8e4b admin admin] PATH_INFO: `/v3/projects/473e8865891448759aa4d11fa2eed485/users/7f30c5bdcb774cee8e0c6fe79ac33fc1/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:23.430948 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21c913-6d8e-415b-8ee1-1224130b8e4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=473e8865891448759aa4d11fa2eed485, user_id=7f30c5bdcb774cee8e0c6fe79ac33fc1, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:23.434946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21c913-6d8e-415b-8ee1-1224130b8e4b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:23.457313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1096/2195] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:23 2022] PUT /identity/v3/projects/473e8865891448759aa4d11fa2eed485/users/7f30c5bdcb774cee8e0c6fe79ac33fc1/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:31:23.464614 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97f7d5-b575-450d-bf82-10d073d2466c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:23.464809 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97f7d5-b575-450d-bf82-10d073d2466c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:23.465678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97f7d5-b575-450d-bf82-10d073d2466c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:23.509591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9d97f7d5-b575-450d-bf82-10d073d2466c None None] MFA Rules not processed for user `7f30c5bdcb774cee8e0c6fe79ac33fc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:23.512253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9d97f7d5-b575-450d-bf82-10d073d2466c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:23.637599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1100/2196] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:23 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:23.648730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21c913-6d8e-415b-8ee1-1224130b8e4b admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:23.651420 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6a21c913-6d8e-415b-8ee1-1224130b8e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:23.660945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:23.738027 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21c913-6d8e-415b-8ee1-1224130b8e4b admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:23.743824 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cda966-c7d8-404b-8c2f-8b145b03f9ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:23.744964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cda966-c7d8-404b-8c2f-8b145b03f9ff service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:23.745281 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cda966-c7d8-404b-8c2f-8b145b03f9ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:23.745560 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cda966-c7d8-404b-8c2f-8b145b03f9ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:23.764299 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cda966-c7d8-404b-8c2f-8b145b03f9ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:23.765796 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cda966-c7d8-404b-8c2f-8b145b03f9ff service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:23.795248 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1097/2197] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:23 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:23.813263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97f7d5-b575-450d-bf82-10d073d2466c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:23.815266 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9d97f7d5-b575-450d-bf82-10d073d2466c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:23.831998 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cda966-c7d8-404b-8c2f-8b145b03f9ff service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:23.835813 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c7cda966-c7d8-404b-8c2f-8b145b03f9ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:23.870923 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cda966-c7d8-404b-8c2f-8b145b03f9ff service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:23.882617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e7396-17f6-4c57-8831-c98546e1ef4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:23.883322 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e7396-17f6-4c57-8831-c98546e1ef4f service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:23.883672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e7396-17f6-4c57-8831-c98546e1ef4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:23.884386 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e7396-17f6-4c57-8831-c98546e1ef4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:23.888205 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-852e7396-17f6-4c57-8831-c98546e1ef4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:23.991992 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97f7d5-b575-450d-bf82-10d073d2466c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:23.999254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d248f-ff4e-403d-b0c9-5b9e3c4fb56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:24.000561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e7396-17f6-4c57-8831-c98546e1ef4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:24.000917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d248f-ff4e-403d-b0c9-5b9e3c4fb56b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:24.001451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d248f-ff4e-403d-b0c9-5b9e3c4fb56b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:24.001690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e7396-17f6-4c57-8831-c98546e1ef4f service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:24.002532 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d248f-ff4e-403d-b0c9-5b9e3c4fb56b admin admin] PATH_INFO: `/v3/users/c4ab5ec176b54202a587c4545e27b7f9` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:24.004735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d248f-ff4e-403d-b0c9-5b9e3c4fb56b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4ab5ec176b54202a587c4545e27b7f9)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:24.007908 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d248f-ff4e-403d-b0c9-5b9e3c4fb56b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:24.013624 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1098/2198] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:31:24.027010 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:24.067095 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e7396-17f6-4c57-8831-c98546e1ef4f service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:24.079176 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-762d248f-ff4e-403d-b0c9-5b9e3c4fb56b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4ab5ec176b54202a587c4545e27b7f9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:24.080209 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e7396-17f6-4c57-8831-c98546e1ef4f service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:24.089952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-762d248f-ff4e-403d-b0c9-5b9e3c4fb56b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4ab5ec176b54202a587c4545e27b7f9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:24.090182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174554e-c459-4d88-a341-d4e60b09038d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:24.090614 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174554e-c459-4d88-a341-d4e60b09038d service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:24.090893 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174554e-c459-4d88-a341-d4e60b09038d service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:24.091285 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174554e-c459-4d88-a341-d4e60b09038d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:24.091705 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-762d248f-ff4e-403d-b0c9-5b9e3c4fb56b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4ab5ec176b54202a587c4545e27b7f9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:24.099311 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1174554e-c459-4d88-a341-d4e60b09038d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:24.114391 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-762d248f-ff4e-403d-b0c9-5b9e3c4fb56b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4ab5ec176b54202a587c4545e27b7f9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:24.159671 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-762d248f-ff4e-403d-b0c9-5b9e3c4fb56b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4ab5ec176b54202a587c4545e27b7f9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:24.188105 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1101/2199] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:23 2022] DELETE /identity/v3/users/c4ab5ec176b54202a587c4545e27b7f9 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:24.191211 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa6fbb-bacb-4839-8f15-c5f8434fb8d7 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:24.192191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa6fbb-bacb-4839-8f15-c5f8434fb8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:24.192655 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa6fbb-bacb-4839-8f15-c5f8434fb8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:24.229531 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e4fa6fbb-bacb-4839-8f15-c5f8434fb8d7 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:24.233932 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e4fa6fbb-bacb-4839-8f15-c5f8434fb8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:24.258116 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174554e-c459-4d88-a341-d4e60b09038d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:24.264140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174554e-c459-4d88-a341-d4e60b09038d service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:24.295201 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1099/2200] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:24 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:31:24.392631 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1102/2201] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:24.436521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174554e-c459-4d88-a341-d4e60b09038d service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:24.438769 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1174554e-c459-4d88-a341-d4e60b09038d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:24.577426 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:24.600848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174554e-c459-4d88-a341-d4e60b09038d service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:24.674591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9cff87-721d-49c6-b2a2-7e0f50925205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:24.676289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cff87-721d-49c6-b2a2-7e0f50925205 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:24.677050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cff87-721d-49c6-b2a2-7e0f50925205 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:24.677829 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9cff87-721d-49c6-b2a2-7e0f50925205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:24.692324 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9cff87-721d-49c6-b2a2-7e0f50925205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:24.695951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9cff87-721d-49c6-b2a2-7e0f50925205 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:24.729400 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1100/2202] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:31:25.304953 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa6fbb-bacb-4839-8f15-c5f8434fb8d7 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:25.306471 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e4fa6fbb-bacb-4839-8f15-c5f8434fb8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:25.319325 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa6fbb-bacb-4839-8f15-c5f8434fb8d7 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:25.325567 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38e19f-71f6-4a4f-af12-4e5773775a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:25.326896 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38e19f-71f6-4a4f-af12-4e5773775a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:25.327174 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38e19f-71f6-4a4f-af12-4e5773775a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:25.328013 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38e19f-71f6-4a4f-af12-4e5773775a35 admin admin] PATH_INFO: `/v3/projects/abc5c5f1329243c5bb72d5d02d1f44be` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:25.329196 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38e19f-71f6-4a4f-af12-4e5773775a35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abc5c5f1329243c5bb72d5d02d1f44be)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:25.331119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38e19f-71f6-4a4f-af12-4e5773775a35 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:25.391500 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3f38e19f-71f6-4a4f-af12-4e5773775a35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abc5c5f1329243c5bb72d5d02d1f44be', 'request_id': 'req-3f38e19f-71f6-4a4f-af12-4e5773775a35'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:25.400340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3f38e19f-71f6-4a4f-af12-4e5773775a35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abc5c5f1329243c5bb72d5d02d1f44be', 'request_id': 'req-3f38e19f-71f6-4a4f-af12-4e5773775a35'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:25.407693 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3f38e19f-71f6-4a4f-af12-4e5773775a35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abc5c5f1329243c5bb72d5d02d1f44be', 'request_id': 'req-3f38e19f-71f6-4a4f-af12-4e5773775a35'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:25.425984 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3f38e19f-71f6-4a4f-af12-4e5773775a35 admin admin] The token cache is being invalidate because project abc5c5f1329243c5bb72d5d02d1f44be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:25.426762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3f38e19f-71f6-4a4f-af12-4e5773775a35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:25.427842 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3f38e19f-71f6-4a4f-af12-4e5773775a35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:25.435068 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1103/2203] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:25 2022] DELETE /identity/v3/projects/abc5c5f1329243c5bb72d5d02d1f44be => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:25.435813 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea297b3b-bfab-4d15-b0cb-034e0cc2bac9 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:25.436156 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea297b3b-bfab-4d15-b0cb-034e0cc2bac9 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:25.436438 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea297b3b-bfab-4d15-b0cb-034e0cc2bac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:25.458191 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-ea297b3b-bfab-4d15-b0cb-034e0cc2bac9 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:25.459981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ea297b3b-bfab-4d15-b0cb-034e0cc2bac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:25.537200 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1101/2204] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:25.541572 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc99298-2b25-4add-9826-32c09877dd44 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:25.542468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc99298-2b25-4add-9826-32c09877dd44 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:25.543102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc99298-2b25-4add-9826-32c09877dd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:25.596040 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-efc99298-2b25-4add-9826-32c09877dd44 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:25.597995 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-efc99298-2b25-4add-9826-32c09877dd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:25.617287 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1104/2205] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:25.618589 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea297b3b-bfab-4d15-b0cb-034e0cc2bac9 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:25.637439 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea297b3b-bfab-4d15-b0cb-034e0cc2bac9 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:25.648402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea7f01-13b3-447f-b632-cdbd5281fae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:25.649440 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea7f01-13b3-447f-b632-cdbd5281fae3 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:25.649440 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea7f01-13b3-447f-b632-cdbd5281fae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:25.649949 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea7f01-13b3-447f-b632-cdbd5281fae3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:25.650986 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea7f01-13b3-447f-b632-cdbd5281fae3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:31:25.651469 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea7f01-13b3-447f-b632-cdbd5281fae3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:25.653359 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea7f01-13b3-447f-b632-cdbd5281fae3 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:25.667701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1102/2206] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:31:25.674192 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc99298-2b25-4add-9826-32c09877dd44 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:25.681809 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:25.688249 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc99298-2b25-4add-9826-32c09877dd44 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:25.711920 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01979105-7e9d-4adf-8e1f-987624702629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:25.713276 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01979105-7e9d-4adf-8e1f-987624702629 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:25.713796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01979105-7e9d-4adf-8e1f-987624702629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:25.714234 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01979105-7e9d-4adf-8e1f-987624702629 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:25.714737 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01979105-7e9d-4adf-8e1f-987624702629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:25.717551 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01979105-7e9d-4adf-8e1f-987624702629 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:25.775281 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea7f01-13b3-447f-b632-cdbd5281fae3 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:25.785310 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1105/2207] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:25 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:25.794101 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea7f01-13b3-447f-b632-cdbd5281fae3 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:26.007126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798fc41-1b1f-4af0-96dc-05f0dc449cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:26.007763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798fc41-1b1f-4af0-96dc-05f0dc449cdf admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:26.008046 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798fc41-1b1f-4af0-96dc-05f0dc449cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:26.008319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798fc41-1b1f-4af0-96dc-05f0dc449cdf admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:26.015886 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798fc41-1b1f-4af0-96dc-05f0dc449cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:26.018606 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798fc41-1b1f-4af0-96dc-05f0dc449cdf admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:26.067859 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01979105-7e9d-4adf-8e1f-987624702629 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:26.074510 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1103/2208] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:25 2022] POST /identity/v3/users => generated 288 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:26.095989 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01979105-7e9d-4adf-8e1f-987624702629 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:26.102689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bba1fb-2d0e-4d38-bd36-434818b36816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:26.107459 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bba1fb-2d0e-4d38-bd36-434818b36816 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:26.107639 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bba1fb-2d0e-4d38-bd36-434818b36816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:26.107861 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bba1fb-2d0e-4d38-bd36-434818b36816 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:26.109045 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bba1fb-2d0e-4d38-bd36-434818b36816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:26.111163 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bba1fb-2d0e-4d38-bd36-434818b36816 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:26.131907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1106/2209] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:26.136159 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798fc41-1b1f-4af0-96dc-05f0dc449cdf admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:26.153617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798fc41-1b1f-4af0-96dc-05f0dc449cdf admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:26.161492 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538bf1ff-8a10-498c-b59c-68f69f0987e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:26.162143 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bf1ff-8a10-498c-b59c-68f69f0987e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:26.162418 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bf1ff-8a10-498c-b59c-68f69f0987e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:26.162687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bf1ff-8a10-498c-b59c-68f69f0987e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:26.163409 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538bf1ff-8a10-498c-b59c-68f69f0987e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:26.166426 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538bf1ff-8a10-498c-b59c-68f69f0987e0 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:26.184046 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1104/2210] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:26.189096 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bba1fb-2d0e-4d38-bd36-434818b36816 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:26.210599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bba1fb-2d0e-4d38-bd36-434818b36816 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:26.216127 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12e370-28b6-4713-a45f-67e0745ef9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:26.216481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12e370-28b6-4713-a45f-67e0745ef9f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:26.216810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12e370-28b6-4713-a45f-67e0745ef9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:26.217089 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12e370-28b6-4713-a45f-67e0745ef9f7 admin admin] PATH_INFO: `/v3/projects/9e2f292d41a241cabd43439496046bd5/users/f4d596d4043d45b1a698a6c2fe9da392/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:26.245597 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12e370-28b6-4713-a45f-67e0745ef9f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e2f292d41a241cabd43439496046bd5, user_id=f4d596d4043d45b1a698a6c2fe9da392, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:26.249924 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12e370-28b6-4713-a45f-67e0745ef9f7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:26.269860 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1107/2211] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:26 2022] PUT /identity/v3/projects/9e2f292d41a241cabd43439496046bd5/users/f4d596d4043d45b1a698a6c2fe9da392/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:26.287594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8dbc2-dc97-4c2f-b44f-3ebe1f5bced4 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:26.288026 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8dbc2-dc97-4c2f-b44f-3ebe1f5bced4 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:26.289362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8dbc2-dc97-4c2f-b44f-3ebe1f5bced4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:26.297271 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:26.336688 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a5f8dbc2-dc97-4c2f-b44f-3ebe1f5bced4 None None] MFA Rules not processed for user `f4d596d4043d45b1a698a6c2fe9da392`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:26.354990 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a5f8dbc2-dc97-4c2f-b44f-3ebe1f5bced4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:26.382215 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adc807-fa4e-43bc-8598-fa9d5eeac72d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:26.382571 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adc807-fa4e-43bc-8598-fa9d5eeac72d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:26.383050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adc807-fa4e-43bc-8598-fa9d5eeac72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:26.450355 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-29adc807-fa4e-43bc-8598-fa9d5eeac72d None None] MFA Rules not processed for user `2d8ebcd7b7cc43ad87dfff3d91a4d679`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:26.451713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-29adc807-fa4e-43bc-8598-fa9d5eeac72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:26.483739 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1105/2212] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:26.488220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8dbc2-dc97-4c2f-b44f-3ebe1f5bced4 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:26.539608 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1108/2213] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:31:26.543376 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7cf57-5590-45fb-9988-b7af9f870ccd None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:26.544263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7cf57-5590-45fb-9988-b7af9f870ccd None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:26.544596 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7cf57-5590-45fb-9988-b7af9f870ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:26.567037 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-0dd7cf57-5590-45fb-9988-b7af9f870ccd None None] MFA Rules not processed for user `2d8ebcd7b7cc43ad87dfff3d91a4d679`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:26.568925 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0dd7cf57-5590-45fb-9988-b7af9f870ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:26.576173 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1109/2214] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:31:26.577332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8dbc2-dc97-4c2f-b44f-3ebe1f5bced4 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:26.584345 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8c8a4-8e61-4ed6-9e65-3e81dd1be2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:26.584975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8c8a4-8e61-4ed6-9e65-3e81dd1be2ec admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:26.585288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8c8a4-8e61-4ed6-9e65-3e81dd1be2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:26.585635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8c8a4-8e61-4ed6-9e65-3e81dd1be2ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:26.586279 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8c8a4-8e61-4ed6-9e65-3e81dd1be2ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:26.588274 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8c8a4-8e61-4ed6-9e65-3e81dd1be2ec admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:26.588575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7cf57-5590-45fb-9988-b7af9f870ccd None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:26.590829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0dd7cf57-5590-45fb-9988-b7af9f870ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:26.629061 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1106/2215] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:26 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:26.632939 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8c8a4-8e61-4ed6-9e65-3e81dd1be2ec admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:26.697255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7cf57-5590-45fb-9988-b7af9f870ccd None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:26.721168 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8c8a4-8e61-4ed6-9e65-3e81dd1be2ec admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:26.728305 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89833715-9ec6-4c5b-a92d-644f5f2fdbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:26.728974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89833715-9ec6-4c5b-a92d-644f5f2fdbf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:26.729331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89833715-9ec6-4c5b-a92d-644f5f2fdbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:26.729665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89833715-9ec6-4c5b-a92d-644f5f2fdbf9 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:26.730597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89833715-9ec6-4c5b-a92d-644f5f2fdbf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:26.732479 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:26.736670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89833715-9ec6-4c5b-a92d-644f5f2fdbf9 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:26.769770 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1107/2216] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:26 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:31:26.774036 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89833715-9ec6-4c5b-a92d-644f5f2fdbf9 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:26.786654 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89833715-9ec6-4c5b-a92d-644f5f2fdbf9 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:26.794669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdfc45-dc45-4c17-a8ee-33ae7c10a8d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:26.795394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdfc45-dc45-4c17-a8ee-33ae7c10a8d5 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:26.796039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdfc45-dc45-4c17-a8ee-33ae7c10a8d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:26.796486 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdfc45-dc45-4c17-a8ee-33ae7c10a8d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:26.811691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b923d-ac24-4444-87fb-ad605e72b59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:26.814462 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b923d-ac24-4444-87fb-ad605e72b59f admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:26.814843 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b923d-ac24-4444-87fb-ad605e72b59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:26.815065 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b923d-ac24-4444-87fb-ad605e72b59f admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:26.819546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b923d-ac24-4444-87fb-ad605e72b59f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:26.824261 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b923d-ac24-4444-87fb-ad605e72b59f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:26.829832 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:26.850366 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1108/2217] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:26.854208 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b923d-ac24-4444-87fb-ad605e72b59f admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:26.868556 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b923d-ac24-4444-87fb-ad605e72b59f admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:26.874365 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4194222-68f0-4f8b-be66-1ca7bf008e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:26.875242 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4194222-68f0-4f8b-be66-1ca7bf008e7b admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:26.876237 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4194222-68f0-4f8b-be66-1ca7bf008e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:26.876715 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4194222-68f0-4f8b-be66-1ca7bf008e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:26.877584 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4194222-68f0-4f8b-be66-1ca7bf008e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:26.879663 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4194222-68f0-4f8b-be66-1ca7bf008e7b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:26.881884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fdfc45-dc45-4c17-a8ee-33ae7c10a8d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:26.883533 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fdfc45-dc45-4c17-a8ee-33ae7c10a8d5 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:26.900396 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1109/2218] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:31:26.903366 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1110/2219] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:26 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:26.922909 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4194222-68f0-4f8b-be66-1ca7bf008e7b admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:26.938261 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4194222-68f0-4f8b-be66-1ca7bf008e7b admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:26.944549 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da428d2c-27b6-48b7-a929-564cd2d792a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:26.945301 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da428d2c-27b6-48b7-a929-564cd2d792a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:26.945574 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da428d2c-27b6-48b7-a929-564cd2d792a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:26.945996 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da428d2c-27b6-48b7-a929-564cd2d792a3 admin admin] PATH_INFO: `/v3/projects/fb474af8f7f7488087b70c4f9e5a429e/users/dd7928192a5c4c71b17118595598c049/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:26.962928 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da428d2c-27b6-48b7-a929-564cd2d792a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb474af8f7f7488087b70c4f9e5a429e, user_id=dd7928192a5c4c71b17118595598c049, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:26.968798 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da428d2c-27b6-48b7-a929-564cd2d792a3 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:26.996115 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1110/2220] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:26 2022] PUT /identity/v3/projects/fb474af8f7f7488087b70c4f9e5a429e/users/dd7928192a5c4c71b17118595598c049/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:27.006683 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c306d6-9674-41b8-8ba3-e2386cba1c37 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:27.007604 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c306d6-9674-41b8-8ba3-e2386cba1c37 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:27.007604 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c306d6-9674-41b8-8ba3-e2386cba1c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:27.047288 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-22c306d6-9674-41b8-8ba3-e2386cba1c37 None None] MFA Rules not processed for user `dd7928192a5c4c71b17118595598c049`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:27.048803 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-22c306d6-9674-41b8-8ba3-e2386cba1c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:27.138593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1111/2221] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:27.143171 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da428d2c-27b6-48b7-a929-564cd2d792a3 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:27.265286 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da428d2c-27b6-48b7-a929-564cd2d792a3 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:27.276151 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b34f8e-90c4-468f-acb1-1e715200046b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:27.276996 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b34f8e-90c4-468f-acb1-1e715200046b admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:27.278956 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b34f8e-90c4-468f-acb1-1e715200046b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:27.279260 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b34f8e-90c4-468f-acb1-1e715200046b admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:27.280078 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b34f8e-90c4-468f-acb1-1e715200046b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:27.282165 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b34f8e-90c4-468f-acb1-1e715200046b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:27.313769 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1111/2222] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:27 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:31:27.317183 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c306d6-9674-41b8-8ba3-e2386cba1c37 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:27.337478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c306d6-9674-41b8-8ba3-e2386cba1c37 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:27.402284 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:27.409775 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fe8f0-df05-4e29-8490-b715867f527d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:27.410471 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fe8f0-df05-4e29-8490-b715867f527d admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:27.410831 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fe8f0-df05-4e29-8490-b715867f527d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:27.411108 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532fe8f0-df05-4e29-8490-b715867f527d admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:27.412345 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532fe8f0-df05-4e29-8490-b715867f527d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:27.414369 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532fe8f0-df05-4e29-8490-b715867f527d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:27.445581 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1112/2223] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:27 2022] POST /identity/v3/users => generated 295 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:27.446998 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b34f8e-90c4-468f-acb1-1e715200046b admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:27.480003 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b34f8e-90c4-468f-acb1-1e715200046b admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:27.486102 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e7638-8a98-4d6e-8a0c-5841605919df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:27.487103 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e7638-8a98-4d6e-8a0c-5841605919df admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:27.487569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e7638-8a98-4d6e-8a0c-5841605919df admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:27.487921 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e7638-8a98-4d6e-8a0c-5841605919df admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:27.488879 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e7638-8a98-4d6e-8a0c-5841605919df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:27.491087 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e7638-8a98-4d6e-8a0c-5841605919df admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:27.502906 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1112/2224] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:27.507002 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fe8f0-df05-4e29-8490-b715867f527d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:27.518546 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532fe8f0-df05-4e29-8490-b715867f527d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:27.524722 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7554e2-cccd-40e5-a61f-9d5fcd17def9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:27.525422 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7554e2-cccd-40e5-a61f-9d5fcd17def9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:27.525785 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7554e2-cccd-40e5-a61f-9d5fcd17def9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:27.526143 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7554e2-cccd-40e5-a61f-9d5fcd17def9 admin admin] PATH_INFO: `/v3/projects/12db38754b6b41019e7cd0d098e72cbd/users/0a82aa66d48047e6b4c6e254f04a5c16/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:27.547497 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7554e2-cccd-40e5-a61f-9d5fcd17def9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12db38754b6b41019e7cd0d098e72cbd, user_id=0a82aa66d48047e6b4c6e254f04a5c16, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:27.551180 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7554e2-cccd-40e5-a61f-9d5fcd17def9 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:27.569092 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1113/2225] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:27 2022] PUT /identity/v3/projects/12db38754b6b41019e7cd0d098e72cbd/users/0a82aa66d48047e6b4c6e254f04a5c16/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:27.571188 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e7638-8a98-4d6e-8a0c-5841605919df admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:27.583163 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e7638-8a98-4d6e-8a0c-5841605919df admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:27.666395 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c19bd-e4de-4312-a9f3-ae60b0a1cacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:27.667630 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c19bd-e4de-4312-a9f3-ae60b0a1cacb admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:27.668785 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c19bd-e4de-4312-a9f3-ae60b0a1cacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:27.669309 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c19bd-e4de-4312-a9f3-ae60b0a1cacb admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:27.670381 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c19bd-e4de-4312-a9f3-ae60b0a1cacb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:27.672959 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c19bd-e4de-4312-a9f3-ae60b0a1cacb admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:27.719680 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1113/2226] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:27.725527 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7554e2-cccd-40e5-a61f-9d5fcd17def9 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:27.749143 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7554e2-cccd-40e5-a61f-9d5fcd17def9 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:27.754392 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71654c-e4d7-4265-9f42-944fbade2551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:27.754963 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71654c-e4d7-4265-9f42-944fbade2551 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:27.755809 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71654c-e4d7-4265-9f42-944fbade2551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:27.756092 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71654c-e4d7-4265-9f42-944fbade2551 admin admin] PATH_INFO: `/v3/projects/12db38754b6b41019e7cd0d098e72cbd/users/0a82aa66d48047e6b4c6e254f04a5c16/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:27.758188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f71654c-e4d7-4265-9f42-944fbade2551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12db38754b6b41019e7cd0d098e72cbd, user_id=0a82aa66d48047e6b4c6e254f04a5c16, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:27.773750 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f71654c-e4d7-4265-9f42-944fbade2551 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:27.800352 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6f037-258c-40b4-a121-88b86f3d02b2 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:27.801150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6f037-258c-40b4-a121-88b86f3d02b2 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:27.801562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6f037-258c-40b4-a121-88b86f3d02b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:27.804488 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1114/2227] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:27 2022] PUT /identity/v3/projects/12db38754b6b41019e7cd0d098e72cbd/users/0a82aa66d48047e6b4c6e254f04a5c16/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:27.842854 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c0c6f037-258c-40b4-a121-88b86f3d02b2 None None] MFA Rules not processed for user `0a82aa66d48047e6b4c6e254f04a5c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:27.845246 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c0c6f037-258c-40b4-a121-88b86f3d02b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:27.877229 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:27.891517 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c660d-bb2e-4942-8471-45a86987db04 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:27.892689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c660d-bb2e-4942-8471-45a86987db04 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:27.893177 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c660d-bb2e-4942-8471-45a86987db04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:27.931865 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-cc9c660d-bb2e-4942-8471-45a86987db04 None None] MFA Rules not processed for user `2d8ebcd7b7cc43ad87dfff3d91a4d679`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:27.934055 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cc9c660d-bb2e-4942-8471-45a86987db04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:27.945591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1114/2228] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:27.960782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6f037-258c-40b4-a121-88b86f3d02b2 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:27.962453 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c0c6f037-258c-40b4-a121-88b86f3d02b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:28.039327 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6f037-258c-40b4-a121-88b86f3d02b2 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:28.048980 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4fb4d-1ca8-4331-99f9-dd0d2c804baa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:28.049947 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4fb4d-1ca8-4331-99f9-dd0d2c804baa service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:28.050724 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4fb4d-1ca8-4331-99f9-dd0d2c804baa service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:28.051068 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4fb4d-1ca8-4331-99f9-dd0d2c804baa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:28.062858 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1115/2229] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:28.121749 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4fb4d-1ca8-4331-99f9-dd0d2c804baa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:28.123290 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4fb4d-1ca8-4331-99f9-dd0d2c804baa service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:28.134197 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1115/2230] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:29.659352 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c660d-bb2e-4942-8471-45a86987db04 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:29.662177 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cc9c660d-bb2e-4942-8471-45a86987db04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:29.846822 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c660d-bb2e-4942-8471-45a86987db04 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:29.861908 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906cded-39c5-4b33-b433-326164dae65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:29.863000 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906cded-39c5-4b33-b433-326164dae65e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:29.866273 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906cded-39c5-4b33-b433-326164dae65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:29.866815 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906cded-39c5-4b33-b433-326164dae65e admin admin] PATH_INFO: `/v3/users/d6f8e71e47754c1fb395de995dd08217` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:29.872626 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906cded-39c5-4b33-b433-326164dae65e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6f8e71e47754c1fb395de995dd08217)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:29.879584 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906cded-39c5-4b33-b433-326164dae65e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:30.031146 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2906cded-39c5-4b33-b433-326164dae65e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6f8e71e47754c1fb395de995dd08217'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:30.047357 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2906cded-39c5-4b33-b433-326164dae65e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6f8e71e47754c1fb395de995dd08217'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:30.048982 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2906cded-39c5-4b33-b433-326164dae65e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6f8e71e47754c1fb395de995dd08217'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:30.051129 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:30.075933 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2906cded-39c5-4b33-b433-326164dae65e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6f8e71e47754c1fb395de995dd08217'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:30.099718 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4fb4d-1ca8-4331-99f9-dd0d2c804baa service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:30.101855 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2906cded-39c5-4b33-b433-326164dae65e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6f8e71e47754c1fb395de995dd08217'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:30.108849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4fb4d-1ca8-4331-99f9-dd0d2c804baa service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:30.115253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02c5a3-8c42-477d-84ff-6ea01ae7b5bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:30.116448 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02c5a3-8c42-477d-84ff-6ea01ae7b5bb service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:30.116902 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02c5a3-8c42-477d-84ff-6ea01ae7b5bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:30.117363 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02c5a3-8c42-477d-84ff-6ea01ae7b5bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:30.119363 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9c02c5a3-8c42-477d-84ff-6ea01ae7b5bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:30.127453 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1116/2231] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:29 2022] DELETE /identity/v3/users/d6f8e71e47754c1fb395de995dd08217 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:30.131719 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2c3e7-fec4-4ee2-bfac-62eb98aa745a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:30.132116 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2c3e7-fec4-4ee2-bfac-62eb98aa745a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:30.132275 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2c3e7-fec4-4ee2-bfac-62eb98aa745a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:30.189854 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-28b2c3e7-fec4-4ee2-bfac-62eb98aa745a None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:30.191087 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-28b2c3e7-fec4-4ee2-bfac-62eb98aa745a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:30.267942 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02c5a3-8c42-477d-84ff-6ea01ae7b5bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:30.270128 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02c5a3-8c42-477d-84ff-6ea01ae7b5bb service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:30.289689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1117/2232] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:31:30.290978 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1116/2233] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:30.310048 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2c3e7-fec4-4ee2-bfac-62eb98aa745a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:30.311635 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-28b2c3e7-fec4-4ee2-bfac-62eb98aa745a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:30.418659 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2c3e7-fec4-4ee2-bfac-62eb98aa745a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:30.428360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04ca2e-1af2-4088-913c-b3c7132e4b1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:30.430774 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04ca2e-1af2-4088-913c-b3c7132e4b1a service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:30.431632 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04ca2e-1af2-4088-913c-b3c7132e4b1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:30.432884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04ca2e-1af2-4088-913c-b3c7132e4b1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:30.449575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04ca2e-1af2-4088-913c-b3c7132e4b1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:30.451267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04ca2e-1af2-4088-913c-b3c7132e4b1a service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:30.464886 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1118/2234] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:30.723024 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02c5a3-8c42-477d-84ff-6ea01ae7b5bb service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:30.729537 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9c02c5a3-8c42-477d-84ff-6ea01ae7b5bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:30.760396 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02c5a3-8c42-477d-84ff-6ea01ae7b5bb service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:30.769428 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1c571-80eb-48ac-9b73-d10d9e057b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:30.770095 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1c571-80eb-48ac-9b73-d10d9e057b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:30.770418 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1c571-80eb-48ac-9b73-d10d9e057b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:30.771333 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1c571-80eb-48ac-9b73-d10d9e057b20 admin admin] PATH_INFO: `/v3/users/969602870241447795b782f0b11d78c6` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:30.773080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1c571-80eb-48ac-9b73-d10d9e057b20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=969602870241447795b782f0b11d78c6)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:30.775380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1c571-80eb-48ac-9b73-d10d9e057b20 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:30.782901 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=100 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:30.946457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9ae1c571-80eb-48ac-9b73-d10d9e057b20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '969602870241447795b782f0b11d78c6'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:30.963127 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9ae1c571-80eb-48ac-9b73-d10d9e057b20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '969602870241447795b782f0b11d78c6'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:30.989983 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9ae1c571-80eb-48ac-9b73-d10d9e057b20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '969602870241447795b782f0b11d78c6'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:30.991195 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9ae1c571-80eb-48ac-9b73-d10d9e057b20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '969602870241447795b782f0b11d78c6'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:31.024780 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-9ae1c571-80eb-48ac-9b73-d10d9e057b20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '969602870241447795b782f0b11d78c6'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:31.033684 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1117/2235] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:30 2022] DELETE /identity/v3/users/969602870241447795b782f0b11d78c6 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:31.040642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e7190-eb5d-4f79-a3c7-30c44961fd18 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:31.043289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e7190-eb5d-4f79-a3c7-30c44961fd18 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:31.043725 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e7190-eb5d-4f79-a3c7-30c44961fd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:31.094913 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-0f4e7190-eb5d-4f79-a3c7-30c44961fd18 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:31.101985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0f4e7190-eb5d-4f79-a3c7-30c44961fd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:31.334708 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1119/2236] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:31.363437 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1c571-80eb-48ac-9b73-d10d9e057b20 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:31.370563 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e7190-eb5d-4f79-a3c7-30c44961fd18 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:31.372078 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9ae1c571-80eb-48ac-9b73-d10d9e057b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:31.374037 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0f4e7190-eb5d-4f79-a3c7-30c44961fd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:31.433905 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:31.526087 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e7190-eb5d-4f79-a3c7-30c44961fd18 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:31.536902 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab4ef0-d580-485c-8394-b01a518235da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:31.538085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab4ef0-d580-485c-8394-b01a518235da service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:31.538594 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab4ef0-d580-485c-8394-b01a518235da service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:31.540103 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab4ef0-d580-485c-8394-b01a518235da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:31.545618 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1bab4ef0-d580-485c-8394-b01a518235da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:31.558481 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1c571-80eb-48ac-9b73-d10d9e057b20 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:31.567168 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e2b37-5ecb-4e7c-a650-6504182fb2c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:31.567839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e2b37-5ecb-4e7c-a650-6504182fb2c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:31.568120 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e2b37-5ecb-4e7c-a650-6504182fb2c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:31.568390 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e2b37-5ecb-4e7c-a650-6504182fb2c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:31.584003 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e2b37-5ecb-4e7c-a650-6504182fb2c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:31.589169 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e2b37-5ecb-4e7c-a650-6504182fb2c6 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:31.604722 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1118/2237] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:31.605701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e2b37-5ecb-4e7c-a650-6504182fb2c6 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:31.607312 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8a5e2b37-5ecb-4e7c-a650-6504182fb2c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:31.648648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab4ef0-d580-485c-8394-b01a518235da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:31.650554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab4ef0-d580-485c-8394-b01a518235da service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:31.651661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e2b37-5ecb-4e7c-a650-6504182fb2c6 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:31.662958 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0a81b-5c1b-43e0-a682-c1593454f7cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:31.663596 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0a81b-5c1b-43e0-a682-c1593454f7cb service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:31.664268 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1120/2238] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:31:31.665266 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab4ef0-d580-485c-8394-b01a518235da service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:31.666966 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1bab4ef0-d580-485c-8394-b01a518235da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:31.674373 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0a81b-5c1b-43e0-a682-c1593454f7cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:31.675016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0a81b-5c1b-43e0-a682-c1593454f7cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:31.683987 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab4ef0-d580-485c-8394-b01a518235da service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:31.688518 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0ae0a81b-5c1b-43e0-a682-c1593454f7cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:31.691297 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f178c0e-1386-4dfa-a08c-4ecb01fff80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:31.692185 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f178c0e-1386-4dfa-a08c-4ecb01fff80b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:31.693236 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f178c0e-1386-4dfa-a08c-4ecb01fff80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:31.693633 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f178c0e-1386-4dfa-a08c-4ecb01fff80b admin admin] PATH_INFO: `/v3/projects/f9200e419f2948a089bb32442942a7c3` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:31.695456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f178c0e-1386-4dfa-a08c-4ecb01fff80b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9200e419f2948a089bb32442942a7c3)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:31.698701 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f178c0e-1386-4dfa-a08c-4ecb01fff80b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:31.811363 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2f178c0e-1386-4dfa-a08c-4ecb01fff80b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9200e419f2948a089bb32442942a7c3', 'request_id': 'req-2f178c0e-1386-4dfa-a08c-4ecb01fff80b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:31.821414 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2f178c0e-1386-4dfa-a08c-4ecb01fff80b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9200e419f2948a089bb32442942a7c3', 'request_id': 'req-2f178c0e-1386-4dfa-a08c-4ecb01fff80b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:31.830252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2f178c0e-1386-4dfa-a08c-4ecb01fff80b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9200e419f2948a089bb32442942a7c3', 'request_id': 'req-2f178c0e-1386-4dfa-a08c-4ecb01fff80b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:31.864381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2f178c0e-1386-4dfa-a08c-4ecb01fff80b admin admin] The token cache is being invalidate because project f9200e419f2948a089bb32442942a7c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:31.864738 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2f178c0e-1386-4dfa-a08c-4ecb01fff80b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:31.871327 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2f178c0e-1386-4dfa-a08c-4ecb01fff80b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:31.877378 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1121/2239] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:31 2022] DELETE /identity/v3/projects/f9200e419f2948a089bb32442942a7c3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:31.884562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f178c0e-1386-4dfa-a08c-4ecb01fff80b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:31.887791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0a81b-5c1b-43e0-a682-c1593454f7cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:31.889573 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2f178c0e-1386-4dfa-a08c-4ecb01fff80b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:31.899390 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0a81b-5c1b-43e0-a682-c1593454f7cb service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:31.931174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1119/2240] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:32.049408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:32.100615 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f178c0e-1386-4dfa-a08c-4ecb01fff80b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:32.110285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2aca4e-c8c1-4d57-adfa-e6260bd92bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:32.120193 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2aca4e-c8c1-4d57-adfa-e6260bd92bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:32.120799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2aca4e-c8c1-4d57-adfa-e6260bd92bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:32.121252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2aca4e-c8c1-4d57-adfa-e6260bd92bea admin admin] PATH_INFO: `/v3/users/1dc6a697d4ff42f2b1db149f02dc751c` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:32.123157 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2aca4e-c8c1-4d57-adfa-e6260bd92bea admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dc6a697d4ff42f2b1db149f02dc751c)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:32.127406 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2aca4e-c8c1-4d57-adfa-e6260bd92bea admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:32.228447 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8d2aca4e-c8c1-4d57-adfa-e6260bd92bea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dc6a697d4ff42f2b1db149f02dc751c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:32.248426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8d2aca4e-c8c1-4d57-adfa-e6260bd92bea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dc6a697d4ff42f2b1db149f02dc751c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:32.249353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8d2aca4e-c8c1-4d57-adfa-e6260bd92bea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dc6a697d4ff42f2b1db149f02dc751c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:32.269841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8d2aca4e-c8c1-4d57-adfa-e6260bd92bea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dc6a697d4ff42f2b1db149f02dc751c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:32.293897 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-8d2aca4e-c8c1-4d57-adfa-e6260bd92bea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dc6a697d4ff42f2b1db149f02dc751c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:32.319075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1122/2241] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:31 2022] DELETE /identity/v3/users/1dc6a697d4ff42f2b1db149f02dc751c => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:31:32.709999 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0a81b-5c1b-43e0-a682-c1593454f7cb service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:32.711795 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0ae0a81b-5c1b-43e0-a682-c1593454f7cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:32.734872 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0a81b-5c1b-43e0-a682-c1593454f7cb service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:32.778963 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:32.869400 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728bbf62-dc29-4b08-b0fe-e2fb59597e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:32.874557 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728bbf62-dc29-4b08-b0fe-e2fb59597e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:32.875177 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728bbf62-dc29-4b08-b0fe-e2fb59597e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:32.875540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728bbf62-dc29-4b08-b0fe-e2fb59597e20 admin admin] PATH_INFO: `/v3/projects/434f17be084245ef95e7b33dc4b5d75e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:32.891206 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728bbf62-dc29-4b08-b0fe-e2fb59597e20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=434f17be084245ef95e7b33dc4b5d75e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:32.903469 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728bbf62-dc29-4b08-b0fe-e2fb59597e20 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:33.010003 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-728bbf62-dc29-4b08-b0fe-e2fb59597e20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '434f17be084245ef95e7b33dc4b5d75e', 'request_id': 'req-728bbf62-dc29-4b08-b0fe-e2fb59597e20'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:33.019739 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-728bbf62-dc29-4b08-b0fe-e2fb59597e20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '434f17be084245ef95e7b33dc4b5d75e', 'request_id': 'req-728bbf62-dc29-4b08-b0fe-e2fb59597e20'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:33.027834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-728bbf62-dc29-4b08-b0fe-e2fb59597e20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '434f17be084245ef95e7b33dc4b5d75e', 'request_id': 'req-728bbf62-dc29-4b08-b0fe-e2fb59597e20'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:33.049682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-728bbf62-dc29-4b08-b0fe-e2fb59597e20 admin admin] The token cache is being invalidate because project 434f17be084245ef95e7b33dc4b5d75e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:33.049976 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-728bbf62-dc29-4b08-b0fe-e2fb59597e20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:33.051194 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-728bbf62-dc29-4b08-b0fe-e2fb59597e20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:33.053713 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1120/2242] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:32 2022] DELETE /identity/v3/projects/434f17be084245ef95e7b33dc4b5d75e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:33.058237 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2aca4e-c8c1-4d57-adfa-e6260bd92bea admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:33.060693 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8d2aca4e-c8c1-4d57-adfa-e6260bd92bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:33.078538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2aca4e-c8c1-4d57-adfa-e6260bd92bea admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:33.178623 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e20cc-e288-4a1d-8036-9c6f83858b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:33.179501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e20cc-e288-4a1d-8036-9c6f83858b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:33.180021 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e20cc-e288-4a1d-8036-9c6f83858b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:33.180516 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e20cc-e288-4a1d-8036-9c6f83858b18 admin admin] PATH_INFO: `/v3/users/7f30c5bdcb774cee8e0c6fe79ac33fc1` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:33.182087 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e20cc-e288-4a1d-8036-9c6f83858b18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f30c5bdcb774cee8e0c6fe79ac33fc1)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:33.184248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e20cc-e288-4a1d-8036-9c6f83858b18 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:33.253492 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4e6e20cc-e288-4a1d-8036-9c6f83858b18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f30c5bdcb774cee8e0c6fe79ac33fc1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:33.265447 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4e6e20cc-e288-4a1d-8036-9c6f83858b18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f30c5bdcb774cee8e0c6fe79ac33fc1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:33.266491 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4e6e20cc-e288-4a1d-8036-9c6f83858b18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f30c5bdcb774cee8e0c6fe79ac33fc1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:33.282891 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:33.284864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4e6e20cc-e288-4a1d-8036-9c6f83858b18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f30c5bdcb774cee8e0c6fe79ac33fc1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:33.310004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4e6e20cc-e288-4a1d-8036-9c6f83858b18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f30c5bdcb774cee8e0c6fe79ac33fc1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:33.319435 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1123/2243] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:33 2022] DELETE /identity/v3/users/7f30c5bdcb774cee8e0c6fe79ac33fc1 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:31:33.631190 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728bbf62-dc29-4b08-b0fe-e2fb59597e20 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:33.633659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-728bbf62-dc29-4b08-b0fe-e2fb59597e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:33.659722 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728bbf62-dc29-4b08-b0fe-e2fb59597e20 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:33.779491 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd9772-6085-426d-a175-f57ba94cd883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:33.780641 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd9772-6085-426d-a175-f57ba94cd883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:33.781387 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd9772-6085-426d-a175-f57ba94cd883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:33.781963 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd9772-6085-426d-a175-f57ba94cd883 admin admin] PATH_INFO: `/v3/projects/967d3cb44c1d4d0ead9d9a0d7de79cbf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:33.783371 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd9772-6085-426d-a175-f57ba94cd883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=967d3cb44c1d4d0ead9d9a0d7de79cbf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:33.785584 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd9772-6085-426d-a175-f57ba94cd883 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:33.883930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-2ebd9772-6085-426d-a175-f57ba94cd883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '967d3cb44c1d4d0ead9d9a0d7de79cbf', 'request_id': 'req-2ebd9772-6085-426d-a175-f57ba94cd883'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:33.885272 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:33.893065 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-2ebd9772-6085-426d-a175-f57ba94cd883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '967d3cb44c1d4d0ead9d9a0d7de79cbf', 'request_id': 'req-2ebd9772-6085-426d-a175-f57ba94cd883'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:33.901265 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-2ebd9772-6085-426d-a175-f57ba94cd883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '967d3cb44c1d4d0ead9d9a0d7de79cbf', 'request_id': 'req-2ebd9772-6085-426d-a175-f57ba94cd883'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:33.924429 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-2ebd9772-6085-426d-a175-f57ba94cd883 admin admin] The token cache is being invalidate because project 967d3cb44c1d4d0ead9d9a0d7de79cbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:33.924709 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-2ebd9772-6085-426d-a175-f57ba94cd883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:33.926295 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-2ebd9772-6085-426d-a175-f57ba94cd883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:33.933105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1121/2244] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:33 2022] DELETE /identity/v3/projects/967d3cb44c1d4d0ead9d9a0d7de79cbf => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:33.935307 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fadbc-d0cf-41cf-856f-977bb3d2163f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:33.935602 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fadbc-d0cf-41cf-856f-977bb3d2163f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:33.935913 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fadbc-d0cf-41cf-856f-977bb3d2163f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:33.961804 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-090fadbc-d0cf-41cf-856f-977bb3d2163f None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:33.963050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-090fadbc-d0cf-41cf-856f-977bb3d2163f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:33.967842 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd9772-6085-426d-a175-f57ba94cd883 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:33.970125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2ebd9772-6085-426d-a175-f57ba94cd883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:34.086244 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd9772-6085-426d-a175-f57ba94cd883 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:34.091167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1124/2245] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:34.093297 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83a970-f7f6-48b5-abf0-a7cc058ff64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:34.093969 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83a970-f7f6-48b5-abf0-a7cc058ff64d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:34.094254 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83a970-f7f6-48b5-abf0-a7cc058ff64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:34.097111 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83a970-f7f6-48b5-abf0-a7cc058ff64d admin admin] PATH_INFO: `/v3/projects/473e8865891448759aa4d11fa2eed485` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:34.098672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83a970-f7f6-48b5-abf0-a7cc058ff64d admin admin] RBAC: Authorizing `identity:delete_project(project_id=473e8865891448759aa4d11fa2eed485)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:34.099582 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f877f77-3576-4283-88a9-5afed9b6e86d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:34.099941 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f877f77-3576-4283-88a9-5afed9b6e86d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:34.100283 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f877f77-3576-4283-88a9-5afed9b6e86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:34.100641 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83a970-f7f6-48b5-abf0-a7cc058ff64d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:34.122558 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-4f877f77-3576-4283-88a9-5afed9b6e86d None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:34.123934 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4f877f77-3576-4283-88a9-5afed9b6e86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:34.133246 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1125/2246] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:31:34.139467 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f877f77-3576-4283-88a9-5afed9b6e86d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:34.148978 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f877f77-3576-4283-88a9-5afed9b6e86d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:34.164333 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-df83a970-f7f6-48b5-abf0-a7cc058ff64d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '473e8865891448759aa4d11fa2eed485', 'request_id': 'req-df83a970-f7f6-48b5-abf0-a7cc058ff64d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:34.171800 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-df83a970-f7f6-48b5-abf0-a7cc058ff64d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '473e8865891448759aa4d11fa2eed485', 'request_id': 'req-df83a970-f7f6-48b5-abf0-a7cc058ff64d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:34.179657 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-df83a970-f7f6-48b5-abf0-a7cc058ff64d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '473e8865891448759aa4d11fa2eed485', 'request_id': 'req-df83a970-f7f6-48b5-abf0-a7cc058ff64d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:34.196811 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-df83a970-f7f6-48b5-abf0-a7cc058ff64d admin admin] The token cache is being invalidate because project 473e8865891448759aa4d11fa2eed485 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:34.197223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-df83a970-f7f6-48b5-abf0-a7cc058ff64d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:34.201700 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-df83a970-f7f6-48b5-abf0-a7cc058ff64d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:34.203486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1122/2247] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:33 2022] DELETE /identity/v3/projects/473e8865891448759aa4d11fa2eed485 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:31:34.208275 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319b7f9-1460-4c57-9f8c-429a3173bce3 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:34.209255 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319b7f9-1460-4c57-9f8c-429a3173bce3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:34.209896 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319b7f9-1460-4c57-9f8c-429a3173bce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:34.214946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156396db-1279-43f7-834b-440068803694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:34.215549 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156396db-1279-43f7-834b-440068803694 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:34.215827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156396db-1279-43f7-834b-440068803694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:34.216096 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156396db-1279-43f7-834b-440068803694 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:34.216795 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156396db-1279-43f7-834b-440068803694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:31:34.217134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156396db-1279-43f7-834b-440068803694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:34.218755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156396db-1279-43f7-834b-440068803694 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:34.230279 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1126/2248] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:31:34.231202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-1319b7f9-1460-4c57-9f8c-429a3173bce3 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:34.232431 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1319b7f9-1460-4c57-9f8c-429a3173bce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:34.234759 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156396db-1279-43f7-834b-440068803694 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:34.236330 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-156396db-1279-43f7-834b-440068803694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:34.241938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1123/2249] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:31:34.249078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156396db-1279-43f7-834b-440068803694 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:34.250379 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98240185-d57f-4ed8-820c-432c77b7aff6 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:34.250741 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98240185-d57f-4ed8-820c-432c77b7aff6 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:34.250958 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98240185-d57f-4ed8-820c-432c77b7aff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:34.253863 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2eeef-6be6-45cc-a20e-eed57b8ca232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:34.254416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2eeef-6be6-45cc-a20e-eed57b8ca232 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:34.254702 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2eeef-6be6-45cc-a20e-eed57b8ca232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:34.255553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2eeef-6be6-45cc-a20e-eed57b8ca232 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:34.256175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2eeef-6be6-45cc-a20e-eed57b8ca232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:34.258113 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2eeef-6be6-45cc-a20e-eed57b8ca232 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:34.270548 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-98240185-d57f-4ed8-820c-432c77b7aff6 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:34.271745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-98240185-d57f-4ed8-820c-432c77b7aff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:34.281171 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1124/2250] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:31:34.285105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98240185-d57f-4ed8-820c-432c77b7aff6 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:34.289537 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1127/2251] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:34 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:31:34.290444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2eeef-6be6-45cc-a20e-eed57b8ca232 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:34.294483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98240185-d57f-4ed8-820c-432c77b7aff6 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:34.343271 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:34.345115 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:34.353976 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404d9d8-7dec-40ad-a38c-56ae5c7d24f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:34.354697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404d9d8-7dec-40ad-a38c-56ae5c7d24f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:34.354995 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404d9d8-7dec-40ad-a38c-56ae5c7d24f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:34.355432 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404d9d8-7dec-40ad-a38c-56ae5c7d24f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:34.356238 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404d9d8-7dec-40ad-a38c-56ae5c7d24f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:31:34.356648 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404d9d8-7dec-40ad-a38c-56ae5c7d24f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:34.356834 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2eeef-6be6-45cc-a20e-eed57b8ca232 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:34.358734 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404d9d8-7dec-40ad-a38c-56ae5c7d24f6 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:34.361840 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e4561-3be7-49fe-b706-81bedb6ec07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:34.362443 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e4561-3be7-49fe-b706-81bedb6ec07e admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:34.362725 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e4561-3be7-49fe-b706-81bedb6ec07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:34.363033 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e4561-3be7-49fe-b706-81bedb6ec07e admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:34.363665 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e4561-3be7-49fe-b706-81bedb6ec07e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:34.366154 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e4561-3be7-49fe-b706-81bedb6ec07e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:34.374683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1125/2252] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:31:34.375624 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404d9d8-7dec-40ad-a38c-56ae5c7d24f6 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:34.387063 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404d9d8-7dec-40ad-a38c-56ae5c7d24f6 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:34.391311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1128/2253] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:34 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:31:34.391715 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd085f-afad-477e-8280-d9a09df9c016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:34.392278 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e4561-3be7-49fe-b706-81bedb6ec07e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:34.392392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd085f-afad-477e-8280-d9a09df9c016 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:34.392568 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd085f-afad-477e-8280-d9a09df9c016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:34.392869 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd085f-afad-477e-8280-d9a09df9c016 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:34.393530 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd085f-afad-477e-8280-d9a09df9c016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:34.395461 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd085f-afad-477e-8280-d9a09df9c016 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:34.402399 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e4561-3be7-49fe-b706-81bedb6ec07e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:34.407118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01084a37-cdb6-41b3-ae72-fd1f66aa43db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:34.407713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01084a37-cdb6-41b3-ae72-fd1f66aa43db admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:34.407995 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01084a37-cdb6-41b3-ae72-fd1f66aa43db admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:34.408272 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01084a37-cdb6-41b3-ae72-fd1f66aa43db admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:34.408920 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01084a37-cdb6-41b3-ae72-fd1f66aa43db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:34.410586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01084a37-cdb6-41b3-ae72-fd1f66aa43db admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:34.421280 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1129/2254] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:34.427594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1126/2255] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:34 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:34.427693 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01084a37-cdb6-41b3-ae72-fd1f66aa43db admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:34.428379 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd085f-afad-477e-8280-d9a09df9c016 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:34.435380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01084a37-cdb6-41b3-ae72-fd1f66aa43db admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:34.503881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1877f-b118-4a45-9160-5ee84182a02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:34.504572 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1877f-b118-4a45-9160-5ee84182a02e admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:34.505278 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1877f-b118-4a45-9160-5ee84182a02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:34.505630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b1877f-b118-4a45-9160-5ee84182a02e admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:34.506392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd085f-afad-477e-8280-d9a09df9c016 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:34.506522 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1877f-b118-4a45-9160-5ee84182a02e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:34.508371 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b1877f-b118-4a45-9160-5ee84182a02e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:34.513877 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c830e1-2668-47f4-98c0-57d5c945be8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:34.514570 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c830e1-2668-47f4-98c0-57d5c945be8a admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:34.516801 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c830e1-2668-47f4-98c0-57d5c945be8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:34.516801 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c830e1-2668-47f4-98c0-57d5c945be8a admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:34.516801 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c830e1-2668-47f4-98c0-57d5c945be8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:34.518149 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c830e1-2668-47f4-98c0-57d5c945be8a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:34.522285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1130/2256] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:31:34.529548 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1877f-b118-4a45-9160-5ee84182a02e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:34.550149 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b1877f-b118-4a45-9160-5ee84182a02e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:34.553289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1127/2257] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:34 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:31:34.556992 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c830e1-2668-47f4-98c0-57d5c945be8a admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:34.561823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b28d62-cbff-4669-b607-18e7b1648603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:34.563367 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b28d62-cbff-4669-b607-18e7b1648603 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:34.563722 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b28d62-cbff-4669-b607-18e7b1648603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:34.564199 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b28d62-cbff-4669-b607-18e7b1648603 admin admin] PATH_INFO: `/v3/projects/24b47790580e47b69800b023ff073a04/users/b993b49bcd294429a1b596054e681f7f/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:34.570859 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c830e1-2668-47f4-98c0-57d5c945be8a admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:34.579465 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10b096-82f5-4e95-8349-d29074aa4227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:34.580353 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10b096-82f5-4e95-8349-d29074aa4227 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:34.580723 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10b096-82f5-4e95-8349-d29074aa4227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:34.580897 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10b096-82f5-4e95-8349-d29074aa4227 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:34.581683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10b096-82f5-4e95-8349-d29074aa4227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:34.583329 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10b096-82f5-4e95-8349-d29074aa4227 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:34.596872 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1128/2258] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:34.601955 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10b096-82f5-4e95-8349-d29074aa4227 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:34.606838 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b28d62-cbff-4669-b607-18e7b1648603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24b47790580e47b69800b023ff073a04, user_id=b993b49bcd294429a1b596054e681f7f, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:34.609830 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b28d62-cbff-4669-b607-18e7b1648603 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:34.615445 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10b096-82f5-4e95-8349-d29074aa4227 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:34.621091 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ec131-3574-46c5-a5af-c8a4a2379593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:34.622280 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ec131-3574-46c5-a5af-c8a4a2379593 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:34.622593 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ec131-3574-46c5-a5af-c8a4a2379593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:34.623012 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ec131-3574-46c5-a5af-c8a4a2379593 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:34.623821 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ec131-3574-46c5-a5af-c8a4a2379593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:34.626145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ec131-3574-46c5-a5af-c8a4a2379593 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:34.639214 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1131/2259] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:34 2022] PUT /identity/v3/projects/24b47790580e47b69800b023ff073a04/users/b993b49bcd294429a1b596054e681f7f/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:34.643532 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1129/2260] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:34.651521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9185d-e44c-43ca-8161-09e091976e42 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:34.652168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9185d-e44c-43ca-8161-09e091976e42 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:34.652600 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9185d-e44c-43ca-8161-09e091976e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:34.655238 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ec131-3574-46c5-a5af-c8a4a2379593 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:34.666540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ec131-3574-46c5-a5af-c8a4a2379593 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:34.705519 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d0a9185d-e44c-43ca-8161-09e091976e42 None None] MFA Rules not processed for user `b993b49bcd294429a1b596054e681f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:34.707203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d0a9185d-e44c-43ca-8161-09e091976e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:34.740861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40257af-5ddb-4d72-9cb3-6c47c02312ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:34.741857 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40257af-5ddb-4d72-9cb3-6c47c02312ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:34.742238 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40257af-5ddb-4d72-9cb3-6c47c02312ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:34.742610 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40257af-5ddb-4d72-9cb3-6c47c02312ba admin admin] PATH_INFO: `/v3/projects/ae05a48c67ee4ba0b7ba54555f2df919/users/80ff291728bd4148ad5bc64cd66c54e4/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:34.774942 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40257af-5ddb-4d72-9cb3-6c47c02312ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae05a48c67ee4ba0b7ba54555f2df919, user_id=80ff291728bd4148ad5bc64cd66c54e4, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:34.778497 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40257af-5ddb-4d72-9cb3-6c47c02312ba admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:34.796835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1130/2261] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:34 2022] PUT /identity/v3/projects/ae05a48c67ee4ba0b7ba54555f2df919/users/80ff291728bd4148ad5bc64cd66c54e4/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:31:34.808411 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac908b-7133-4c26-82b1-72f23feb72c3 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:34.808707 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac908b-7133-4c26-82b1-72f23feb72c3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:34.808982 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac908b-7133-4c26-82b1-72f23feb72c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:34.828593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1132/2262] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:34.850772 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-16ac908b-7133-4c26-82b1-72f23feb72c3 None None] MFA Rules not processed for user `80ff291728bd4148ad5bc64cd66c54e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:34.852310 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-16ac908b-7133-4c26-82b1-72f23feb72c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:34.869393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9185d-e44c-43ca-8161-09e091976e42 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:34.869729 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:34.870356 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d0a9185d-e44c-43ca-8161-09e091976e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:34.920593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:34.952818 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9185d-e44c-43ca-8161-09e091976e42 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:34.975922 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1131/2263] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:34.980422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac908b-7133-4c26-82b1-72f23feb72c3 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:35.038986 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e42bbc-1a71-413f-92b2-e85644f8b468 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:35.041044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e42bbc-1a71-413f-92b2-e85644f8b468 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:35.041345 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e42bbc-1a71-413f-92b2-e85644f8b468 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:35.042106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e42bbc-1a71-413f-92b2-e85644f8b468 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:35.078030 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac908b-7133-4c26-82b1-72f23feb72c3 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:35.084247 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1418906-87b7-48b5-99ee-465fd5f888d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:35.085221 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1418906-87b7-48b5-99ee-465fd5f888d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:35.085511 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1418906-87b7-48b5-99ee-465fd5f888d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:35.085788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1418906-87b7-48b5-99ee-465fd5f888d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:35.086430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1418906-87b7-48b5-99ee-465fd5f888d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:35.088947 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1418906-87b7-48b5-99ee-465fd5f888d4 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:35.106799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e42bbc-1a71-413f-92b2-e85644f8b468 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:35.108834 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e42bbc-1a71-413f-92b2-e85644f8b468 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:35.118156 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1132/2264] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:34 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:31:35.119214 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1133/2265] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:31:35.126019 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1418906-87b7-48b5-99ee-465fd5f888d4 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:35.138878 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e42bbc-1a71-413f-92b2-e85644f8b468 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:35.153535 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e42bbc-1a71-413f-92b2-e85644f8b468 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:35.208579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1418906-87b7-48b5-99ee-465fd5f888d4 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:35.215486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14612dda-eb15-499f-9eca-c8285ff74df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:35.216168 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14612dda-eb15-499f-9eca-c8285ff74df7 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:35.216389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14612dda-eb15-499f-9eca-c8285ff74df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:35.216782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14612dda-eb15-499f-9eca-c8285ff74df7 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:35.217918 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14612dda-eb15-499f-9eca-c8285ff74df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:35.222396 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14612dda-eb15-499f-9eca-c8285ff74df7 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:35.236138 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bccb3-71fb-4987-a9c4-ae1cfc18c29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:35.236831 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bccb3-71fb-4987-a9c4-ae1cfc18c29c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:35.237204 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bccb3-71fb-4987-a9c4-ae1cfc18c29c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:35.237481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bccb3-71fb-4987-a9c4-ae1cfc18c29c admin admin] PATH_INFO: `/v3/users/b993b49bcd294429a1b596054e681f7f` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:35.238861 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bccb3-71fb-4987-a9c4-ae1cfc18c29c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b993b49bcd294429a1b596054e681f7f)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:35.240899 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bccb3-71fb-4987-a9c4-ae1cfc18c29c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:35.246769 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1133/2266] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:35 2022] POST /identity/v3/users => generated 294 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:35.250444 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14612dda-eb15-499f-9eca-c8285ff74df7 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:35.264010 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14612dda-eb15-499f-9eca-c8285ff74df7 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:35.271756 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1c4ef-c96f-4a46-9d51-8cd25fef4a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:35.272662 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1c4ef-c96f-4a46-9d51-8cd25fef4a48 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:35.273409 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1c4ef-c96f-4a46-9d51-8cd25fef4a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:35.273590 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1c4ef-c96f-4a46-9d51-8cd25fef4a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:35.274226 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1c4ef-c96f-4a46-9d51-8cd25fef4a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:35.276308 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1c4ef-c96f-4a46-9d51-8cd25fef4a48 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:35.291247 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1134/2267] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:31:35.295384 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1c4ef-c96f-4a46-9d51-8cd25fef4a48 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:35.307252 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1c4ef-c96f-4a46-9d51-8cd25fef4a48 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:35.312659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd5aa2-f16b-422c-a415-7f232925c7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:35.313401 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd5aa2-f16b-422c-a415-7f232925c7be admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:35.313620 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd5aa2-f16b-422c-a415-7f232925c7be admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:35.313869 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd5aa2-f16b-422c-a415-7f232925c7be admin admin] PATH_INFO: `/v3/projects/b1cf8c87890b47ecb2646e7dff7afc47/users/d2f7426837c24dee98aa0c73395d2862/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:35.324511 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:35.325419 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:35.327595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ae9bccb3-71fb-4987-a9c4-ae1cfc18c29c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b993b49bcd294429a1b596054e681f7f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:35.347331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd5aa2-f16b-422c-a415-7f232925c7be admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1cf8c87890b47ecb2646e7dff7afc47, user_id=d2f7426837c24dee98aa0c73395d2862, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:35.347488 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ae9bccb3-71fb-4987-a9c4-ae1cfc18c29c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b993b49bcd294429a1b596054e681f7f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:35.350801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ae9bccb3-71fb-4987-a9c4-ae1cfc18c29c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b993b49bcd294429a1b596054e681f7f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:35.367184 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd5aa2-f16b-422c-a415-7f232925c7be admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:35.370797 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ae9bccb3-71fb-4987-a9c4-ae1cfc18c29c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b993b49bcd294429a1b596054e681f7f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:35.382471 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ae9bccb3-71fb-4987-a9c4-ae1cfc18c29c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b993b49bcd294429a1b596054e681f7f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:35.391377 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1134/2268] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:35 2022] DELETE /identity/v3/users/b993b49bcd294429a1b596054e681f7f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:31:35.396526 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef2d63-cd0e-4980-b624-e7cfa7334f9c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:35.397573 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1135/2269] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:35 2022] PUT /identity/v3/projects/b1cf8c87890b47ecb2646e7dff7afc47/users/d2f7426837c24dee98aa0c73395d2862/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:31:35.397844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef2d63-cd0e-4980-b624-e7cfa7334f9c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:35.398256 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef2d63-cd0e-4980-b624-e7cfa7334f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:35.401744 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd5aa2-f16b-422c-a415-7f232925c7be admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:35.403760 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-7fcd5aa2-f16b-422c-a415-7f232925c7be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:35.432005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-11ef2d63-cd0e-4980-b624-e7cfa7334f9c None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:35.434593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-11ef2d63-cd0e-4980-b624-e7cfa7334f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:35.511169 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd5aa2-f16b-422c-a415-7f232925c7be admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:35.528050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1135/2270] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:35.595129 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50d233-ab9c-473a-908e-8909ccb92382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:35.596351 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50d233-ab9c-473a-908e-8909ccb92382 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:35.596634 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50d233-ab9c-473a-908e-8909ccb92382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:35.597101 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50d233-ab9c-473a-908e-8909ccb92382 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:35.597967 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50d233-ab9c-473a-908e-8909ccb92382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:35.600397 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50d233-ab9c-473a-908e-8909ccb92382 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:35.623210 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1136/2271] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:35.626931 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef2d63-cd0e-4980-b624-e7cfa7334f9c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:35.627122 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50d233-ab9c-473a-908e-8909ccb92382 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:35.630824 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-11ef2d63-cd0e-4980-b624-e7cfa7334f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:35.648519 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50d233-ab9c-473a-908e-8909ccb92382 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:35.656507 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a399b68-984f-4b2f-b802-7f54d8dc7991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:35.657290 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a399b68-984f-4b2f-b802-7f54d8dc7991 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:35.657562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a399b68-984f-4b2f-b802-7f54d8dc7991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:35.657847 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a399b68-984f-4b2f-b802-7f54d8dc7991 admin admin] PATH_INFO: `/v3/projects/b1cf8c87890b47ecb2646e7dff7afc47/users/d2f7426837c24dee98aa0c73395d2862/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:35.660938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a399b68-984f-4b2f-b802-7f54d8dc7991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1cf8c87890b47ecb2646e7dff7afc47, user_id=d2f7426837c24dee98aa0c73395d2862, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:35.663393 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a399b68-984f-4b2f-b802-7f54d8dc7991 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:35.679711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1137/2272] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:35 2022] PUT /identity/v3/projects/b1cf8c87890b47ecb2646e7dff7afc47/users/d2f7426837c24dee98aa0c73395d2862/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:35.693774 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0d2b9-686f-4a25-90d7-2cf4de7f7ab8 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:35.694098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0d2b9-686f-4a25-90d7-2cf4de7f7ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:35.694371 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0d2b9-686f-4a25-90d7-2cf4de7f7ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:35.736108 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-f8a0d2b9-686f-4a25-90d7-2cf4de7f7ab8 None None] MFA Rules not processed for user `d2f7426837c24dee98aa0c73395d2862`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:35.736979 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef2d63-cd0e-4980-b624-e7cfa7334f9c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:35.737438 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f8a0d2b9-686f-4a25-90d7-2cf4de7f7ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:35.806744 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5361a-2d9c-4a50-af40-cca5432f15b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:35.807461 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5361a-2d9c-4a50-af40-cca5432f15b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:35.807673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5361a-2d9c-4a50-af40-cca5432f15b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:35.807945 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5361a-2d9c-4a50-af40-cca5432f15b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:35.833181 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1138/2273] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:35.841886 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0d2b9-686f-4a25-90d7-2cf4de7f7ab8 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:35.843998 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f8a0d2b9-686f-4a25-90d7-2cf4de7f7ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:35.850539 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:35.882876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:35.925801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f5361a-2d9c-4a50-af40-cca5432f15b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:35.928169 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f5361a-2d9c-4a50-af40-cca5432f15b3 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:35.938919 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1136/2274] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:35.947361 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0d2b9-686f-4a25-90d7-2cf4de7f7ab8 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:35.952351 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f61e0-ab0e-400f-acd7-98e42026aa51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:35.953079 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f61e0-ab0e-400f-acd7-98e42026aa51 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:35.953428 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f61e0-ab0e-400f-acd7-98e42026aa51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:35.953912 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f61e0-ab0e-400f-acd7-98e42026aa51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:35.955838 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-bb6f61e0-ab0e-400f-acd7-98e42026aa51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:36.029993 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f61e0-ab0e-400f-acd7-98e42026aa51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:36.031544 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f61e0-ab0e-400f-acd7-98e42026aa51 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:36.043565 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1139/2275] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:31:36.298050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5361a-2d9c-4a50-af40-cca5432f15b3 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:36.299521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b7f5361a-2d9c-4a50-af40-cca5432f15b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:36.314042 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5361a-2d9c-4a50-af40-cca5432f15b3 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:36.319383 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f626f-3a49-47fa-b0e3-9ef372ddd7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:36.320022 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f626f-3a49-47fa-b0e3-9ef372ddd7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:36.320304 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f626f-3a49-47fa-b0e3-9ef372ddd7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:36.320580 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f626f-3a49-47fa-b0e3-9ef372ddd7f7 admin admin] PATH_INFO: `/v3/users/f4d596d4043d45b1a698a6c2fe9da392` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:36.321749 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f626f-3a49-47fa-b0e3-9ef372ddd7f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4d596d4043d45b1a698a6c2fe9da392)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:36.323870 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f626f-3a49-47fa-b0e3-9ef372ddd7f7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:36.388928 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f61e0-ab0e-400f-acd7-98e42026aa51 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:36.390546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-bb6f61e0-ab0e-400f-acd7-98e42026aa51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:36.415739 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f61e0-ab0e-400f-acd7-98e42026aa51 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:36.427645 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78253dfc-39ee-497b-a866-9d24f40f9f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:36.428297 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dc6f626f-3a49-47fa-b0e3-9ef372ddd7f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4d596d4043d45b1a698a6c2fe9da392'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:36.430907 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78253dfc-39ee-497b-a866-9d24f40f9f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:36.431187 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78253dfc-39ee-497b-a866-9d24f40f9f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:36.432410 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78253dfc-39ee-497b-a866-9d24f40f9f8d admin admin] PATH_INFO: `/v3/projects/24b47790580e47b69800b023ff073a04` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:36.434465 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78253dfc-39ee-497b-a866-9d24f40f9f8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=24b47790580e47b69800b023ff073a04)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:36.436469 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78253dfc-39ee-497b-a866-9d24f40f9f8d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:36.442677 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dc6f626f-3a49-47fa-b0e3-9ef372ddd7f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4d596d4043d45b1a698a6c2fe9da392'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:36.444012 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dc6f626f-3a49-47fa-b0e3-9ef372ddd7f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4d596d4043d45b1a698a6c2fe9da392'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:36.459895 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dc6f626f-3a49-47fa-b0e3-9ef372ddd7f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4d596d4043d45b1a698a6c2fe9da392'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:36.467289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dc6f626f-3a49-47fa-b0e3-9ef372ddd7f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4d596d4043d45b1a698a6c2fe9da392'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:36.473925 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1137/2276] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:36 2022] DELETE /identity/v3/users/f4d596d4043d45b1a698a6c2fe9da392 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:36.479625 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c176b51-2f9a-4ac0-9dec-96e515f6a348 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:36.479934 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c176b51-2f9a-4ac0-9dec-96e515f6a348 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:36.480196 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c176b51-2f9a-4ac0-9dec-96e515f6a348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:36.496755 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-78253dfc-39ee-497b-a866-9d24f40f9f8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24b47790580e47b69800b023ff073a04', 'request_id': 'req-78253dfc-39ee-497b-a866-9d24f40f9f8d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:36.499464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2c176b51-2f9a-4ac0-9dec-96e515f6a348 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:36.500799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2c176b51-2f9a-4ac0-9dec-96e515f6a348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:36.502223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-78253dfc-39ee-497b-a866-9d24f40f9f8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24b47790580e47b69800b023ff073a04', 'request_id': 'req-78253dfc-39ee-497b-a866-9d24f40f9f8d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:36.508336 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-78253dfc-39ee-497b-a866-9d24f40f9f8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24b47790580e47b69800b023ff073a04', 'request_id': 'req-78253dfc-39ee-497b-a866-9d24f40f9f8d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:36.522000 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-78253dfc-39ee-497b-a866-9d24f40f9f8d admin admin] The token cache is being invalidate because project 24b47790580e47b69800b023ff073a04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:36.522289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-78253dfc-39ee-497b-a866-9d24f40f9f8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:36.522909 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-78253dfc-39ee-497b-a866-9d24f40f9f8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:36.524392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1140/2277] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:36 2022] DELETE /identity/v3/projects/24b47790580e47b69800b023ff073a04 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:36.529037 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e0b68-32fd-4f98-8b46-03cb8b880331 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:36.529396 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e0b68-32fd-4f98-8b46-03cb8b880331 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:36.529680 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e0b68-32fd-4f98-8b46-03cb8b880331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:36.550570 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-788e0b68-32fd-4f98-8b46-03cb8b880331 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:36.551739 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-788e0b68-32fd-4f98-8b46-03cb8b880331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:36.568043 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1138/2278] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:36.575013 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c176b51-2f9a-4ac0-9dec-96e515f6a348 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:36.576720 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2c176b51-2f9a-4ac0-9dec-96e515f6a348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:36.586719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:36.615503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1141/2279] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:31:36.623337 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ad34f-13c7-4cbf-a4dc-32390d9cb650 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:36.623624 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ad34f-13c7-4cbf-a4dc-32390d9cb650 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:36.623897 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ad34f-13c7-4cbf-a4dc-32390d9cb650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:36.624626 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:36.638247 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c176b51-2f9a-4ac0-9dec-96e515f6a348 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:36.642195 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81c8bf-487f-465d-a572-d35d0458bcf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:36.642791 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81c8bf-487f-465d-a572-d35d0458bcf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:36.643068 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81c8bf-487f-465d-a572-d35d0458bcf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:36.643190 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-435ad34f-13c7-4cbf-a4dc-32390d9cb650 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:36.643338 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81c8bf-487f-465d-a572-d35d0458bcf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:36.644286 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-435ad34f-13c7-4cbf-a4dc-32390d9cb650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:36.652735 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1142/2280] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:31:36.653038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81c8bf-487f-465d-a572-d35d0458bcf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:36.654520 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81c8bf-487f-465d-a572-d35d0458bcf2 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:36.656756 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ad34f-13c7-4cbf-a4dc-32390d9cb650 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:36.664883 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1139/2281] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:31:36.666245 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ad34f-13c7-4cbf-a4dc-32390d9cb650 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:36.670946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f30dbb-dec5-4fe0-92d6-25a3d93b0900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:36.671542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f30dbb-dec5-4fe0-92d6-25a3d93b0900 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:36.671824 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f30dbb-dec5-4fe0-92d6-25a3d93b0900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:36.672096 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f30dbb-dec5-4fe0-92d6-25a3d93b0900 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:36.672749 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f30dbb-dec5-4fe0-92d6-25a3d93b0900 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:31:36.673084 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f30dbb-dec5-4fe0-92d6-25a3d93b0900 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:36.674688 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f30dbb-dec5-4fe0-92d6-25a3d93b0900 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:36.687237 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1143/2282] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:31:36.692288 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81c8bf-487f-465d-a572-d35d0458bcf2 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:36.704643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81c8bf-487f-465d-a572-d35d0458bcf2 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:36.710061 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed841d-5eb8-48d1-928b-3255461ab47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:36.710667 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed841d-5eb8-48d1-928b-3255461ab47b admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:36.710950 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed841d-5eb8-48d1-928b-3255461ab47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:36.711223 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed841d-5eb8-48d1-928b-3255461ab47b admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:36.711850 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed841d-5eb8-48d1-928b-3255461ab47b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:36.713808 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed841d-5eb8-48d1-928b-3255461ab47b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:36.741463 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1140/2283] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:36 2022] POST /identity/v3/projects => generated 359 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:36.745696 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f30dbb-dec5-4fe0-92d6-25a3d93b0900 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:36.757029 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f30dbb-dec5-4fe0-92d6-25a3d93b0900 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:36.816275 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac8b98-bc41-4499-9da8-9c2f215ae8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:36.817628 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac8b98-bc41-4499-9da8-9c2f215ae8b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:36.818303 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac8b98-bc41-4499-9da8-9c2f215ae8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:36.818424 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac8b98-bc41-4499-9da8-9c2f215ae8b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:36.819140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac8b98-bc41-4499-9da8-9c2f215ae8b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:36.821168 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac8b98-bc41-4499-9da8-9c2f215ae8b1 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:36.853422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1144/2284] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:36 2022] POST /identity/v3/users => generated 280 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:31:36.861097 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed841d-5eb8-48d1-928b-3255461ab47b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:36.876926 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed841d-5eb8-48d1-928b-3255461ab47b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:36.887031 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb12e1-9a05-4f34-8255-36c2285344d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:36.890331 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb12e1-9a05-4f34-8255-36c2285344d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:36.890657 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb12e1-9a05-4f34-8255-36c2285344d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:36.890961 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb12e1-9a05-4f34-8255-36c2285344d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:36.893433 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb12e1-9a05-4f34-8255-36c2285344d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:36.895077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb12e1-9a05-4f34-8255-36c2285344d1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:36.923370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1141/2285] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:36.924318 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac8b98-bc41-4499-9da8-9c2f215ae8b1 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:36.936082 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac8b98-bc41-4499-9da8-9c2f215ae8b1 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:36.942587 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2c7cc-69e2-4c9e-840e-3b988bc39768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:36.943238 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2c7cc-69e2-4c9e-840e-3b988bc39768 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:36.943522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2c7cc-69e2-4c9e-840e-3b988bc39768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:36.943844 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2c7cc-69e2-4c9e-840e-3b988bc39768 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:36.944561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2c7cc-69e2-4c9e-840e-3b988bc39768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:36.946320 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2c7cc-69e2-4c9e-840e-3b988bc39768 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:36.960484 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1145/2286] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:31:36.964468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb12e1-9a05-4f34-8255-36c2285344d1 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:36.979148 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb12e1-9a05-4f34-8255-36c2285344d1 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:36.988061 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38667f-4049-4e53-8768-325a2cc02cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:36.991989 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38667f-4049-4e53-8768-325a2cc02cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:36.992394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38667f-4049-4e53-8768-325a2cc02cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:36.992774 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38667f-4049-4e53-8768-325a2cc02cf9 admin admin] PATH_INFO: `/v3/projects/6e50fbb2f6c5497f85ed9128d5bf4bd7/users/0a953573583e4354afd41abaf771fbec/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:37.019567 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38667f-4049-4e53-8768-325a2cc02cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e50fbb2f6c5497f85ed9128d5bf4bd7, user_id=0a953573583e4354afd41abaf771fbec, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:37.023020 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38667f-4049-4e53-8768-325a2cc02cf9 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:37.039207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1142/2287] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:36 2022] PUT /identity/v3/projects/6e50fbb2f6c5497f85ed9128d5bf4bd7/users/0a953573583e4354afd41abaf771fbec/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:37.049395 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ba7cb-dcd6-4f78-9034-c83134ded8b0 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:37.049687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ba7cb-dcd6-4f78-9034-c83134ded8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:37.050054 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ba7cb-dcd6-4f78-9034-c83134ded8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:37.102136 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-161ba7cb-dcd6-4f78-9034-c83134ded8b0 None None] MFA Rules not processed for user `0a953573583e4354afd41abaf771fbec`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:37.103448 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-161ba7cb-dcd6-4f78-9034-c83134ded8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:37.108055 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38667f-4049-4e53-8768-325a2cc02cf9 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:37.110075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1c38667f-4049-4e53-8768-325a2cc02cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:37.242090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38667f-4049-4e53-8768-325a2cc02cf9 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:37.247556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525abe5-600e-4694-a118-3da6c21540e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:37.247868 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1146/2288] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:37.249048 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525abe5-600e-4694-a118-3da6c21540e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:37.249419 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525abe5-600e-4694-a118-3da6c21540e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:37.249931 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525abe5-600e-4694-a118-3da6c21540e7 admin admin] PATH_INFO: `/v3/projects/9e2f292d41a241cabd43439496046bd5` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:37.251444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525abe5-600e-4694-a118-3da6c21540e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e2f292d41a241cabd43439496046bd5)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:37.253812 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525abe5-600e-4694-a118-3da6c21540e7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:37.297346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ba7cb-dcd6-4f78-9034-c83134ded8b0 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:37.298771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-161ba7cb-dcd6-4f78-9034-c83134ded8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:37.334563 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a525abe5-600e-4694-a118-3da6c21540e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e2f292d41a241cabd43439496046bd5', 'request_id': 'req-a525abe5-600e-4694-a118-3da6c21540e7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:37.342157 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a525abe5-600e-4694-a118-3da6c21540e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e2f292d41a241cabd43439496046bd5', 'request_id': 'req-a525abe5-600e-4694-a118-3da6c21540e7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:37.346517 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:37.353880 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a525abe5-600e-4694-a118-3da6c21540e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e2f292d41a241cabd43439496046bd5', 'request_id': 'req-a525abe5-600e-4694-a118-3da6c21540e7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:37.373350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a525abe5-600e-4694-a118-3da6c21540e7 admin admin] The token cache is being invalidate because project 9e2f292d41a241cabd43439496046bd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:37.373962 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a525abe5-600e-4694-a118-3da6c21540e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:37.374410 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a525abe5-600e-4694-a118-3da6c21540e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:37.381000 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1143/2289] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:37 2022] DELETE /identity/v3/projects/9e2f292d41a241cabd43439496046bd5 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:31:37.382434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525abe5-600e-4694-a118-3da6c21540e7 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:37.384011 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a525abe5-600e-4694-a118-3da6c21540e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:37.397609 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ba7cb-dcd6-4f78-9034-c83134ded8b0 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:37.410708 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:37.475410 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525abe5-600e-4694-a118-3da6c21540e7 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:37.476033 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc6ed2-1f62-4401-9863-362a7e2a5774 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:37.476737 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc6ed2-1f62-4401-9863-362a7e2a5774 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:37.477038 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc6ed2-1f62-4401-9863-362a7e2a5774 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:37.477322 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc6ed2-1f62-4401-9863-362a7e2a5774 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:37.481925 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c331b84-c729-4594-bee4-5d4137ebc1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:37.482925 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c331b84-c729-4594-bee4-5d4137ebc1b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:37.483178 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c331b84-c729-4594-bee4-5d4137ebc1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:37.483528 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c331b84-c729-4594-bee4-5d4137ebc1b7 admin admin] PATH_INFO: `/v3/users/dd7928192a5c4c71b17118595598c049` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:37.484782 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c331b84-c729-4594-bee4-5d4137ebc1b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd7928192a5c4c71b17118595598c049)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:37.486834 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c331b84-c729-4594-bee4-5d4137ebc1b7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:37.495345 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d5bc6ed2-1f62-4401-9863-362a7e2a5774 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:37.548348 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7c331b84-c729-4594-bee4-5d4137ebc1b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd7928192a5c4c71b17118595598c049'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:37.560900 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7c331b84-c729-4594-bee4-5d4137ebc1b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd7928192a5c4c71b17118595598c049'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:37.561881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7c331b84-c729-4594-bee4-5d4137ebc1b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd7928192a5c4c71b17118595598c049'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:37.578996 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7c331b84-c729-4594-bee4-5d4137ebc1b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd7928192a5c4c71b17118595598c049'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:37.582320 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc6ed2-1f62-4401-9863-362a7e2a5774 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:37.584126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc6ed2-1f62-4401-9863-362a7e2a5774 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:37.590739 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7c331b84-c729-4594-bee4-5d4137ebc1b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd7928192a5c4c71b17118595598c049'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:37.604867 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1144/2290] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:37 2022] DELETE /identity/v3/users/dd7928192a5c4c71b17118595598c049 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:37.617523 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1147/2291] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:37.623652 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c331b84-c729-4594-bee4-5d4137ebc1b7 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:37.626034 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7c331b84-c729-4594-bee4-5d4137ebc1b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:37.742236 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c331b84-c729-4594-bee4-5d4137ebc1b7 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:37.748202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec350353-5338-40e2-ae6b-476e0dc0e9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:37.748938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec350353-5338-40e2-ae6b-476e0dc0e9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:37.749350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec350353-5338-40e2-ae6b-476e0dc0e9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:37.749919 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec350353-5338-40e2-ae6b-476e0dc0e9b5 admin admin] PATH_INFO: `/v3/users/0a953573583e4354afd41abaf771fbec` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:37.751340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec350353-5338-40e2-ae6b-476e0dc0e9b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a953573583e4354afd41abaf771fbec)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:37.753657 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec350353-5338-40e2-ae6b-476e0dc0e9b5 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:37.816248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:37.831583 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ec350353-5338-40e2-ae6b-476e0dc0e9b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a953573583e4354afd41abaf771fbec'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:37.846221 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ec350353-5338-40e2-ae6b-476e0dc0e9b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a953573583e4354afd41abaf771fbec'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:37.846981 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ec350353-5338-40e2-ae6b-476e0dc0e9b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a953573583e4354afd41abaf771fbec'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:37.865218 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ec350353-5338-40e2-ae6b-476e0dc0e9b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a953573583e4354afd41abaf771fbec'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:37.880351 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ec350353-5338-40e2-ae6b-476e0dc0e9b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a953573583e4354afd41abaf771fbec'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:37.898752 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1145/2292] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:37 2022] DELETE /identity/v3/users/0a953573583e4354afd41abaf771fbec => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:31:37.900891 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de16a82-b834-41b1-affe-7eb61ecce0c3 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:37.901415 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de16a82-b834-41b1-affe-7eb61ecce0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:37.901498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de16a82-b834-41b1-affe-7eb61ecce0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:37.937673 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-6de16a82-b834-41b1-affe-7eb61ecce0c3 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:37.938477 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6de16a82-b834-41b1-affe-7eb61ecce0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:38.031658 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1148/2293] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:38.084139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec350353-5338-40e2-ae6b-476e0dc0e9b5 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:38.085987 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ec350353-5338-40e2-ae6b-476e0dc0e9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:38.150055 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec350353-5338-40e2-ae6b-476e0dc0e9b5 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:38.154225 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22164d4-e39e-40ad-81a7-e30deb2ac06d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:38.154914 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22164d4-e39e-40ad-81a7-e30deb2ac06d service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:38.155623 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22164d4-e39e-40ad-81a7-e30deb2ac06d service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:38.155968 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22164d4-e39e-40ad-81a7-e30deb2ac06d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:38.168633 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22164d4-e39e-40ad-81a7-e30deb2ac06d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:38.170683 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22164d4-e39e-40ad-81a7-e30deb2ac06d service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:38.181612 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1146/2294] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:38.279522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de16a82-b834-41b1-affe-7eb61ecce0c3 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:38.280970 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6de16a82-b834-41b1-affe-7eb61ecce0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:38.308366 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de16a82-b834-41b1-affe-7eb61ecce0c3 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:38.339211 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fa0b5-8b8e-4ac9-99af-806468bc9fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:38.340620 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fa0b5-8b8e-4ac9-99af-806468bc9fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:38.340620 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fa0b5-8b8e-4ac9-99af-806468bc9fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:38.340620 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fa0b5-8b8e-4ac9-99af-806468bc9fef admin admin] PATH_INFO: `/v3/projects/fb474af8f7f7488087b70c4f9e5a429e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:38.342435 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335fa0b5-8b8e-4ac9-99af-806468bc9fef admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb474af8f7f7488087b70c4f9e5a429e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:38.344489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335fa0b5-8b8e-4ac9-99af-806468bc9fef admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:38.419404 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:38.435573 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-335fa0b5-8b8e-4ac9-99af-806468bc9fef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb474af8f7f7488087b70c4f9e5a429e', 'request_id': 'req-335fa0b5-8b8e-4ac9-99af-806468bc9fef'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:38.444600 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-335fa0b5-8b8e-4ac9-99af-806468bc9fef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb474af8f7f7488087b70c4f9e5a429e', 'request_id': 'req-335fa0b5-8b8e-4ac9-99af-806468bc9fef'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:38.453066 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-335fa0b5-8b8e-4ac9-99af-806468bc9fef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb474af8f7f7488087b70c4f9e5a429e', 'request_id': 'req-335fa0b5-8b8e-4ac9-99af-806468bc9fef'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:38.473757 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-335fa0b5-8b8e-4ac9-99af-806468bc9fef admin admin] The token cache is being invalidate because project fb474af8f7f7488087b70c4f9e5a429e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:38.474062 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-335fa0b5-8b8e-4ac9-99af-806468bc9fef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:38.474798 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-335fa0b5-8b8e-4ac9-99af-806468bc9fef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:38.476570 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1149/2295] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:38 2022] DELETE /identity/v3/projects/fb474af8f7f7488087b70c4f9e5a429e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:38.480400 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22164d4-e39e-40ad-81a7-e30deb2ac06d service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:38.492319 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22164d4-e39e-40ad-81a7-e30deb2ac06d service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:38.560584 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d94557-74cf-4279-8ca6-13a8a79cb747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:38.561952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d94557-74cf-4279-8ca6-13a8a79cb747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:38.562241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d94557-74cf-4279-8ca6-13a8a79cb747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:38.562519 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d94557-74cf-4279-8ca6-13a8a79cb747 admin admin] PATH_INFO: `/v3/users/0a82aa66d48047e6b4c6e254f04a5c16` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:38.563674 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d94557-74cf-4279-8ca6-13a8a79cb747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a82aa66d48047e6b4c6e254f04a5c16)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:38.565882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d94557-74cf-4279-8ca6-13a8a79cb747 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:38.653944 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a1d94557-74cf-4279-8ca6-13a8a79cb747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a82aa66d48047e6b4c6e254f04a5c16'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:38.674031 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a1d94557-74cf-4279-8ca6-13a8a79cb747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a82aa66d48047e6b4c6e254f04a5c16'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:38.674954 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a1d94557-74cf-4279-8ca6-13a8a79cb747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a82aa66d48047e6b4c6e254f04a5c16'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:38.682066 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:38.694192 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a1d94557-74cf-4279-8ca6-13a8a79cb747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a82aa66d48047e6b4c6e254f04a5c16'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:38.703116 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a1d94557-74cf-4279-8ca6-13a8a79cb747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a82aa66d48047e6b4c6e254f04a5c16'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:38.711613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1147/2296] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:38 2022] DELETE /identity/v3/users/0a82aa66d48047e6b4c6e254f04a5c16 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:38.748607 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fa0b5-8b8e-4ac9-99af-806468bc9fef admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:38.750504 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-335fa0b5-8b8e-4ac9-99af-806468bc9fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:38.768110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fa0b5-8b8e-4ac9-99af-806468bc9fef admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:38.944627 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffe5b8-eb79-4745-baf2-d1e2f5b85cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:38.945320 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffe5b8-eb79-4745-baf2-d1e2f5b85cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:38.945657 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffe5b8-eb79-4745-baf2-d1e2f5b85cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:38.945994 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffe5b8-eb79-4745-baf2-d1e2f5b85cf8 admin admin] PATH_INFO: `/v3/users/80ff291728bd4148ad5bc64cd66c54e4` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:38.948932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffe5b8-eb79-4745-baf2-d1e2f5b85cf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80ff291728bd4148ad5bc64cd66c54e4)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:38.953124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffe5b8-eb79-4745-baf2-d1e2f5b85cf8 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:39.033355 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-04ffe5b8-eb79-4745-baf2-d1e2f5b85cf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80ff291728bd4148ad5bc64cd66c54e4'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:39.057747 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-04ffe5b8-eb79-4745-baf2-d1e2f5b85cf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80ff291728bd4148ad5bc64cd66c54e4'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:39.073858 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d94557-74cf-4279-8ca6-13a8a79cb747 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:39.079896 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a1d94557-74cf-4279-8ca6-13a8a79cb747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:39.100523 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-04ffe5b8-eb79-4745-baf2-d1e2f5b85cf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80ff291728bd4148ad5bc64cd66c54e4'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:39.101362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-04ffe5b8-eb79-4745-baf2-d1e2f5b85cf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80ff291728bd4148ad5bc64cd66c54e4'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:39.135797 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-04ffe5b8-eb79-4745-baf2-d1e2f5b85cf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80ff291728bd4148ad5bc64cd66c54e4'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:39.142908 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d94557-74cf-4279-8ca6-13a8a79cb747 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:39.144619 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1150/2297] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:38 2022] DELETE /identity/v3/users/80ff291728bd4148ad5bc64cd66c54e4 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:39.148704 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffe5b8-eb79-4745-baf2-d1e2f5b85cf8 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:39.150427 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-04ffe5b8-eb79-4745-baf2-d1e2f5b85cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:39.198510 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:39.213950 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d599b-f4d8-472d-a708-85116e9659d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:39.214585 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d599b-f4d8-472d-a708-85116e9659d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:39.214863 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d599b-f4d8-472d-a708-85116e9659d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:39.215134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d599b-f4d8-472d-a708-85116e9659d8 admin admin] PATH_INFO: `/v3/projects/6e50fbb2f6c5497f85ed9128d5bf4bd7` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:39.216248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d599b-f4d8-472d-a708-85116e9659d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e50fbb2f6c5497f85ed9128d5bf4bd7)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:39.218563 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d599b-f4d8-472d-a708-85116e9659d8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:39.221710 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffe5b8-eb79-4745-baf2-d1e2f5b85cf8 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:39.226972 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112a308-2f4c-400c-87b4-3d14cf17f2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:39.227617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112a308-2f4c-400c-87b4-3d14cf17f2c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:39.227894 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112a308-2f4c-400c-87b4-3d14cf17f2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:39.228167 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112a308-2f4c-400c-87b4-3d14cf17f2c3 admin admin] PATH_INFO: `/v3/projects/12db38754b6b41019e7cd0d098e72cbd` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:39.229531 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112a308-2f4c-400c-87b4-3d14cf17f2c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12db38754b6b41019e7cd0d098e72cbd)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:39.231948 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112a308-2f4c-400c-87b4-3d14cf17f2c3 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:39.293157 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4112a308-2f4c-400c-87b4-3d14cf17f2c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12db38754b6b41019e7cd0d098e72cbd', 'request_id': 'req-4112a308-2f4c-400c-87b4-3d14cf17f2c3'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:39.293640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-561d599b-f4d8-472d-a708-85116e9659d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e50fbb2f6c5497f85ed9128d5bf4bd7', 'request_id': 'req-561d599b-f4d8-472d-a708-85116e9659d8'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:39.299967 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-561d599b-f4d8-472d-a708-85116e9659d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e50fbb2f6c5497f85ed9128d5bf4bd7', 'request_id': 'req-561d599b-f4d8-472d-a708-85116e9659d8'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:39.300101 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4112a308-2f4c-400c-87b4-3d14cf17f2c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12db38754b6b41019e7cd0d098e72cbd', 'request_id': 'req-4112a308-2f4c-400c-87b4-3d14cf17f2c3'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:39.307304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4112a308-2f4c-400c-87b4-3d14cf17f2c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12db38754b6b41019e7cd0d098e72cbd', 'request_id': 'req-4112a308-2f4c-400c-87b4-3d14cf17f2c3'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:39.307703 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-561d599b-f4d8-472d-a708-85116e9659d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e50fbb2f6c5497f85ed9128d5bf4bd7', 'request_id': 'req-561d599b-f4d8-472d-a708-85116e9659d8'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:39.326057 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-561d599b-f4d8-472d-a708-85116e9659d8 admin admin] The token cache is being invalidate because project 6e50fbb2f6c5497f85ed9128d5bf4bd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:39.326358 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-561d599b-f4d8-472d-a708-85116e9659d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:39.327025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-561d599b-f4d8-472d-a708-85116e9659d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:39.328554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1148/2298] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:39 2022] DELETE /identity/v3/projects/6e50fbb2f6c5497f85ed9128d5bf4bd7 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:39.343195 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a4fb6-2728-45e1-b91a-453bc19beb07 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:39.343195 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a4fb6-2728-45e1-b91a-453bc19beb07 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:39.343195 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a4fb6-2728-45e1-b91a-453bc19beb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:39.343496 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4112a308-2f4c-400c-87b4-3d14cf17f2c3 admin admin] The token cache is being invalidate because project 12db38754b6b41019e7cd0d098e72cbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:39.343496 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4112a308-2f4c-400c-87b4-3d14cf17f2c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:39.351246 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4112a308-2f4c-400c-87b4-3d14cf17f2c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:39.353275 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1151/2299] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:39 2022] DELETE /identity/v3/projects/12db38754b6b41019e7cd0d098e72cbd => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:39.359673 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed07124-3d37-4247-a44c-1c9226fcc86b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:39.363786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed07124-3d37-4247-a44c-1c9226fcc86b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:39.363786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed07124-3d37-4247-a44c-1c9226fcc86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:39.387333 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-4ed07124-3d37-4247-a44c-1c9226fcc86b None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:39.388563 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a89a4fb6-2728-45e1-b91a-453bc19beb07 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:39.388704 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4ed07124-3d37-4247-a44c-1c9226fcc86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:39.390501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a89a4fb6-2728-45e1-b91a-453bc19beb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:39.459111 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1152/2300] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:39.467328 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0cffa-13db-41fe-a414-fe3f49f2988f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:39.467620 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0cffa-13db-41fe-a414-fe3f49f2988f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:39.467900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0cffa-13db-41fe-a414-fe3f49f2988f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:39.475361 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1149/2301] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:39.488597 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a4fb6-2728-45e1-b91a-453bc19beb07 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:39.490548 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a89a4fb6-2728-45e1-b91a-453bc19beb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:39.492346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-e3e0cffa-13db-41fe-a414-fe3f49f2988f None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:39.493660 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e3e0cffa-13db-41fe-a414-fe3f49f2988f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:39.502066 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:39.506341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1153/2302] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:39.507420 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0cffa-13db-41fe-a414-fe3f49f2988f None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:39.517928 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0cffa-13db-41fe-a414-fe3f49f2988f None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:39.524607 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f30468-6db0-44f3-b922-4e0be630f7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:39.525387 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f30468-6db0-44f3-b922-4e0be630f7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:39.525732 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f30468-6db0-44f3-b922-4e0be630f7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:39.526568 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f30468-6db0-44f3-b922-4e0be630f7d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:39.526808 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f30468-6db0-44f3-b922-4e0be630f7d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:31:39.527186 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f30468-6db0-44f3-b922-4e0be630f7d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:39.529003 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f30468-6db0-44f3-b922-4e0be630f7d3 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:39.543893 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1154/2303] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:31:39.547938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f30468-6db0-44f3-b922-4e0be630f7d3 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:39.558321 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f30468-6db0-44f3-b922-4e0be630f7d3 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:39.563060 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fd395-9244-436d-b8ea-405011800054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:39.563660 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fd395-9244-436d-b8ea-405011800054 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:39.563809 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a4fb6-2728-45e1-b91a-453bc19beb07 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:39.563944 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fd395-9244-436d-b8ea-405011800054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:39.564229 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fd395-9244-436d-b8ea-405011800054 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:39.564923 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fd395-9244-436d-b8ea-405011800054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:39.567212 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fd395-9244-436d-b8ea-405011800054 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:39.567495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29205d3-d278-42b3-bfd7-216e4fa3f3f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:39.568098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29205d3-d278-42b3-bfd7-216e4fa3f3f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:39.568410 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29205d3-d278-42b3-bfd7-216e4fa3f3f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:39.568739 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29205d3-d278-42b3-bfd7-216e4fa3f3f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:39.580876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29205d3-d278-42b3-bfd7-216e4fa3f3f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:39.583306 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29205d3-d278-42b3-bfd7-216e4fa3f3f2 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:39.593127 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1150/2304] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:31:39.596449 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1155/2305] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:39 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:31:39.601007 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29205d3-d278-42b3-bfd7-216e4fa3f3f2 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:39.610692 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29205d3-d278-42b3-bfd7-216e4fa3f3f2 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:39.698105 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1f2ca-3791-4e0d-99fb-b4ffeef70d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:39.699558 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1f2ca-3791-4e0d-99fb-b4ffeef70d15 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:39.700069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1f2ca-3791-4e0d-99fb-b4ffeef70d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:39.700449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1f2ca-3791-4e0d-99fb-b4ffeef70d15 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:39.701957 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1f2ca-3791-4e0d-99fb-b4ffeef70d15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:39.704255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1f2ca-3791-4e0d-99fb-b4ffeef70d15 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:39.730448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1151/2306] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:39 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:39.734560 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fd395-9244-436d-b8ea-405011800054 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:39.747157 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fd395-9244-436d-b8ea-405011800054 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:39.753252 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec2375-5bdb-48e2-97fa-741d487d58ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:39.755492 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec2375-5bdb-48e2-97fa-741d487d58ef admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:39.755492 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec2375-5bdb-48e2-97fa-741d487d58ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:39.755790 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec2375-5bdb-48e2-97fa-741d487d58ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:39.756525 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec2375-5bdb-48e2-97fa-741d487d58ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:39.758616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec2375-5bdb-48e2-97fa-741d487d58ef admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:39.782155 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1156/2307] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:31:39.789687 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1f2ca-3791-4e0d-99fb-b4ffeef70d15 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:39.807250 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1f2ca-3791-4e0d-99fb-b4ffeef70d15 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:39.813463 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c74d3-d371-4f2b-b37b-c7792ba9c224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:39.814219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c74d3-d371-4f2b-b37b-c7792ba9c224 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:39.815213 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c74d3-d371-4f2b-b37b-c7792ba9c224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:39.815213 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c74d3-d371-4f2b-b37b-c7792ba9c224 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:39.816239 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c74d3-d371-4f2b-b37b-c7792ba9c224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:39.818524 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c74d3-d371-4f2b-b37b-c7792ba9c224 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:39.834666 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec2375-5bdb-48e2-97fa-741d487d58ef admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:39.835942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1152/2308] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:39.845835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec2375-5bdb-48e2-97fa-741d487d58ef admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:39.850969 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db58358-1793-4dea-a462-b2fdb7b70d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:39.851778 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db58358-1793-4dea-a462-b2fdb7b70d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:39.852046 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db58358-1793-4dea-a462-b2fdb7b70d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:39.852396 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db58358-1793-4dea-a462-b2fdb7b70d43 admin admin] PATH_INFO: `/v3/projects/ff31a9c661484430b5f045f285ad855c/users/cab9b9068a4e462c93d8789d7b018f4b/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:39.877751 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db58358-1793-4dea-a462-b2fdb7b70d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff31a9c661484430b5f045f285ad855c, user_id=cab9b9068a4e462c93d8789d7b018f4b, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:39.881062 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db58358-1793-4dea-a462-b2fdb7b70d43 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:39.884119 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:39.896163 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1157/2309] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:39 2022] PUT /identity/v3/projects/ff31a9c661484430b5f045f285ad855c/users/cab9b9068a4e462c93d8789d7b018f4b/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:31:39.907723 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035b7a6-99c7-4fc5-b011-27e9cddfef88 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:39.908008 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035b7a6-99c7-4fc5-b011-27e9cddfef88 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:39.908281 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035b7a6-99c7-4fc5-b011-27e9cddfef88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:39.925572 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db58358-1793-4dea-a462-b2fdb7b70d43 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:39.927726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3db58358-1793-4dea-a462-b2fdb7b70d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:39.943363 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c035b7a6-99c7-4fc5-b011-27e9cddfef88 None None] MFA Rules not processed for user `cab9b9068a4e462c93d8789d7b018f4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:39.944976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c035b7a6-99c7-4fc5-b011-27e9cddfef88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:40.008689 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db58358-1793-4dea-a462-b2fdb7b70d43 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:40.013606 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc102e-bd49-4722-a873-a49b62aaf640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:40.014240 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc102e-bd49-4722-a873-a49b62aaf640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:40.014522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc102e-bd49-4722-a873-a49b62aaf640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:40.014799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc102e-bd49-4722-a873-a49b62aaf640 admin admin] PATH_INFO: `/v3/projects/ae05a48c67ee4ba0b7ba54555f2df919` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:40.015930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc102e-bd49-4722-a873-a49b62aaf640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae05a48c67ee4ba0b7ba54555f2df919)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:40.017877 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc102e-bd49-4722-a873-a49b62aaf640 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:40.028240 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1153/2310] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:40.033452 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035b7a6-99c7-4fc5-b011-27e9cddfef88 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:40.045960 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035b7a6-99c7-4fc5-b011-27e9cddfef88 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:40.051053 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b1f16-baf9-45fc-ae82-c9721072a661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:40.051686 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b1f16-baf9-45fc-ae82-c9721072a661 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:40.052066 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b1f16-baf9-45fc-ae82-c9721072a661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:40.052472 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b1f16-baf9-45fc-ae82-c9721072a661 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:40.053213 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b1f16-baf9-45fc-ae82-c9721072a661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:40.055126 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b1f16-baf9-45fc-ae82-c9721072a661 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:40.070147 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-5ccc102e-bd49-4722-a873-a49b62aaf640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae05a48c67ee4ba0b7ba54555f2df919', 'request_id': 'req-5ccc102e-bd49-4722-a873-a49b62aaf640'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:40.076098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-5ccc102e-bd49-4722-a873-a49b62aaf640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae05a48c67ee4ba0b7ba54555f2df919', 'request_id': 'req-5ccc102e-bd49-4722-a873-a49b62aaf640'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:40.077640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:40.084386 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-5ccc102e-bd49-4722-a873-a49b62aaf640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae05a48c67ee4ba0b7ba54555f2df919', 'request_id': 'req-5ccc102e-bd49-4722-a873-a49b62aaf640'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:40.090825 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1154/2311] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:40 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:31:40.091825 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b1f16-baf9-45fc-ae82-c9721072a661 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:40.099934 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-5ccc102e-bd49-4722-a873-a49b62aaf640 admin admin] The token cache is being invalidate because project ae05a48c67ee4ba0b7ba54555f2df919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:40.100226 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-5ccc102e-bd49-4722-a873-a49b62aaf640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:40.100895 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-5ccc102e-bd49-4722-a873-a49b62aaf640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:40.102465 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1158/2312] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:39 2022] DELETE /identity/v3/projects/ae05a48c67ee4ba0b7ba54555f2df919 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:31:40.106232 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc102e-bd49-4722-a873-a49b62aaf640 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:40.107953 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5ccc102e-bd49-4722-a873-a49b62aaf640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:40.162087 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b1f16-baf9-45fc-ae82-c9721072a661 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:40.167102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b72a8-79fa-4327-8f7a-239830b54ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:40.167719 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b72a8-79fa-4327-8f7a-239830b54ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:40.167982 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b72a8-79fa-4327-8f7a-239830b54ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:40.168249 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b72a8-79fa-4327-8f7a-239830b54ab7 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:40.168869 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b72a8-79fa-4327-8f7a-239830b54ab7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:40.170800 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b72a8-79fa-4327-8f7a-239830b54ab7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:40.191663 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1155/2313] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:40 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:31:40.196215 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b72a8-79fa-4327-8f7a-239830b54ab7 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:40.197175 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc102e-bd49-4722-a873-a49b62aaf640 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:40.197975 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-db2b72a8-79fa-4327-8f7a-239830b54ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:40.202215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f2e65-286d-48f6-87e4-df2878ad91a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:40.202965 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f2e65-286d-48f6-87e4-df2878ad91a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:40.203339 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f2e65-286d-48f6-87e4-df2878ad91a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:40.203734 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f2e65-286d-48f6-87e4-df2878ad91a5 admin admin] PATH_INFO: `/v3/users/d2f7426837c24dee98aa0c73395d2862` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:40.204974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2f2e65-286d-48f6-87e4-df2878ad91a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2f7426837c24dee98aa0c73395d2862)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:40.207003 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2f2e65-286d-48f6-87e4-df2878ad91a5 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:40.210288 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b72a8-79fa-4327-8f7a-239830b54ab7 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:40.215278 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e339ab-0636-4d66-88c0-a726c95331ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:40.215957 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e339ab-0636-4d66-88c0-a726c95331ac admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:40.216429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e339ab-0636-4d66-88c0-a726c95331ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:40.216767 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e339ab-0636-4d66-88c0-a726c95331ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:40.217579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e339ab-0636-4d66-88c0-a726c95331ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:40.219236 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e339ab-0636-4d66-88c0-a726c95331ac admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:40.230578 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1156/2314] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:31:40.234787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e339ab-0636-4d66-88c0-a726c95331ac admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:40.248531 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:40.249012 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e339ab-0636-4d66-88c0-a726c95331ac admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:40.255174 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98122a6-4a7d-4b10-bf4a-9d6efb1c5f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:40.256157 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98122a6-4a7d-4b10-bf4a-9d6efb1c5f80 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:40.256582 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98122a6-4a7d-4b10-bf4a-9d6efb1c5f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:40.256874 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98122a6-4a7d-4b10-bf4a-9d6efb1c5f80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:40.257710 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98122a6-4a7d-4b10-bf4a-9d6efb1c5f80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:40.259390 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98122a6-4a7d-4b10-bf4a-9d6efb1c5f80 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:40.270741 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1157/2315] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:40.275406 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98122a6-4a7d-4b10-bf4a-9d6efb1c5f80 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:40.276016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-ce2f2e65-286d-48f6-87e4-df2878ad91a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2f7426837c24dee98aa0c73395d2862'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:40.285147 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-ce2f2e65-286d-48f6-87e4-df2878ad91a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2f7426837c24dee98aa0c73395d2862'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:40.287111 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98122a6-4a7d-4b10-bf4a-9d6efb1c5f80 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:40.292681 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40677a0f-8715-4a67-95ff-462d1ad2c806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:40.293451 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-ce2f2e65-286d-48f6-87e4-df2878ad91a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2f7426837c24dee98aa0c73395d2862'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:40.293587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40677a0f-8715-4a67-95ff-462d1ad2c806 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:40.293964 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40677a0f-8715-4a67-95ff-462d1ad2c806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:40.294239 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40677a0f-8715-4a67-95ff-462d1ad2c806 admin admin] PATH_INFO: `/v3/projects/02c2ffe6e04a451abf058a46810d825e/users/1f9a166a5b60485998b063400870d48f/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:40.294649 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-ce2f2e65-286d-48f6-87e4-df2878ad91a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2f7426837c24dee98aa0c73395d2862'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:40.311025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40677a0f-8715-4a67-95ff-462d1ad2c806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02c2ffe6e04a451abf058a46810d825e, user_id=1f9a166a5b60485998b063400870d48f, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:40.311731 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-ce2f2e65-286d-48f6-87e4-df2878ad91a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2f7426837c24dee98aa0c73395d2862'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:40.313755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40677a0f-8715-4a67-95ff-462d1ad2c806 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:40.321042 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1159/2316] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:40 2022] DELETE /identity/v3/users/d2f7426837c24dee98aa0c73395d2862 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:31:40.330174 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1158/2317] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:40 2022] PUT /identity/v3/projects/02c2ffe6e04a451abf058a46810d825e/users/1f9a166a5b60485998b063400870d48f/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:40.341196 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743380b-6b5b-4c69-b5fc-88b411731f29 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:40.341578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743380b-6b5b-4c69-b5fc-88b411731f29 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:40.341944 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743380b-6b5b-4c69-b5fc-88b411731f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:40.377164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-8743380b-6b5b-4c69-b5fc-88b411731f29 None None] MFA Rules not processed for user `1f9a166a5b60485998b063400870d48f`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:40.378607 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8743380b-6b5b-4c69-b5fc-88b411731f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:40.468800 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1160/2318] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:31:40.470162 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40677a0f-8715-4a67-95ff-462d1ad2c806 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:40.471980 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-40677a0f-8715-4a67-95ff-462d1ad2c806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:40.563988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40677a0f-8715-4a67-95ff-462d1ad2c806 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:40.569999 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076de897-fc91-47b4-b899-bc3a918902ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:40.570605 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076de897-fc91-47b4-b899-bc3a918902ba admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:40.570909 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076de897-fc91-47b4-b899-bc3a918902ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:40.571543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076de897-fc91-47b4-b899-bc3a918902ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:40.571906 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076de897-fc91-47b4-b899-bc3a918902ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:40.575607 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076de897-fc91-47b4-b899-bc3a918902ba admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:40.629047 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1159/2319] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:40 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:40.634186 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743380b-6b5b-4c69-b5fc-88b411731f29 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:40.649288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743380b-6b5b-4c69-b5fc-88b411731f29 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:40.690516 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076de897-fc91-47b4-b899-bc3a918902ba admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:40.708460 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-076de897-fc91-47b4-b899-bc3a918902ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:40.745798 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2de5d-dbe2-4028-94ea-2ed6b1a1b2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:40.746499 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2de5d-dbe2-4028-94ea-2ed6b1a1b2c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:40.746842 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2de5d-dbe2-4028-94ea-2ed6b1a1b2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:40.747186 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2de5d-dbe2-4028-94ea-2ed6b1a1b2c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:40.748564 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db2de5d-dbe2-4028-94ea-2ed6b1a1b2c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:40.757980 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:40.764998 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db2de5d-dbe2-4028-94ea-2ed6b1a1b2c8 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:40.795001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1161/2320] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:40 2022] POST /identity/v3/users => generated 299 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:40.799822 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2de5d-dbe2-4028-94ea-2ed6b1a1b2c8 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:40.819840 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076de897-fc91-47b4-b899-bc3a918902ba admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:40.821045 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2de5d-dbe2-4028-94ea-2ed6b1a1b2c8 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:40.835428 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a8ae9-7402-4a9c-92e4-40b095137962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:40.836073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a8ae9-7402-4a9c-92e4-40b095137962 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:40.836356 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a8ae9-7402-4a9c-92e4-40b095137962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:40.836631 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a8ae9-7402-4a9c-92e4-40b095137962 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:40.837603 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ac1ee-0fd1-4d48-99d6-2db39aee551a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:40.839049 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a8ae9-7402-4a9c-92e4-40b095137962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:40.840195 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ac1ee-0fd1-4d48-99d6-2db39aee551a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:40.840487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ac1ee-0fd1-4d48-99d6-2db39aee551a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:40.840757 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ac1ee-0fd1-4d48-99d6-2db39aee551a admin admin] PATH_INFO: `/v3/projects/b1cf8c87890b47ecb2646e7dff7afc47` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:40.842930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a8ae9-7402-4a9c-92e4-40b095137962 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:40.845050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ac1ee-0fd1-4d48-99d6-2db39aee551a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1cf8c87890b47ecb2646e7dff7afc47)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:40.850476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ac1ee-0fd1-4d48-99d6-2db39aee551a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:40.875862 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1162/2321] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:40.875862 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a33a2-16d1-46c6-b57e-88ab1a928d56 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:40.875862 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a33a2-16d1-46c6-b57e-88ab1a928d56 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:40.877234 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a33a2-16d1-46c6-b57e-88ab1a928d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:40.902759 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-5d1a33a2-16d1-46c6-b57e-88ab1a928d56 None None] MFA Rules not processed for user `9add5093067e4da990785354f686d7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:40.904349 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-5d1a33a2-16d1-46c6-b57e-88ab1a928d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:40.920980 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:40.935989 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dd1ac1ee-0fd1-4d48-99d6-2db39aee551a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1cf8c87890b47ecb2646e7dff7afc47', 'request_id': 'req-dd1ac1ee-0fd1-4d48-99d6-2db39aee551a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:40.946804 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dd1ac1ee-0fd1-4d48-99d6-2db39aee551a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1cf8c87890b47ecb2646e7dff7afc47', 'request_id': 'req-dd1ac1ee-0fd1-4d48-99d6-2db39aee551a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:40.955434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dd1ac1ee-0fd1-4d48-99d6-2db39aee551a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1cf8c87890b47ecb2646e7dff7afc47', 'request_id': 'req-dd1ac1ee-0fd1-4d48-99d6-2db39aee551a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:40.994195 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dd1ac1ee-0fd1-4d48-99d6-2db39aee551a admin admin] The token cache is being invalidate because project b1cf8c87890b47ecb2646e7dff7afc47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:40.994529 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dd1ac1ee-0fd1-4d48-99d6-2db39aee551a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:40.995219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-dd1ac1ee-0fd1-4d48-99d6-2db39aee551a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:40.997080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1160/2322] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:40 2022] DELETE /identity/v3/projects/b1cf8c87890b47ecb2646e7dff7afc47 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:40.998466 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ac1ee-0fd1-4d48-99d6-2db39aee551a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:41.003226 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-dd1ac1ee-0fd1-4d48-99d6-2db39aee551a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:41.013799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1163/2323] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:41.015305 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11af7fa-be77-4c5e-887b-69256cc5de81 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:41.015695 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11af7fa-be77-4c5e-887b-69256cc5de81 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:41.016079 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11af7fa-be77-4c5e-887b-69256cc5de81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:41.051772 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a11af7fa-be77-4c5e-887b-69256cc5de81 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:41.054388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a11af7fa-be77-4c5e-887b-69256cc5de81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:41.160060 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ac1ee-0fd1-4d48-99d6-2db39aee551a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:41.167498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1164/2324] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:41.173462 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0d9ef-9c04-46cd-8b99-574e6bfc862b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:41.174642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0d9ef-9c04-46cd-8b99-574e6bfc862b admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:41.174977 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3aa961-fc3b-49a1-8684-2c44bcdf61c5 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:41.175200 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0d9ef-9c04-46cd-8b99-574e6bfc862b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:41.175340 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3aa961-fc3b-49a1-8684-2c44bcdf61c5 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:41.175933 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0d9ef-9c04-46cd-8b99-574e6bfc862b admin admin] PATH_INFO: `/v3/projects/bc297310446048198247645408160efa/users/a9f59a32c3d84d76b655474bde59ce0c/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:41.176051 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3aa961-fc3b-49a1-8684-2c44bcdf61c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:41.196768 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-da3aa961-fc3b-49a1-8684-2c44bcdf61c5 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:41.198347 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-da3aa961-fc3b-49a1-8684-2c44bcdf61c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:41.206369 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0d9ef-9c04-46cd-8b99-574e6bfc862b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc297310446048198247645408160efa, user_id=a9f59a32c3d84d76b655474bde59ce0c, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:41.206875 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1165/2325] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:41.210078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0d9ef-9c04-46cd-8b99-574e6bfc862b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:41.213690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3aa961-fc3b-49a1-8684-2c44bcdf61c5 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:41.239840 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1161/2326] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:40 2022] PUT /identity/v3/projects/bc297310446048198247645408160efa/users/a9f59a32c3d84d76b655474bde59ce0c/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:41.247962 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3aa961-fc3b-49a1-8684-2c44bcdf61c5 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:41.249674 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0d9ef-9c04-46cd-8b99-574e6bfc862b admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:41.344555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:41.360177 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eff1bd-7ca1-409f-8a03-c2d1741bae7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:41.360177 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eff1bd-7ca1-409f-8a03-c2d1741bae7c admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:41.360177 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eff1bd-7ca1-409f-8a03-c2d1741bae7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:41.361394 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eff1bd-7ca1-409f-8a03-c2d1741bae7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:41.362505 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eff1bd-7ca1-409f-8a03-c2d1741bae7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:31:41.363224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eff1bd-7ca1-409f-8a03-c2d1741bae7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:41.365537 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eff1bd-7ca1-409f-8a03-c2d1741bae7c admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:41.385927 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1166/2327] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:31:41.387412 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eff1bd-7ca1-409f-8a03-c2d1741bae7c admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:41.392462 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0d9ef-9c04-46cd-8b99-574e6bfc862b admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:41.398923 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0826522-ebe8-4b6f-9ec1-f88422b33f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:41.400434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0826522-ebe8-4b6f-9ec1-f88422b33f58 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:41.400815 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0826522-ebe8-4b6f-9ec1-f88422b33f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:41.401285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0826522-ebe8-4b6f-9ec1-f88422b33f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:41.402074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0826522-ebe8-4b6f-9ec1-f88422b33f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:41.403922 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0826522-ebe8-4b6f-9ec1-f88422b33f58 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:41.404574 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eff1bd-7ca1-409f-8a03-c2d1741bae7c admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:41.410113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990fe48-47ed-4241-a008-2b2186275148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:41.410761 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990fe48-47ed-4241-a008-2b2186275148 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:41.411049 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990fe48-47ed-4241-a008-2b2186275148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:41.411609 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990fe48-47ed-4241-a008-2b2186275148 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:41.412840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990fe48-47ed-4241-a008-2b2186275148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:41.415068 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990fe48-47ed-4241-a008-2b2186275148 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:41.419006 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1162/2328] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:41.423220 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0826522-ebe8-4b6f-9ec1-f88422b33f58 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:41.441304 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0826522-ebe8-4b6f-9ec1-f88422b33f58 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:41.447586 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12581aa3-0113-4d37-b928-906e2e502d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:41.448608 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12581aa3-0113-4d37-b928-906e2e502d17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:41.448895 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12581aa3-0113-4d37-b928-906e2e502d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:41.449290 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12581aa3-0113-4d37-b928-906e2e502d17 admin admin] PATH_INFO: `/v3/projects/bc297310446048198247645408160efa/users/a9f59a32c3d84d76b655474bde59ce0c/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:41.451509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12581aa3-0113-4d37-b928-906e2e502d17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc297310446048198247645408160efa, user_id=a9f59a32c3d84d76b655474bde59ce0c, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:41.456682 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12581aa3-0113-4d37-b928-906e2e502d17 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:41.457464 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1167/2329] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:41 2022] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:41.462133 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990fe48-47ed-4241-a008-2b2186275148 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:41.481744 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1163/2330] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:41 2022] PUT /identity/v3/projects/bc297310446048198247645408160efa/users/a9f59a32c3d84d76b655474bde59ce0c/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:31:41.488562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3f053-9ea1-4dfa-8f9e-f73feeab51c5 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:41.489206 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3f053-9ea1-4dfa-8f9e-f73feeab51c5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:41.489988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3f053-9ea1-4dfa-8f9e-f73feeab51c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:41.511819 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:41.537881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c1e3f053-9ea1-4dfa-8f9e-f73feeab51c5 None None] MFA Rules not processed for user `a9f59a32c3d84d76b655474bde59ce0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:41.539378 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c1e3f053-9ea1-4dfa-8f9e-f73feeab51c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:41.583368 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990fe48-47ed-4241-a008-2b2186275148 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:41.621924 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1164/2331] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:41.637672 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3f053-9ea1-4dfa-8f9e-f73feeab51c5 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:41.639131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c1e3f053-9ea1-4dfa-8f9e-f73feeab51c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:41.678819 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e65ac-c247-4334-a048-fe0ed5f62c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:41.679574 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e65ac-c247-4334-a048-fe0ed5f62c2d admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:41.679929 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e65ac-c247-4334-a048-fe0ed5f62c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:41.680276 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e65ac-c247-4334-a048-fe0ed5f62c2d admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:41.680976 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e65ac-c247-4334-a048-fe0ed5f62c2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:41.683130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e65ac-c247-4334-a048-fe0ed5f62c2d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:41.715476 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1168/2332] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:41 2022] POST /identity/v3/users => generated 285 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:31:41.716830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e65ac-c247-4334-a048-fe0ed5f62c2d admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:41.729670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e65ac-c247-4334-a048-fe0ed5f62c2d admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:41.736769 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c107a84-be18-4106-9f15-dd96d953a5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:41.737599 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c107a84-be18-4106-9f15-dd96d953a5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:41.737934 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c107a84-be18-4106-9f15-dd96d953a5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:41.738358 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c107a84-be18-4106-9f15-dd96d953a5d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:41.740019 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c107a84-be18-4106-9f15-dd96d953a5d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:41.742646 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c107a84-be18-4106-9f15-dd96d953a5d3 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:41.744630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3f053-9ea1-4dfa-8f9e-f73feeab51c5 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:41.757812 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1169/2333] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:41.760774 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039fbd1-678e-481c-8f46-16424f991664 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:41.761919 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039fbd1-678e-481c-8f46-16424f991664 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:41.762313 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039fbd1-678e-481c-8f46-16424f991664 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:41.762703 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039fbd1-678e-481c-8f46-16424f991664 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:41.764795 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7039fbd1-678e-481c-8f46-16424f991664 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:41.771145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c107a84-be18-4106-9f15-dd96d953a5d3 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:41.803332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c107a84-be18-4106-9f15-dd96d953a5d3 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:41.819263 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cc63c-dc76-4f2a-a2e1-b555a8bda0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:41.820352 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cc63c-dc76-4f2a-a2e1-b555a8bda0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:41.820839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cc63c-dc76-4f2a-a2e1-b555a8bda0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:41.821432 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cc63c-dc76-4f2a-a2e1-b555a8bda0a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:41.822784 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476cc63c-dc76-4f2a-a2e1-b555a8bda0a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:41.837856 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476cc63c-dc76-4f2a-a2e1-b555a8bda0a7 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:41.846630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039fbd1-678e-481c-8f46-16424f991664 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:41.848415 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039fbd1-678e-481c-8f46-16424f991664 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:41.875881 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1165/2334] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:31:41.883687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1170/2335] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:41.888145 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039fbd1-678e-481c-8f46-16424f991664 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:41.894645 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:41.911733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039fbd1-678e-481c-8f46-16424f991664 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:41.925508 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540645c4-ee7b-454a-b701-d182e92caa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:41.927354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540645c4-ee7b-454a-b701-d182e92caa91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:41.928003 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540645c4-ee7b-454a-b701-d182e92caa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:41.928167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540645c4-ee7b-454a-b701-d182e92caa91 admin admin] PATH_INFO: `/v3/projects/7dffc540bfba4b11bee93adc5625db30/users/e89680f4537d4c1992be71b673d00909/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:41.961766 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540645c4-ee7b-454a-b701-d182e92caa91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dffc540bfba4b11bee93adc5625db30, user_id=e89680f4537d4c1992be71b673d00909, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:41.964539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540645c4-ee7b-454a-b701-d182e92caa91 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:41.990672 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1166/2336] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:41 2022] PUT /identity/v3/projects/7dffc540bfba4b11bee93adc5625db30/users/e89680f4537d4c1992be71b673d00909/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:31:42.001397 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c00f5-3603-4144-af4a-88401bcbb86b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:42.001717 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c00f5-3603-4144-af4a-88401bcbb86b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:42.001998 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c00f5-3603-4144-af4a-88401bcbb86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:42.072466 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-0b7c00f5-3603-4144-af4a-88401bcbb86b None None] MFA Rules not processed for user `e89680f4537d4c1992be71b673d00909`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:42.074920 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0b7c00f5-3603-4144-af4a-88401bcbb86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:42.241148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1171/2337] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:31:42.252805 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540645c4-ee7b-454a-b701-d182e92caa91 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:42.256928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-540645c4-ee7b-454a-b701-d182e92caa91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:42.496661 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540645c4-ee7b-454a-b701-d182e92caa91 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:42.502084 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31e2e6-b23e-4e47-82d5-973190b8d7d2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63645a88f5924a57b5b828aacd856902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:42.502920 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31e2e6-b23e-4e47-82d5-973190b8d7d2 service glance] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:42.503205 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31e2e6-b23e-4e47-82d5-973190b8d7d2 service glance] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:42.503477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31e2e6-b23e-4e47-82d5-973190b8d7d2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:42.518437 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31e2e6-b23e-4e47-82d5-973190b8d7d2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:42.521921 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31e2e6-b23e-4e47-82d5-973190b8d7d2 service glance] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:42.536059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1167/2338] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:43.809845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c00f5-3603-4144-af4a-88401bcbb86b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:43.811870 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0b7c00f5-3603-4144-af4a-88401bcbb86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:43.853365 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:43.892336 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c00f5-3603-4144-af4a-88401bcbb86b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:43.898258 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ef08f-44d9-4124-b3c3-e48565b17050 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:43.898985 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ef08f-44d9-4124-b3c3-e48565b17050 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:43.899620 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ef08f-44d9-4124-b3c3-e48565b17050 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:43.899620 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ef08f-44d9-4124-b3c3-e48565b17050 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:43.901471 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-523ef08f-44d9-4124-b3c3-e48565b17050 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:44.017121 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ef08f-44d9-4124-b3c3-e48565b17050 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:44.018844 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ef08f-44d9-4124-b3c3-e48565b17050 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:44.037072 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1172/2339] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:44.928583 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31e2e6-b23e-4e47-82d5-973190b8d7d2 service glance] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:44.938859 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31e2e6-b23e-4e47-82d5-973190b8d7d2 service glance] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:44.942545 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55dbee-72e6-496d-8ae2-1af5d967d5d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:44.943164 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55dbee-72e6-496d-8ae2-1af5d967d5d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:44.943449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55dbee-72e6-496d-8ae2-1af5d967d5d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:44.943718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55dbee-72e6-496d-8ae2-1af5d967d5d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:45.013472 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55dbee-72e6-496d-8ae2-1af5d967d5d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:45.015011 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55dbee-72e6-496d-8ae2-1af5d967d5d7 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:45.026326 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1168/2340] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:47.062682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a622f2-2efe-496b-a7cb-130168e4a3ef None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:47.063188 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a622f2-2efe-496b-a7cb-130168e4a3ef None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:47.063413 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a622f2-2efe-496b-a7cb-130168e4a3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:47.086782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-77a622f2-2efe-496b-a7cb-130168e4a3ef None None] MFA Rules not processed for user `0b20525bc3124888bbb1decbae15d3c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:47.088056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-77a622f2-2efe-496b-a7cb-130168e4a3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:47.150139 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1173/2341] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:49.108636 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55dbee-72e6-496d-8ae2-1af5d967d5d7 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:49.174427 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:49.181184 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55dbee-72e6-496d-8ae2-1af5d967d5d7 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:49.188438 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5796736-fdf0-401c-b45c-84f2c2c6b74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:49.189490 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5796736-fdf0-401c-b45c-84f2c2c6b74d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:49.189778 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5796736-fdf0-401c-b45c-84f2c2c6b74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:49.190059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5796736-fdf0-401c-b45c-84f2c2c6b74d admin admin] PATH_INFO: `/v3/users/cab9b9068a4e462c93d8789d7b018f4b` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:49.191284 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5796736-fdf0-401c-b45c-84f2c2c6b74d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cab9b9068a4e462c93d8789d7b018f4b)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:49.193409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5796736-fdf0-401c-b45c-84f2c2c6b74d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:49.256312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c5796736-fdf0-401c-b45c-84f2c2c6b74d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cab9b9068a4e462c93d8789d7b018f4b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:49.264620 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c5796736-fdf0-401c-b45c-84f2c2c6b74d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cab9b9068a4e462c93d8789d7b018f4b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:49.265385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c5796736-fdf0-401c-b45c-84f2c2c6b74d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cab9b9068a4e462c93d8789d7b018f4b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:49.295203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c5796736-fdf0-401c-b45c-84f2c2c6b74d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cab9b9068a4e462c93d8789d7b018f4b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:49.321725 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c5796736-fdf0-401c-b45c-84f2c2c6b74d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cab9b9068a4e462c93d8789d7b018f4b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:49.336258 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1169/2342] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:49 2022] DELETE /identity/v3/users/cab9b9068a4e462c93d8789d7b018f4b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:49.340873 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8b03b-b9e6-4bae-a66a-e20851310f6d None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:49.341296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8b03b-b9e6-4bae-a66a-e20851310f6d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:49.341443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8b03b-b9e6-4bae-a66a-e20851310f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:49.391094 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-cbb8b03b-b9e6-4bae-a66a-e20851310f6d None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:49.392386 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-cbb8b03b-b9e6-4bae-a66a-e20851310f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:49.546406 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1174/2343] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:49.563428 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5796736-fdf0-401c-b45c-84f2c2c6b74d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:49.565653 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c5796736-fdf0-401c-b45c-84f2c2c6b74d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:49.646448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5796736-fdf0-401c-b45c-84f2c2c6b74d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:49.650042 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc852b86-c4e2-45b4-9743-943330b3046f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:49.650641 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc852b86-c4e2-45b4-9743-943330b3046f service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:49.650949 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc852b86-c4e2-45b4-9743-943330b3046f service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:49.651223 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc852b86-c4e2-45b4-9743-943330b3046f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:49.660193 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc852b86-c4e2-45b4-9743-943330b3046f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:49.661722 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc852b86-c4e2-45b4-9743-943330b3046f service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:49.674323 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1170/2344] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:50.038345 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8b03b-b9e6-4bae-a66a-e20851310f6d None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:50.040088 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-cbb8b03b-b9e6-4bae-a66a-e20851310f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:50.076028 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8b03b-b9e6-4bae-a66a-e20851310f6d None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:50.083655 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f747160-6691-43e0-a1fa-759efeb3db42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:50.084304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f747160-6691-43e0-a1fa-759efeb3db42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:50.084588 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f747160-6691-43e0-a1fa-759efeb3db42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:50.084855 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f747160-6691-43e0-a1fa-759efeb3db42 admin admin] PATH_INFO: `/v3/projects/ff31a9c661484430b5f045f285ad855c` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:50.086208 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f747160-6691-43e0-a1fa-759efeb3db42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff31a9c661484430b5f045f285ad855c)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:50.088196 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f747160-6691-43e0-a1fa-759efeb3db42 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:50.116348 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:50.145229 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-7f747160-6691-43e0-a1fa-759efeb3db42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff31a9c661484430b5f045f285ad855c', 'request_id': 'req-7f747160-6691-43e0-a1fa-759efeb3db42'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:50.152645 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-7f747160-6691-43e0-a1fa-759efeb3db42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff31a9c661484430b5f045f285ad855c', 'request_id': 'req-7f747160-6691-43e0-a1fa-759efeb3db42'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:50.161153 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-7f747160-6691-43e0-a1fa-759efeb3db42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff31a9c661484430b5f045f285ad855c', 'request_id': 'req-7f747160-6691-43e0-a1fa-759efeb3db42'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:50.182642 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-7f747160-6691-43e0-a1fa-759efeb3db42 admin admin] The token cache is being invalidate because project ff31a9c661484430b5f045f285ad855c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:50.183188 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-7f747160-6691-43e0-a1fa-759efeb3db42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:50.184364 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-7f747160-6691-43e0-a1fa-759efeb3db42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:50.187353 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1175/2345] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:50 2022] DELETE /identity/v3/projects/ff31a9c661484430b5f045f285ad855c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:50.193073 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc852b86-c4e2-45b4-9743-943330b3046f service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:50.217725 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc852b86-c4e2-45b4-9743-943330b3046f service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:50.361617 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cd4ee-0ca1-4ac6-b285-8f157292be52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:50.364174 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cd4ee-0ca1-4ac6-b285-8f157292be52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:50.364595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cd4ee-0ca1-4ac6-b285-8f157292be52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:50.365464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cd4ee-0ca1-4ac6-b285-8f157292be52 admin admin] PATH_INFO: `/v3/users/1f9a166a5b60485998b063400870d48f` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:50.367329 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cd4ee-0ca1-4ac6-b285-8f157292be52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f9a166a5b60485998b063400870d48f)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:50.369792 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cd4ee-0ca1-4ac6-b285-8f157292be52 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:50.428396 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:50.475329 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e55cd4ee-0ca1-4ac6-b285-8f157292be52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f9a166a5b60485998b063400870d48f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:50.489076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e55cd4ee-0ca1-4ac6-b285-8f157292be52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f9a166a5b60485998b063400870d48f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:50.490985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e55cd4ee-0ca1-4ac6-b285-8f157292be52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f9a166a5b60485998b063400870d48f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:50.516722 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e55cd4ee-0ca1-4ac6-b285-8f157292be52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f9a166a5b60485998b063400870d48f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:50.528369 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e55cd4ee-0ca1-4ac6-b285-8f157292be52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f9a166a5b60485998b063400870d48f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:50.536878 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1171/2346] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:50 2022] DELETE /identity/v3/users/1f9a166a5b60485998b063400870d48f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:51.025145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f747160-6691-43e0-a1fa-759efeb3db42 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:51.026578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-7f747160-6691-43e0-a1fa-759efeb3db42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:51.039745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f747160-6691-43e0-a1fa-759efeb3db42 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:51.097922 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d278a2-f9fc-4598-9a76-4ea2929577f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:51.098557 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d278a2-f9fc-4598-9a76-4ea2929577f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:51.098835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d278a2-f9fc-4598-9a76-4ea2929577f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:51.099104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d278a2-f9fc-4598-9a76-4ea2929577f1 admin admin] PATH_INFO: `/v3/projects/02c2ffe6e04a451abf058a46810d825e` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:51.100209 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d278a2-f9fc-4598-9a76-4ea2929577f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02c2ffe6e04a451abf058a46810d825e)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:51.102146 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d278a2-f9fc-4598-9a76-4ea2929577f1 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:51.154411 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-25d278a2-f9fc-4598-9a76-4ea2929577f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02c2ffe6e04a451abf058a46810d825e', 'request_id': 'req-25d278a2-f9fc-4598-9a76-4ea2929577f1'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:51.160102 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-25d278a2-f9fc-4598-9a76-4ea2929577f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02c2ffe6e04a451abf058a46810d825e', 'request_id': 'req-25d278a2-f9fc-4598-9a76-4ea2929577f1'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:51.166477 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-25d278a2-f9fc-4598-9a76-4ea2929577f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02c2ffe6e04a451abf058a46810d825e', 'request_id': 'req-25d278a2-f9fc-4598-9a76-4ea2929577f1'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:51.185997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-25d278a2-f9fc-4598-9a76-4ea2929577f1 admin admin] The token cache is being invalidate because project 02c2ffe6e04a451abf058a46810d825e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:51.186290 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-25d278a2-f9fc-4598-9a76-4ea2929577f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:51.186910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-25d278a2-f9fc-4598-9a76-4ea2929577f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:51.188414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1176/2347] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:51 2022] DELETE /identity/v3/projects/02c2ffe6e04a451abf058a46810d825e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:51.192945 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cd4ee-0ca1-4ac6-b285-8f157292be52 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:51.194391 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e55cd4ee-0ca1-4ac6-b285-8f157292be52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:51.207790 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cd4ee-0ca1-4ac6-b285-8f157292be52 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:51.283577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43640498-a6b3-4ba4-85fe-d702cb1720f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:51.284698 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43640498-a6b3-4ba4-85fe-d702cb1720f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:51.285648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43640498-a6b3-4ba4-85fe-d702cb1720f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:51.285770 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43640498-a6b3-4ba4-85fe-d702cb1720f1 admin admin] PATH_INFO: `/v3/users/a9f59a32c3d84d76b655474bde59ce0c` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:51.287304 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43640498-a6b3-4ba4-85fe-d702cb1720f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9f59a32c3d84d76b655474bde59ce0c)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:51.290866 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43640498-a6b3-4ba4-85fe-d702cb1720f1 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:51.609113 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-43640498-a6b3-4ba4-85fe-d702cb1720f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9f59a32c3d84d76b655474bde59ce0c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:51.626741 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-43640498-a6b3-4ba4-85fe-d702cb1720f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9f59a32c3d84d76b655474bde59ce0c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:51.627372 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-43640498-a6b3-4ba4-85fe-d702cb1720f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9f59a32c3d84d76b655474bde59ce0c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:51.656399 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-43640498-a6b3-4ba4-85fe-d702cb1720f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9f59a32c3d84d76b655474bde59ce0c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:51.695812 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-43640498-a6b3-4ba4-85fe-d702cb1720f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9f59a32c3d84d76b655474bde59ce0c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:51.705875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1172/2348] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:51 2022] DELETE /identity/v3/users/a9f59a32c3d84d76b655474bde59ce0c => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:52.479416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d278a2-f9fc-4598-9a76-4ea2929577f1 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:52.481256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-25d278a2-f9fc-4598-9a76-4ea2929577f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:52.515689 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d278a2-f9fc-4598-9a76-4ea2929577f1 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:52.588139 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:52.610613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0a8ad-79e8-4ef9-9780-4620de2ee2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:52.611548 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0a8ad-79e8-4ef9-9780-4620de2ee2c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:52.611833 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0a8ad-79e8-4ef9-9780-4620de2ee2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:52.612285 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0a8ad-79e8-4ef9-9780-4620de2ee2c9 admin admin] PATH_INFO: `/v3/projects/bc297310446048198247645408160efa` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:52.613514 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0a8ad-79e8-4ef9-9780-4620de2ee2c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc297310446048198247645408160efa)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:52.615550 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0a8ad-79e8-4ef9-9780-4620de2ee2c9 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:52.683030 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-aef0a8ad-79e8-4ef9-9780-4620de2ee2c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc297310446048198247645408160efa', 'request_id': 'req-aef0a8ad-79e8-4ef9-9780-4620de2ee2c9'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:52.689949 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-aef0a8ad-79e8-4ef9-9780-4620de2ee2c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc297310446048198247645408160efa', 'request_id': 'req-aef0a8ad-79e8-4ef9-9780-4620de2ee2c9'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:52.698559 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-aef0a8ad-79e8-4ef9-9780-4620de2ee2c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc297310446048198247645408160efa', 'request_id': 'req-aef0a8ad-79e8-4ef9-9780-4620de2ee2c9'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:52.712544 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-aef0a8ad-79e8-4ef9-9780-4620de2ee2c9 admin admin] The token cache is being invalidate because project bc297310446048198247645408160efa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:52.712842 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-aef0a8ad-79e8-4ef9-9780-4620de2ee2c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:52.713509 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-aef0a8ad-79e8-4ef9-9780-4620de2ee2c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:52.715014 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1177/2349] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:52 2022] DELETE /identity/v3/projects/bc297310446048198247645408160efa => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:52.722067 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f485e52-5e84-4dd8-b95c-858b7de9e265 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:52.722753 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f485e52-5e84-4dd8-b95c-858b7de9e265 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:52.723002 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f485e52-5e84-4dd8-b95c-858b7de9e265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:52.745149 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9f485e52-5e84-4dd8-b95c-858b7de9e265 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:52.746584 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9f485e52-5e84-4dd8-b95c-858b7de9e265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:52.758996 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:52.822134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1173/2350] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:52.831178 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f1420-d97d-4caf-b59b-e7fbb604c9d4 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:52.832280 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f1420-d97d-4caf-b59b-e7fbb604c9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:52.832632 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f1420-d97d-4caf-b59b-e7fbb604c9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:52.854579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-815f1420-d97d-4caf-b59b-e7fbb604c9d4 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:52.855929 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-815f1420-d97d-4caf-b59b-e7fbb604c9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:52.865892 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1178/2351] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:52.870241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f485e52-5e84-4dd8-b95c-858b7de9e265 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:52.882657 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f485e52-5e84-4dd8-b95c-858b7de9e265 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:52.897768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd26cd-d078-40b2-b67a-d26338e0a35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:52.898410 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd26cd-d078-40b2-b67a-d26338e0a35c admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:52.898697 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd26cd-d078-40b2-b67a-d26338e0a35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:52.898970 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd26cd-d078-40b2-b67a-d26338e0a35c admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:52.899628 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd26cd-d078-40b2-b67a-d26338e0a35c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:31:52.899933 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd26cd-d078-40b2-b67a-d26338e0a35c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:52.901599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd26cd-d078-40b2-b67a-d26338e0a35c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:52.914182 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1174/2352] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:31:52.918601 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f1420-d97d-4caf-b59b-e7fbb604c9d4 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:52.930152 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f1420-d97d-4caf-b59b-e7fbb604c9d4 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:52.937130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977eccdf-8331-4b25-841d-5cb8d5da9f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:52.938003 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977eccdf-8331-4b25-841d-5cb8d5da9f29 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:52.938277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977eccdf-8331-4b25-841d-5cb8d5da9f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:52.938685 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977eccdf-8331-4b25-841d-5cb8d5da9f29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:52.939927 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977eccdf-8331-4b25-841d-5cb8d5da9f29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:52.950399 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977eccdf-8331-4b25-841d-5cb8d5da9f29 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:53.005393 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1179/2353] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:52 2022] POST /identity/v3/projects => generated 369 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:31:53.009193 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd26cd-d078-40b2-b67a-d26338e0a35c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:53.020191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd26cd-d078-40b2-b67a-d26338e0a35c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:53.120257 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867301f-0bd6-4b68-86ec-f07963314f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:53.124007 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867301f-0bd6-4b68-86ec-f07963314f31 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:53.124363 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867301f-0bd6-4b68-86ec-f07963314f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:53.124703 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867301f-0bd6-4b68-86ec-f07963314f31 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:53.125467 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867301f-0bd6-4b68-86ec-f07963314f31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:53.127647 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867301f-0bd6-4b68-86ec-f07963314f31 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:53.167167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1175/2354] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:53 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:31:53.171173 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977eccdf-8331-4b25-841d-5cb8d5da9f29 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:53.182067 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977eccdf-8331-4b25-841d-5cb8d5da9f29 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:53.186699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987130b-d46a-4aaa-97e5-d34f09638b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:53.187288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987130b-d46a-4aaa-97e5-d34f09638b3e admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:53.187563 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987130b-d46a-4aaa-97e5-d34f09638b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:53.187831 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987130b-d46a-4aaa-97e5-d34f09638b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:53.188488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987130b-d46a-4aaa-97e5-d34f09638b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:53.190127 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987130b-d46a-4aaa-97e5-d34f09638b3e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:53.202439 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1180/2355] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:53.209473 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867301f-0bd6-4b68-86ec-f07963314f31 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:53.219405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867301f-0bd6-4b68-86ec-f07963314f31 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:53.224464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9291465-4d8b-453a-a0d3-a641a94cb17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:53.225311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9291465-4d8b-453a-a0d3-a641a94cb17c admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:53.225818 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9291465-4d8b-453a-a0d3-a641a94cb17c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:53.226117 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9291465-4d8b-453a-a0d3-a641a94cb17c admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:53.226939 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9291465-4d8b-453a-a0d3-a641a94cb17c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:53.229066 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9291465-4d8b-453a-a0d3-a641a94cb17c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:53.241656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1176/2356] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:53.245863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987130b-d46a-4aaa-97e5-d34f09638b3e admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:53.255707 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987130b-d46a-4aaa-97e5-d34f09638b3e admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:53.260239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedc74c-1c2c-4c3c-9030-0ee794bb1df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:53.260877 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedc74c-1c2c-4c3c-9030-0ee794bb1df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:53.261181 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedc74c-1c2c-4c3c-9030-0ee794bb1df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:53.261453 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedc74c-1c2c-4c3c-9030-0ee794bb1df5 admin admin] PATH_INFO: `/v3/projects/990cadd5d2e0463ba54a76199f465736/users/2dfc21e67d594c82a166cb487204237c/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:53.275658 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbedc74c-1c2c-4c3c-9030-0ee794bb1df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=990cadd5d2e0463ba54a76199f465736, user_id=2dfc21e67d594c82a166cb487204237c, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:53.278353 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbedc74c-1c2c-4c3c-9030-0ee794bb1df5 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:53.303996 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1181/2357] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:53 2022] PUT /identity/v3/projects/990cadd5d2e0463ba54a76199f465736/users/2dfc21e67d594c82a166cb487204237c/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:53.309130 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fd1f6-215a-4349-9184-20a3fee59be8 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:53.309413 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fd1f6-215a-4349-9184-20a3fee59be8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:53.309710 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fd1f6-215a-4349-9184-20a3fee59be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:53.331316 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-943fd1f6-215a-4349-9184-20a3fee59be8 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:53.332753 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-943fd1f6-215a-4349-9184-20a3fee59be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:53.409267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1177/2358] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:53.421127 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedc74c-1c2c-4c3c-9030-0ee794bb1df5 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:53.422905 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-cbedc74c-1c2c-4c3c-9030-0ee794bb1df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:53.499810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedc74c-1c2c-4c3c-9030-0ee794bb1df5 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:53.503722 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b1910-c19d-4e5f-b14d-01bc00d33cdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:53.504494 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b1910-c19d-4e5f-b14d-01bc00d33cdc service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:53.504777 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b1910-c19d-4e5f-b14d-01bc00d33cdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:53.505096 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b1910-c19d-4e5f-b14d-01bc00d33cdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:53.515275 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b1910-c19d-4e5f-b14d-01bc00d33cdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:53.516700 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b1910-c19d-4e5f-b14d-01bc00d33cdc service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:53.526597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1182/2359] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:31:56.896851 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c8be9-7414-456e-b435-27ee08218960 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:56.897459 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c8be9-7414-456e-b435-27ee08218960 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:56.897459 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c8be9-7414-456e-b435-27ee08218960 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:56.898793 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1178/2360] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 9 02:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:31:56.941760 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6af5a9-8e6e-4e66-a211-c730e16db0de None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:56.942728 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6af5a9-8e6e-4e66-a211-c730e16db0de None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:56.943284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6af5a9-8e6e-4e66-a211-c730e16db0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:56.967695 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-8b6af5a9-8e6e-4e66-a211-c730e16db0de None None] MFA Rules not processed for user `5fe21d9a65a34abeae7329df924d7998`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:56.969362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8b6af5a9-8e6e-4e66-a211-c730e16db0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:56.991102 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:57.009302 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c8be9-7414-456e-b435-27ee08218960 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:57.011847 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8b3c8be9-7414-456e-b435-27ee08218960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:57.045153 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c8be9-7414-456e-b435-27ee08218960 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:57.051774 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476fffb-b14e-44d4-a3ce-70ad0959d9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:57.077540 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476fffb-b14e-44d4-a3ce-70ad0959d9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:57.078295 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476fffb-b14e-44d4-a3ce-70ad0959d9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:57.080269 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476fffb-b14e-44d4-a3ce-70ad0959d9cc admin admin] PATH_INFO: `/v3/users/76f7ebd282b5468994f6158ac893a660` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:57.082703 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476fffb-b14e-44d4-a3ce-70ad0959d9cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=76f7ebd282b5468994f6158ac893a660)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:57.086438 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476fffb-b14e-44d4-a3ce-70ad0959d9cc admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:57.120105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1183/2361] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 9 02:31:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:57.137833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:57.145727 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6af5a9-8e6e-4e66-a211-c730e16db0de None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:57.149642 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8b6af5a9-8e6e-4e66-a211-c730e16db0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:57.169536 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6af5a9-8e6e-4e66-a211-c730e16db0de None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:57.178791 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee03aa5-cb44-41c0-b27a-900ede2a6f49 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fe21d9a65a34abeae7329df924d7998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:57.179432 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee03aa5-cb44-41c0-b27a-900ede2a6f49 service placement] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:57.179717 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee03aa5-cb44-41c0-b27a-900ede2a6f49 service placement] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:57.182457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee03aa5-cb44-41c0-b27a-900ede2a6f49 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:57.192870 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a476fffb-b14e-44d4-a3ce-70ad0959d9cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76f7ebd282b5468994f6158ac893a660'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:57.198658 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee03aa5-cb44-41c0-b27a-900ede2a6f49 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:57.205567 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee03aa5-cb44-41c0-b27a-900ede2a6f49 service placement] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:57.215916 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a476fffb-b14e-44d4-a3ce-70ad0959d9cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76f7ebd282b5468994f6158ac893a660'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:57.216285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a476fffb-b14e-44d4-a3ce-70ad0959d9cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76f7ebd282b5468994f6158ac893a660'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:57.228346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1184/2362] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:31:57.267299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a476fffb-b14e-44d4-a3ce-70ad0959d9cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76f7ebd282b5468994f6158ac893a660'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:57.277990 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a476fffb-b14e-44d4-a3ce-70ad0959d9cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76f7ebd282b5468994f6158ac893a660'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:57.295911 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1179/2363] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:57 2022] DELETE /identity/v3/users/76f7ebd282b5468994f6158ac893a660 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:57.629960 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee03aa5-cb44-41c0-b27a-900ede2a6f49 service placement] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:57.647039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee03aa5-cb44-41c0-b27a-900ede2a6f49 service placement] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:57.737118 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e368ef-294b-4dff-af3d-81ffa27c28ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:57.738066 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e368ef-294b-4dff-af3d-81ffa27c28ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:57.738488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e368ef-294b-4dff-af3d-81ffa27c28ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:57.739188 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e368ef-294b-4dff-af3d-81ffa27c28ef admin admin] PATH_INFO: `/v3/projects/094166335ac343b4a4107ad45d068311` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:57.740926 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e368ef-294b-4dff-af3d-81ffa27c28ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=094166335ac343b4a4107ad45d068311)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:57.744054 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e368ef-294b-4dff-af3d-81ffa27c28ef admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:57.832978 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-59e368ef-294b-4dff-af3d-81ffa27c28ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '094166335ac343b4a4107ad45d068311', 'request_id': 'req-59e368ef-294b-4dff-af3d-81ffa27c28ef'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:57.840627 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-59e368ef-294b-4dff-af3d-81ffa27c28ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '094166335ac343b4a4107ad45d068311', 'request_id': 'req-59e368ef-294b-4dff-af3d-81ffa27c28ef'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:57.849719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-59e368ef-294b-4dff-af3d-81ffa27c28ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '094166335ac343b4a4107ad45d068311', 'request_id': 'req-59e368ef-294b-4dff-af3d-81ffa27c28ef'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:57.872180 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-59e368ef-294b-4dff-af3d-81ffa27c28ef admin admin] The token cache is being invalidate because project 094166335ac343b4a4107ad45d068311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:57.873371 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-59e368ef-294b-4dff-af3d-81ffa27c28ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:57.874409 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-59e368ef-294b-4dff-af3d-81ffa27c28ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:57.877538 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1185/2364] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:57 2022] DELETE /identity/v3/projects/094166335ac343b4a4107ad45d068311 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:57.886413 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476fffb-b14e-44d4-a3ce-70ad0959d9cc admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:57.889307 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a476fffb-b14e-44d4-a3ce-70ad0959d9cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:57.912903 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476fffb-b14e-44d4-a3ce-70ad0959d9cc admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:57.991571 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9614d4a-e74a-4321-ac9e-8dd593010c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:57.992515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9614d4a-e74a-4321-ac9e-8dd593010c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:57.993039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9614d4a-e74a-4321-ac9e-8dd593010c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:57.993521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9614d4a-e74a-4321-ac9e-8dd593010c3d admin admin] PATH_INFO: `/v3/users/31f2d947412c43b1b6336f911eae7a89` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:57.994956 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9614d4a-e74a-4321-ac9e-8dd593010c3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=31f2d947412c43b1b6336f911eae7a89)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:57.997111 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9614d4a-e74a-4321-ac9e-8dd593010c3d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:58.060841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c9614d4a-e74a-4321-ac9e-8dd593010c3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31f2d947412c43b1b6336f911eae7a89'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:58.074249 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c9614d4a-e74a-4321-ac9e-8dd593010c3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31f2d947412c43b1b6336f911eae7a89'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:58.075194 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c9614d4a-e74a-4321-ac9e-8dd593010c3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31f2d947412c43b1b6336f911eae7a89'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:58.092767 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c9614d4a-e74a-4321-ac9e-8dd593010c3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31f2d947412c43b1b6336f911eae7a89'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:58.102833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c9614d4a-e74a-4321-ac9e-8dd593010c3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31f2d947412c43b1b6336f911eae7a89'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:58.112170 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1180/2365] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:31:57 2022] DELETE /identity/v3/users/31f2d947412c43b1b6336f911eae7a89 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:58.380852 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e368ef-294b-4dff-af3d-81ffa27c28ef admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:58.383091 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-59e368ef-294b-4dff-af3d-81ffa27c28ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:58.400510 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e368ef-294b-4dff-af3d-81ffa27c28ef admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:58.426266 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:58.506506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae8631-d027-4ff6-9167-4c60aa8a7aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:58.507170 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae8631-d027-4ff6-9167-4c60aa8a7aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:58.507467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae8631-d027-4ff6-9167-4c60aa8a7aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:58.507872 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae8631-d027-4ff6-9167-4c60aa8a7aac admin admin] PATH_INFO: `/v3/projects/9c334faace8d4e428935147e4247c1b3` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:58.509932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae8631-d027-4ff6-9167-4c60aa8a7aac admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c334faace8d4e428935147e4247c1b3)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:58.512767 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae8631-d027-4ff6-9167-4c60aa8a7aac admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:58.600009 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-50ae8631-d027-4ff6-9167-4c60aa8a7aac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c334faace8d4e428935147e4247c1b3', 'request_id': 'req-50ae8631-d027-4ff6-9167-4c60aa8a7aac'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:58.625641 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-50ae8631-d027-4ff6-9167-4c60aa8a7aac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c334faace8d4e428935147e4247c1b3', 'request_id': 'req-50ae8631-d027-4ff6-9167-4c60aa8a7aac'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:58.640942 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-50ae8631-d027-4ff6-9167-4c60aa8a7aac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c334faace8d4e428935147e4247c1b3', 'request_id': 'req-50ae8631-d027-4ff6-9167-4c60aa8a7aac'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:58.660107 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-50ae8631-d027-4ff6-9167-4c60aa8a7aac admin admin] The token cache is being invalidate because project 9c334faace8d4e428935147e4247c1b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:31:58.660107 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-50ae8631-d027-4ff6-9167-4c60aa8a7aac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:58.663148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-50ae8631-d027-4ff6-9167-4c60aa8a7aac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:31:58.667109 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1186/2366] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:31:58 2022] DELETE /identity/v3/projects/9c334faace8d4e428935147e4247c1b3 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:58.671688 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b068169-087d-4f72-b6dc-9b4ccf1e91bd None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:58.672357 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b068169-087d-4f72-b6dc-9b4ccf1e91bd None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:58.672841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b068169-087d-4f72-b6dc-9b4ccf1e91bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:58.741121 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7b068169-087d-4f72-b6dc-9b4ccf1e91bd None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:58.742730 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7b068169-087d-4f72-b6dc-9b4ccf1e91bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:58.762533 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:58.836773 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1181/2367] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:31:58.844475 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b495089-4aaa-4b3f-a20a-dac050780b16 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:58.844971 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b495089-4aaa-4b3f-a20a-dac050780b16 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:58.845334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b495089-4aaa-4b3f-a20a-dac050780b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:58.868153 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-1b495089-4aaa-4b3f-a20a-dac050780b16 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:58.869429 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1b495089-4aaa-4b3f-a20a-dac050780b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:58.878258 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1187/2368] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:58.881956 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b068169-087d-4f72-b6dc-9b4ccf1e91bd None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:58.893279 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b068169-087d-4f72-b6dc-9b4ccf1e91bd None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:58.898916 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0463438-a410-4b23-8f2a-98c5f189c41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:58.899534 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0463438-a410-4b23-8f2a-98c5f189c41f admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:58.899812 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0463438-a410-4b23-8f2a-98c5f189c41f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:58.900085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0463438-a410-4b23-8f2a-98c5f189c41f admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:58.900810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0463438-a410-4b23-8f2a-98c5f189c41f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:31:58.901838 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0463438-a410-4b23-8f2a-98c5f189c41f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:58.903770 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0463438-a410-4b23-8f2a-98c5f189c41f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:58.924434 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b495089-4aaa-4b3f-a20a-dac050780b16 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:58.933259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1182/2369] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:31:58.934787 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b495089-4aaa-4b3f-a20a-dac050780b16 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:58.940362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10aac74-a865-4652-a798-0d22175bad10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:58.940730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10aac74-a865-4652-a798-0d22175bad10 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:58.940957 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10aac74-a865-4652-a798-0d22175bad10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:58.941233 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10aac74-a865-4652-a798-0d22175bad10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:58.942207 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10aac74-a865-4652-a798-0d22175bad10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:58.943876 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10aac74-a865-4652-a798-0d22175bad10 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:58.984570 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1188/2370] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:31:58 2022] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:58.988127 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0463438-a410-4b23-8f2a-98c5f189c41f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:58.999765 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0463438-a410-4b23-8f2a-98c5f189c41f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:59.068036 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a75077-8dde-4006-a3ea-ab300fc1f3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:59.068757 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a75077-8dde-4006-a3ea-ab300fc1f3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:59.069139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a75077-8dde-4006-a3ea-ab300fc1f3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:59.069475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a75077-8dde-4006-a3ea-ab300fc1f3b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:59.070482 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a75077-8dde-4006-a3ea-ab300fc1f3b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:59.072489 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a75077-8dde-4006-a3ea-ab300fc1f3b6 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:59.103848 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1183/2371] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:31:58 2022] POST /identity/v3/users => generated 285 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:31:59.105092 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10aac74-a865-4652-a798-0d22175bad10 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:59.117119 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10aac74-a865-4652-a798-0d22175bad10 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:59.121956 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772a764-171a-4760-9938-8e2ad0ca68da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:59.122622 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772a764-171a-4760-9938-8e2ad0ca68da admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:59.122903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772a764-171a-4760-9938-8e2ad0ca68da admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:59.123171 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772a764-171a-4760-9938-8e2ad0ca68da admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:59.123838 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772a764-171a-4760-9938-8e2ad0ca68da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:59.125469 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772a764-171a-4760-9938-8e2ad0ca68da admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:59.140597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1189/2372] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:31:59.141839 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a75077-8dde-4006-a3ea-ab300fc1f3b6 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:59.154465 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a75077-8dde-4006-a3ea-ab300fc1f3b6 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:59.160562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14e112-b85c-4133-adeb-09af0dc0df57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:59.161599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14e112-b85c-4133-adeb-09af0dc0df57 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:59.161599 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14e112-b85c-4133-adeb-09af0dc0df57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:59.161795 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14e112-b85c-4133-adeb-09af0dc0df57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:59.162363 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14e112-b85c-4133-adeb-09af0dc0df57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:59.163981 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14e112-b85c-4133-adeb-09af0dc0df57 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:59.226355 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1184/2373] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:31:59.243559 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772a764-171a-4760-9938-8e2ad0ca68da admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:59.264409 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772a764-171a-4760-9938-8e2ad0ca68da admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:59.272581 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde6e17-aa49-496e-9d0c-b930abc3c9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:59.273289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde6e17-aa49-496e-9d0c-b930abc3c9c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:59.273574 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde6e17-aa49-496e-9d0c-b930abc3c9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:59.273849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde6e17-aa49-496e-9d0c-b930abc3c9c1 admin admin] PATH_INFO: `/v3/projects/daf0834d7f4e4b02a690d8a038cb9e0b/users/780952cbd0e04754bb2faf17e9f83362/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:59.299331 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde6e17-aa49-496e-9d0c-b930abc3c9c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daf0834d7f4e4b02a690d8a038cb9e0b, user_id=780952cbd0e04754bb2faf17e9f83362, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:59.302725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde6e17-aa49-496e-9d0c-b930abc3c9c1 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:59.334045 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1190/2374] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:31:59 2022] PUT /identity/v3/projects/daf0834d7f4e4b02a690d8a038cb9e0b/users/780952cbd0e04754bb2faf17e9f83362/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:31:59.347107 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3f8ea-598a-471c-b0df-bc9fb49355e5 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:59.347669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3f8ea-598a-471c-b0df-bc9fb49355e5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:59.348064 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3f8ea-598a-471c-b0df-bc9fb49355e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:59.393754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-46d3f8ea-598a-471c-b0df-bc9fb49355e5 None None] MFA Rules not processed for user `780952cbd0e04754bb2faf17e9f83362`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:31:59.395526 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-46d3f8ea-598a-471c-b0df-bc9fb49355e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:59.490762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1185/2375] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:31:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:31:59.505114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde6e17-aa49-496e-9d0c-b930abc3c9c1 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:31:59.507683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ccde6e17-aa49-496e-9d0c-b930abc3c9c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:31:59.629426 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde6e17-aa49-496e-9d0c-b930abc3c9c1 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:31:59.638151 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57952814-8352-41da-9268-d3e046914061 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63645a88f5924a57b5b828aacd856902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:31:59.638783 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57952814-8352-41da-9268-d3e046914061 service glance] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:31:59.639121 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57952814-8352-41da-9268-d3e046914061 service glance] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:31:59.639837 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57952814-8352-41da-9268-d3e046914061 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:31:59.645858 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:31:59.650857 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57952814-8352-41da-9268-d3e046914061 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:31:59.653122 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57952814-8352-41da-9268-d3e046914061 service glance] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:31:59.672222 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1191/2376] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:31:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:32:01.093313 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b90016-e03b-45a7-adf9-822d175a7e6b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:01.093800 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b90016-e03b-45a7-adf9-822d175a7e6b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:01.094054 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b90016-e03b-45a7-adf9-822d175a7e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:01.118336 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:32:01.129076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-99b90016-e03b-45a7-adf9-822d175a7e6b None None] MFA Rules not processed for user `2dfc21e67d594c82a166cb487204237c`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:01.130290 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-99b90016-e03b-45a7-adf9-822d175a7e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:01.204746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1186/2377] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:32:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:32:01.211871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57952814-8352-41da-9268-d3e046914061 service glance] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:01.213632 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-57952814-8352-41da-9268-d3e046914061 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:01.293964 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57952814-8352-41da-9268-d3e046914061 service glance] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:01.299309 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623b938-b384-4ebc-8a52-caba43cd415a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:01.299960 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623b938-b384-4ebc-8a52-caba43cd415a admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:01.300419 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623b938-b384-4ebc-8a52-caba43cd415a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:01.300556 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623b938-b384-4ebc-8a52-caba43cd415a admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:01.301283 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623b938-b384-4ebc-8a52-caba43cd415a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:01.304789 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623b938-b384-4ebc-8a52-caba43cd415a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:01.335560 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1192/2378] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:32:01 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:32:01.339237 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b90016-e03b-45a7-adf9-822d175a7e6b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:01.357593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b90016-e03b-45a7-adf9-822d175a7e6b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:01.446402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64681b29-7c64-48ed-9c30-7519e7968409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:01.447034 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64681b29-7c64-48ed-9c30-7519e7968409 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:01.447312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64681b29-7c64-48ed-9c30-7519e7968409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:01.447577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64681b29-7c64-48ed-9c30-7519e7968409 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:01.448203 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64681b29-7c64-48ed-9c30-7519e7968409 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:01.450313 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64681b29-7c64-48ed-9c30-7519e7968409 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:01.506061 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1187/2379] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:32:01 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:32:01.510274 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623b938-b384-4ebc-8a52-caba43cd415a admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:01.523869 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623b938-b384-4ebc-8a52-caba43cd415a admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:01.536135 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1426d1-cbd1-4863-9c7b-fcdf47c6aad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:01.537077 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1426d1-cbd1-4863-9c7b-fcdf47c6aad8 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:01.537233 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1426d1-cbd1-4863-9c7b-fcdf47c6aad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:01.537609 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1426d1-cbd1-4863-9c7b-fcdf47c6aad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:01.538338 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1426d1-cbd1-4863-9c7b-fcdf47c6aad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:01.540068 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1426d1-cbd1-4863-9c7b-fcdf47c6aad8 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:01.553071 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1193/2380] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:32:01.558090 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64681b29-7c64-48ed-9c30-7519e7968409 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:01.571826 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64681b29-7c64-48ed-9c30-7519e7968409 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:01.582123 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a266a4d-a697-4f44-bee0-b00b417ac7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:01.582821 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a266a4d-a697-4f44-bee0-b00b417ac7e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:01.583160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a266a4d-a697-4f44-bee0-b00b417ac7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:01.583417 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a266a4d-a697-4f44-bee0-b00b417ac7e2 admin admin] PATH_INFO: `/v3/projects/78e85f7422b84255b372fb8daf142843/users/5a797d556f314170bab7a6b2c25d81e0/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:01.606143 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a266a4d-a697-4f44-bee0-b00b417ac7e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78e85f7422b84255b372fb8daf142843, user_id=5a797d556f314170bab7a6b2c25d81e0, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:01.606143 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a266a4d-a697-4f44-bee0-b00b417ac7e2 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:01.625418 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1188/2381] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:32:01 2022] PUT /identity/v3/projects/78e85f7422b84255b372fb8daf142843/users/5a797d556f314170bab7a6b2c25d81e0/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:32:01.630086 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1426d1-cbd1-4863-9c7b-fcdf47c6aad8 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:01.644742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1426d1-cbd1-4863-9c7b-fcdf47c6aad8 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:01.708583 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafb317-a3ee-4f26-ac93-cd7a0e9b625f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:01.709282 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafb317-a3ee-4f26-ac93-cd7a0e9b625f admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:01.710206 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafb317-a3ee-4f26-ac93-cd7a0e9b625f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:01.710482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafb317-a3ee-4f26-ac93-cd7a0e9b625f admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:01.711173 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafb317-a3ee-4f26-ac93-cd7a0e9b625f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:01.712786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafb317-a3ee-4f26-ac93-cd7a0e9b625f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:01.732352 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1194/2382] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:32:01.734581 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a266a4d-a697-4f44-bee0-b00b417ac7e2 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:01.748901 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a266a4d-a697-4f44-bee0-b00b417ac7e2 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:01.753931 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32435862-ceab-41f8-9334-f50823ad7696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:01.754748 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32435862-ceab-41f8-9334-f50823ad7696 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:01.755029 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32435862-ceab-41f8-9334-f50823ad7696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:01.755294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32435862-ceab-41f8-9334-f50823ad7696 admin admin] PATH_INFO: `/v3/projects/78e85f7422b84255b372fb8daf142843/users/5a797d556f314170bab7a6b2c25d81e0/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:01.757747 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32435862-ceab-41f8-9334-f50823ad7696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78e85f7422b84255b372fb8daf142843, user_id=5a797d556f314170bab7a6b2c25d81e0, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:01.760310 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32435862-ceab-41f8-9334-f50823ad7696 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:01.779132 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1189/2383] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:32:01 2022] PUT /identity/v3/projects/78e85f7422b84255b372fb8daf142843/users/5a797d556f314170bab7a6b2c25d81e0/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:32:02.734361 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e638129-2587-4231-9a14-7afc5788d53d None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:02.734908 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e638129-2587-4231-9a14-7afc5788d53d None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:02.738529 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e638129-2587-4231-9a14-7afc5788d53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:02.767728 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-2e638129-2587-4231-9a14-7afc5788d53d None None] MFA Rules not processed for user `07041df2276d4dd58fb0e49417a26e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:02.769413 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2e638129-2587-4231-9a14-7afc5788d53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:02.852920 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1195/2384] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 9 02:32:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:32:02.920041 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32435862-ceab-41f8-9334-f50823ad7696 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:02.927539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-32435862-ceab-41f8-9334-f50823ad7696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:03.074999 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:32:03.109438 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32435862-ceab-41f8-9334-f50823ad7696 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:03.119416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b5300-2bb3-4b3c-837b-763a941f415d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9151f210d29542dcb41ea3bc03390350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:03.120288 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b5300-2bb3-4b3c-837b-763a941f415d service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:03.122424 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b5300-2bb3-4b3c-837b-763a941f415d service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:03.122708 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b5300-2bb3-4b3c-837b-763a941f415d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:03.135588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b5300-2bb3-4b3c-837b-763a941f415d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:03.137883 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b5300-2bb3-4b3c-837b-763a941f415d service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:03.158401 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1190/2385] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 9 02:32:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 02:32:10.825881 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d103f-97b8-4b58-84ed-e47515950179 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:10.826486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d103f-97b8-4b58-84ed-e47515950179 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:10.826486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d103f-97b8-4b58-84ed-e47515950179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:10.859182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:32:10.872695 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-be0d103f-97b8-4b58-84ed-e47515950179 None None] MFA Rules not processed for user `5a797d556f314170bab7a6b2c25d81e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:10.876317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-be0d103f-97b8-4b58-84ed-e47515950179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:11.096642 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1196/2386] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:32:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:32:11.111410 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b5300-2bb3-4b3c-837b-763a941f415d service swift] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:11.114263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2a6b5300-2bb3-4b3c-837b-763a941f415d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:11.206964 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b5300-2bb3-4b3c-837b-763a941f415d service swift] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:11.214131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751599cc-24be-4871-8a5c-14de90ac43c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:11.215197 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751599cc-24be-4871-8a5c-14de90ac43c6 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:11.215684 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751599cc-24be-4871-8a5c-14de90ac43c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:11.216650 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751599cc-24be-4871-8a5c-14de90ac43c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:11.296737 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751599cc-24be-4871-8a5c-14de90ac43c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:11.298530 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751599cc-24be-4871-8a5c-14de90ac43c6 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:11.309107 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1191/2387] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:32:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:32:12.068966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d103f-97b8-4b58-84ed-e47515950179 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:12.071536 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-be0d103f-97b8-4b58-84ed-e47515950179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:12.236648 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d103f-97b8-4b58-84ed-e47515950179 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:12.247685 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afa131-63a1-42b9-9ee6-143e5c5349d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:12.248625 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afa131-63a1-42b9-9ee6-143e5c5349d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:12.249003 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afa131-63a1-42b9-9ee6-143e5c5349d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:12.249437 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afa131-63a1-42b9-9ee6-143e5c5349d1 admin admin] PATH_INFO: `/v3/users/e89680f4537d4c1992be71b673d00909` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:12.251516 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afa131-63a1-42b9-9ee6-143e5c5349d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e89680f4537d4c1992be71b673d00909)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:12.256605 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afa131-63a1-42b9-9ee6-143e5c5349d1 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:12.358236 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-58afa131-63a1-42b9-9ee6-143e5c5349d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e89680f4537d4c1992be71b673d00909'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:12.388238 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-58afa131-63a1-42b9-9ee6-143e5c5349d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e89680f4537d4c1992be71b673d00909'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:12.407890 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-58afa131-63a1-42b9-9ee6-143e5c5349d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e89680f4537d4c1992be71b673d00909'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:12.409410 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-58afa131-63a1-42b9-9ee6-143e5c5349d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e89680f4537d4c1992be71b673d00909'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:12.442648 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-58afa131-63a1-42b9-9ee6-143e5c5349d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e89680f4537d4c1992be71b673d00909'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:12.466731 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1197/2388] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:32:12 2022] DELETE /identity/v3/users/e89680f4537d4c1992be71b673d00909 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:32:12.468473 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182a933-2241-4cf2-9d99-c5ca183e1e4a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:12.468952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182a933-2241-4cf2-9d99-c5ca183e1e4a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:12.469073 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182a933-2241-4cf2-9d99-c5ca183e1e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:12.494547 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5182a933-2241-4cf2-9d99-c5ca183e1e4a None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:12.496035 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5182a933-2241-4cf2-9d99-c5ca183e1e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:12.591085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1192/2389] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:32:12.603586 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afa131-63a1-42b9-9ee6-143e5c5349d1 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:12.605126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-58afa131-63a1-42b9-9ee6-143e5c5349d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:12.621449 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:32:12.730383 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afa131-63a1-42b9-9ee6-143e5c5349d1 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:12.735478 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a038bc-bbb1-4391-9cb3-b93d555ca76c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:12.736330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a038bc-bbb1-4391-9cb3-b93d555ca76c service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:12.737624 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a038bc-bbb1-4391-9cb3-b93d555ca76c service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:12.738006 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a038bc-bbb1-4391-9cb3-b93d555ca76c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:12.752217 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a038bc-bbb1-4391-9cb3-b93d555ca76c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:12.754534 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a038bc-bbb1-4391-9cb3-b93d555ca76c service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:12.769400 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1198/2390] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:32:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:32:13.244410 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514845eb-8005-49fa-8920-21cbda274c25 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:13.244933 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514845eb-8005-49fa-8920-21cbda274c25 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:13.245838 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514845eb-8005-49fa-8920-21cbda274c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:13.270548 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-514845eb-8005-49fa-8920-21cbda274c25 None None] MFA Rules not processed for user `2dfc21e67d594c82a166cb487204237c`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:13.276293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-514845eb-8005-49fa-8920-21cbda274c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:13.308417 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:32:13.401348 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1193/2391] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:32:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:32:13.407358 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a038bc-bbb1-4391-9cb3-b93d555ca76c service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:13.410214 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a7a038bc-bbb1-4391-9cb3-b93d555ca76c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:13.451367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a038bc-bbb1-4391-9cb3-b93d555ca76c service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:13.458518 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3b17f-8422-4dcd-b82b-d30181ab482a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:13.459411 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3b17f-8422-4dcd-b82b-d30181ab482a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:13.459697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3b17f-8422-4dcd-b82b-d30181ab482a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:13.460011 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3b17f-8422-4dcd-b82b-d30181ab482a admin admin] PATH_INFO: `/v3/projects/7dffc540bfba4b11bee93adc5625db30` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:13.461341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3b17f-8422-4dcd-b82b-d30181ab482a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dffc540bfba4b11bee93adc5625db30)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:13.463262 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3b17f-8422-4dcd-b82b-d30181ab482a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:13.527864 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c7b3b17f-8422-4dcd-b82b-d30181ab482a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dffc540bfba4b11bee93adc5625db30', 'request_id': 'req-c7b3b17f-8422-4dcd-b82b-d30181ab482a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:13.536255 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c7b3b17f-8422-4dcd-b82b-d30181ab482a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dffc540bfba4b11bee93adc5625db30', 'request_id': 'req-c7b3b17f-8422-4dcd-b82b-d30181ab482a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:13.546324 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c7b3b17f-8422-4dcd-b82b-d30181ab482a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dffc540bfba4b11bee93adc5625db30', 'request_id': 'req-c7b3b17f-8422-4dcd-b82b-d30181ab482a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:13.562282 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c7b3b17f-8422-4dcd-b82b-d30181ab482a admin admin] The token cache is being invalidate because project 7dffc540bfba4b11bee93adc5625db30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:32:13.562576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c7b3b17f-8422-4dcd-b82b-d30181ab482a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:13.563273 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c7b3b17f-8422-4dcd-b82b-d30181ab482a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:13.565189 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1199/2392] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:32:13 2022] DELETE /identity/v3/projects/7dffc540bfba4b11bee93adc5625db30 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:32:13.570396 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3b97a-76a1-497a-bd99-0a964a79c90f None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:13.571033 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3b97a-76a1-497a-bd99-0a964a79c90f None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:13.571570 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3b97a-76a1-497a-bd99-0a964a79c90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:13.599087 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c5e3b97a-76a1-497a-bd99-0a964a79c90f None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:13.601306 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c5e3b97a-76a1-497a-bd99-0a964a79c90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:13.678808 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1194/2393] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:32:13.689925 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfdb15-37d9-4e51-a444-779761a20542 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:13.690301 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfdb15-37d9-4e51-a444-779761a20542 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:13.690592 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdfdb15-37d9-4e51-a444-779761a20542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:13.718844 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-fbdfdb15-37d9-4e51-a444-779761a20542 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:13.721853 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-fbdfdb15-37d9-4e51-a444-779761a20542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:13.737365 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1200/2394] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:32:13.742112 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3b97a-76a1-497a-bd99-0a964a79c90f None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:13.770397 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3b97a-76a1-497a-bd99-0a964a79c90f None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:13.784795 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6e483-f546-416b-aae0-a2635e4eeffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:13.785883 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6e483-f546-416b-aae0-a2635e4eeffd admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:13.787817 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6e483-f546-416b-aae0-a2635e4eeffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:13.788803 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6e483-f546-416b-aae0-a2635e4eeffd admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:13.791085 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6e483-f546-416b-aae0-a2635e4eeffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:32:13.792431 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6e483-f546-416b-aae0-a2635e4eeffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:13.796380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6e483-f546-416b-aae0-a2635e4eeffd admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:13.842062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1195/2395] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:32:13.847150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfdb15-37d9-4e51-a444-779761a20542 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:13.865528 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdfdb15-37d9-4e51-a444-779761a20542 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:13.902239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20deae9a-4663-4554-b358-2c0ad7f59ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:13.902805 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20deae9a-4663-4554-b358-2c0ad7f59ffb admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:13.903101 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20deae9a-4663-4554-b358-2c0ad7f59ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:13.903379 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20deae9a-4663-4554-b358-2c0ad7f59ffb admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:13.904047 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20deae9a-4663-4554-b358-2c0ad7f59ffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:13.916217 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20deae9a-4663-4554-b358-2c0ad7f59ffb admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:13.997054 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1201/2396] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:32:13 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:32:14.000796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6e483-f546-416b-aae0-a2635e4eeffd admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:14.014019 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6e483-f546-416b-aae0-a2635e4eeffd admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:14.222178 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21880fd-bcd7-4d7d-aa6c-8db57fc7cdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:14.222824 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21880fd-bcd7-4d7d-aa6c-8db57fc7cdc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:14.223115 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21880fd-bcd7-4d7d-aa6c-8db57fc7cdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:14.223388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21880fd-bcd7-4d7d-aa6c-8db57fc7cdc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:14.230960 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21880fd-bcd7-4d7d-aa6c-8db57fc7cdc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:14.235824 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21880fd-bcd7-4d7d-aa6c-8db57fc7cdc4 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:14.291641 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1196/2397] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:32:13 2022] POST /identity/v3/users => generated 287 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:32:14.292830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20deae9a-4663-4554-b358-2c0ad7f59ffb admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:14.307430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20deae9a-4663-4554-b358-2c0ad7f59ffb admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:14.325738 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc269d-203d-42e3-80f0-80778b667066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:14.326378 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc269d-203d-42e3-80f0-80778b667066 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:14.326667 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc269d-203d-42e3-80f0-80778b667066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:14.326941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc269d-203d-42e3-80f0-80778b667066 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:14.327801 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc269d-203d-42e3-80f0-80778b667066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:14.329441 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc269d-203d-42e3-80f0-80778b667066 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:14.361812 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1202/2398] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:32:14.363078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21880fd-bcd7-4d7d-aa6c-8db57fc7cdc4 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:14.388957 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21880fd-bcd7-4d7d-aa6c-8db57fc7cdc4 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:14.399164 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e748db-b148-4f84-948e-2e040a9d0cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:14.399795 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e748db-b148-4f84-948e-2e040a9d0cfd admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:14.400077 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e748db-b148-4f84-948e-2e040a9d0cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:14.400355 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e748db-b148-4f84-948e-2e040a9d0cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:14.401012 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e748db-b148-4f84-948e-2e040a9d0cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:14.410011 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e748db-b148-4f84-948e-2e040a9d0cfd admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:14.433354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1197/2399] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:32:14.434598 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc269d-203d-42e3-80f0-80778b667066 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:14.448962 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc269d-203d-42e3-80f0-80778b667066 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:14.463788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72502f70-30e4-4b58-851e-6c6efacf3a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:14.464498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72502f70-30e4-4b58-851e-6c6efacf3a1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:14.464790 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72502f70-30e4-4b58-851e-6c6efacf3a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:14.465093 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72502f70-30e4-4b58-851e-6c6efacf3a1a admin admin] PATH_INFO: `/v3/projects/0c325b7917544c9287d6961348b65137/users/f7bc2e536513466aa54ec6cb78401b99/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:14.509179 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72502f70-30e4-4b58-851e-6c6efacf3a1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c325b7917544c9287d6961348b65137, user_id=f7bc2e536513466aa54ec6cb78401b99, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:14.517496 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72502f70-30e4-4b58-851e-6c6efacf3a1a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:14.549609 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1203/2400] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:32:14 2022] PUT /identity/v3/projects/0c325b7917544c9287d6961348b65137/users/f7bc2e536513466aa54ec6cb78401b99/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:32:14.560145 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fb0e4-0dfe-46f4-b68b-8feb06cc68a7 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:14.561038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fb0e4-0dfe-46f4-b68b-8feb06cc68a7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:14.561449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fb0e4-0dfe-46f4-b68b-8feb06cc68a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:14.631873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-053fb0e4-0dfe-46f4-b68b-8feb06cc68a7 None None] MFA Rules not processed for user `f7bc2e536513466aa54ec6cb78401b99`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:14.639902 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-053fb0e4-0dfe-46f4-b68b-8feb06cc68a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:14.684137 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:32:14.777411 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1198/2401] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:32:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:32:14.789114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72502f70-30e4-4b58-851e-6c6efacf3a1a admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:14.790242 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-72502f70-30e4-4b58-851e-6c6efacf3a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:14.847670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:32:14.884254 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72502f70-30e4-4b58-851e-6c6efacf3a1a admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:14.889426 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff009e-763d-4828-a64b-709480c1b40b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:14.890954 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff009e-763d-4828-a64b-709480c1b40b service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:14.891303 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff009e-763d-4828-a64b-709480c1b40b service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:14.891683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff009e-763d-4828-a64b-709480c1b40b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:14.903286 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff009e-763d-4828-a64b-709480c1b40b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:14.905180 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff009e-763d-4828-a64b-709480c1b40b service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:14.918649 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1204/2402] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:32:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:32:16.763574 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365de4cd-30b9-47df-9453-0be0b8d45e0d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:16.764218 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365de4cd-30b9-47df-9453-0be0b8d45e0d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:16.764392 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365de4cd-30b9-47df-9453-0be0b8d45e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:16.785394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-365de4cd-30b9-47df-9453-0be0b8d45e0d None None] MFA Rules not processed for user `f7bc2e536513466aa54ec6cb78401b99`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:16.787067 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-365de4cd-30b9-47df-9453-0be0b8d45e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:16.795570 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1199/2403] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:32:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:32:24.913737 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=10 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:32:26.780382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=22 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:32:31.886423 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f37a9-41a0-4482-9e77-4d7d3a282468 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:31.886950 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f37a9-41a0-4482-9e77-4d7d3a282468 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:31.887041 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f37a9-41a0-4482-9e77-4d7d3a282468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:31.906451 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-f32f37a9-41a0-4482-9e77-4d7d3a282468 None None] MFA Rules not processed for user `07041df2276d4dd58fb0e49417a26e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:31.907695 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f32f37a9-41a0-4482-9e77-4d7d3a282468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:31.962184 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1205/2404] 10.222.0.16 () {58 vars in 967 bytes} [Tue Aug 9 02:32:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:32:31.975925 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365de4cd-30b9-47df-9453-0be0b8d45e0d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:31.977928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-365de4cd-30b9-47df-9453-0be0b8d45e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:32.048970 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365de4cd-30b9-47df-9453-0be0b8d45e0d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:32.053936 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca40871-d0ff-4e19-9e51-f6380c1aec6b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9151f210d29542dcb41ea3bc03390350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:32.054538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca40871-d0ff-4e19-9e51-f6380c1aec6b service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:32.054815 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca40871-d0ff-4e19-9e51-f6380c1aec6b service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:32.055082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca40871-d0ff-4e19-9e51-f6380c1aec6b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:32.062943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca40871-d0ff-4e19-9e51-f6380c1aec6b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:32.065212 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca40871-d0ff-4e19-9e51-f6380c1aec6b service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:32.073468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1200/2405] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 9 02:32:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 02:32:34.140789 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f37a9-41a0-4482-9e77-4d7d3a282468 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:34.142328 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f32f37a9-41a0-4482-9e77-4d7d3a282468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:34.209110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f37a9-41a0-4482-9e77-4d7d3a282468 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:34.213635 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40545b-0f57-404c-9ac8-46796b4b1adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:34.214243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40545b-0f57-404c-9ac8-46796b4b1adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:34.214527 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40545b-0f57-404c-9ac8-46796b4b1adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:34.214799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40545b-0f57-404c-9ac8-46796b4b1adc admin admin] PATH_INFO: `/v3/users/9add5093067e4da990785354f686d7f2` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:34.215932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40545b-0f57-404c-9ac8-46796b4b1adc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9add5093067e4da990785354f686d7f2)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:34.217885 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40545b-0f57-404c-9ac8-46796b4b1adc admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:34.268042 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-1a40545b-0f57-404c-9ac8-46796b4b1adc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9add5093067e4da990785354f686d7f2'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:34.276578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-1a40545b-0f57-404c-9ac8-46796b4b1adc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9add5093067e4da990785354f686d7f2'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:34.285063 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-1a40545b-0f57-404c-9ac8-46796b4b1adc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9add5093067e4da990785354f686d7f2'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:34.285717 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-1a40545b-0f57-404c-9ac8-46796b4b1adc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9add5093067e4da990785354f686d7f2'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:34.298735 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-1a40545b-0f57-404c-9ac8-46796b4b1adc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9add5093067e4da990785354f686d7f2'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:34.304625 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1206/2406] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:32:34 2022] DELETE /identity/v3/users/9add5093067e4da990785354f686d7f2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:32:34.484566 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca40871-d0ff-4e19-9e51-f6380c1aec6b service swift] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:34.505414 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca40871-d0ff-4e19-9e51-f6380c1aec6b service swift] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:34.569725 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cde460-cae3-4b3b-9b42-bdbe42ce55b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:34.570362 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cde460-cae3-4b3b-9b42-bdbe42ce55b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:34.570644 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cde460-cae3-4b3b-9b42-bdbe42ce55b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:34.570917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cde460-cae3-4b3b-9b42-bdbe42ce55b7 admin admin] PATH_INFO: `/v3/projects/f81d7160ee7748f7bc3a5f151591d6c4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:34.572054 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cde460-cae3-4b3b-9b42-bdbe42ce55b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f81d7160ee7748f7bc3a5f151591d6c4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:34.573987 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cde460-cae3-4b3b-9b42-bdbe42ce55b7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:34.619718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-87cde460-cae3-4b3b-9b42-bdbe42ce55b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f81d7160ee7748f7bc3a5f151591d6c4', 'request_id': 'req-87cde460-cae3-4b3b-9b42-bdbe42ce55b7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:34.625461 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-87cde460-cae3-4b3b-9b42-bdbe42ce55b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f81d7160ee7748f7bc3a5f151591d6c4', 'request_id': 'req-87cde460-cae3-4b3b-9b42-bdbe42ce55b7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:34.631938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-87cde460-cae3-4b3b-9b42-bdbe42ce55b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f81d7160ee7748f7bc3a5f151591d6c4', 'request_id': 'req-87cde460-cae3-4b3b-9b42-bdbe42ce55b7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:34.643975 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-87cde460-cae3-4b3b-9b42-bdbe42ce55b7 admin admin] The token cache is being invalidate because project f81d7160ee7748f7bc3a5f151591d6c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:32:34.644267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-87cde460-cae3-4b3b-9b42-bdbe42ce55b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:34.644887 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-87cde460-cae3-4b3b-9b42-bdbe42ce55b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:34.646388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1201/2407] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:32:34 2022] DELETE /identity/v3/projects/f81d7160ee7748f7bc3a5f151591d6c4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:32:34.651380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a7f26-e020-4786-a0ce-deb1ad4ad466 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:34.651695 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a7f26-e020-4786-a0ce-deb1ad4ad466 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:34.651975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a7f26-e020-4786-a0ce-deb1ad4ad466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:34.673251 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-714a7f26-e020-4786-a0ce-deb1ad4ad466 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:34.674468 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-714a7f26-e020-4786-a0ce-deb1ad4ad466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:34.692354 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:32:34.736154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1207/2408] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:32:34.743895 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f6ed3-fce1-4738-b38e-cae1e31b42c8 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:34.744175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f6ed3-fce1-4738-b38e-cae1e31b42c8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:34.744445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f6ed3-fce1-4738-b38e-cae1e31b42c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:34.763284 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f45f6ed3-fce1-4738-b38e-cae1e31b42c8 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:34.764472 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f45f6ed3-fce1-4738-b38e-cae1e31b42c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:34.772148 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1202/2409] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:32:34.776319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a7f26-e020-4786-a0ce-deb1ad4ad466 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:34.786638 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a7f26-e020-4786-a0ce-deb1ad4ad466 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:34.791238 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada6d8c-f287-40f9-9690-7ba2565dfb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:34.791836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada6d8c-f287-40f9-9690-7ba2565dfb97 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:34.792119 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada6d8c-f287-40f9-9690-7ba2565dfb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:34.792395 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada6d8c-f287-40f9-9690-7ba2565dfb97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:34.793104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada6d8c-f287-40f9-9690-7ba2565dfb97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:32:34.793414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada6d8c-f287-40f9-9690-7ba2565dfb97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:34.795013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada6d8c-f287-40f9-9690-7ba2565dfb97 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:34.807032 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1208/2410] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:32:34.811502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f6ed3-fce1-4738-b38e-cae1e31b42c8 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:34.821266 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f6ed3-fce1-4738-b38e-cae1e31b42c8 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:34.826099 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f42fb7-e2a3-423d-8774-952e632d67c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:34.826692 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f42fb7-e2a3-423d-8774-952e632d67c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:34.826972 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f42fb7-e2a3-423d-8774-952e632d67c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:34.827238 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f42fb7-e2a3-423d-8774-952e632d67c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:34.827855 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f42fb7-e2a3-423d-8774-952e632d67c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:34.830588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f42fb7-e2a3-423d-8774-952e632d67c8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:34.841666 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:32:34.858752 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1203/2411] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:32:34 2022] POST /identity/v3/projects => generated 395 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:32:34.864785 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada6d8c-f287-40f9-9690-7ba2565dfb97 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:34.874915 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada6d8c-f287-40f9-9690-7ba2565dfb97 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:34.935338 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6131a5-ba71-4bc9-8b72-f524bb59eb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:34.935978 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6131a5-ba71-4bc9-8b72-f524bb59eb94 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:34.936268 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6131a5-ba71-4bc9-8b72-f524bb59eb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:34.936538 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6131a5-ba71-4bc9-8b72-f524bb59eb94 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:34.937218 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6131a5-ba71-4bc9-8b72-f524bb59eb94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:34.939942 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6131a5-ba71-4bc9-8b72-f524bb59eb94 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:34.963229 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1209/2412] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:32:34 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:32:34.967831 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f42fb7-e2a3-423d-8774-952e632d67c8 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:34.982014 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f42fb7-e2a3-423d-8774-952e632d67c8 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:34.988037 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6924df3-9c21-422e-9365-37e0c01c6bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:34.988710 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6924df3-9c21-422e-9365-37e0c01c6bad admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:34.988998 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6924df3-9c21-422e-9365-37e0c01c6bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:34.989302 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6924df3-9c21-422e-9365-37e0c01c6bad admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:34.989951 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6924df3-9c21-422e-9365-37e0c01c6bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:34.991561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6924df3-9c21-422e-9365-37e0c01c6bad admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:35.004168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1204/2413] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:32:35.008709 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6131a5-ba71-4bc9-8b72-f524bb59eb94 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:35.019504 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6131a5-ba71-4bc9-8b72-f524bb59eb94 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:35.024281 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27698a3-fdbb-4e7d-9c53-5294584175ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:35.024969 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27698a3-fdbb-4e7d-9c53-5294584175ea admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:35.025296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27698a3-fdbb-4e7d-9c53-5294584175ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:35.025572 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27698a3-fdbb-4e7d-9c53-5294584175ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:35.026227 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27698a3-fdbb-4e7d-9c53-5294584175ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:35.027859 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27698a3-fdbb-4e7d-9c53-5294584175ea admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:35.038803 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1210/2414] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:32:35.042967 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6924df3-9c21-422e-9365-37e0c01c6bad admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:35.053695 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6924df3-9c21-422e-9365-37e0c01c6bad admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:35.060033 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a3f2a-fb27-43ee-a10c-21731f160fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:35.060730 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a3f2a-fb27-43ee-a10c-21731f160fd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:35.061014 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a3f2a-fb27-43ee-a10c-21731f160fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:35.061295 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a3f2a-fb27-43ee-a10c-21731f160fd0 admin admin] PATH_INFO: `/v3/projects/e9d302fff73645d1b3ac39654a4e6f98/users/fb6131299a8f49ff98ff10efcafc50df/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:35.080655 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a3f2a-fb27-43ee-a10c-21731f160fd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d302fff73645d1b3ac39654a4e6f98, user_id=fb6131299a8f49ff98ff10efcafc50df, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:35.085287 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a3f2a-fb27-43ee-a10c-21731f160fd0 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:35.136668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1205/2415] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:32:35 2022] PUT /identity/v3/projects/e9d302fff73645d1b3ac39654a4e6f98/users/fb6131299a8f49ff98ff10efcafc50df/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:32:35.140378 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fa664-3319-4304-a358-6929a091d93a None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:35.140669 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fa664-3319-4304-a358-6929a091d93a None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:35.140943 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fa664-3319-4304-a358-6929a091d93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:35.177555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-b00fa664-3319-4304-a358-6929a091d93a None None] MFA Rules not processed for user `fb6131299a8f49ff98ff10efcafc50df`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:35.178886 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b00fa664-3319-4304-a358-6929a091d93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:35.263242 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1211/2416] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:32:35 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:32:35.275028 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a3f2a-fb27-43ee-a10c-21731f160fd0 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:35.276771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bd8a3f2a-fb27-43ee-a10c-21731f160fd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:35.342279 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a3f2a-fb27-43ee-a10c-21731f160fd0 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:35.347451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3079a2-6266-400c-921b-f0a980fddf28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:35.349065 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3079a2-6266-400c-921b-f0a980fddf28 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:35.349065 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3079a2-6266-400c-921b-f0a980fddf28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:35.350800 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3079a2-6266-400c-921b-f0a980fddf28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:35.361729 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3079a2-6266-400c-921b-f0a980fddf28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:35.365191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3079a2-6266-400c-921b-f0a980fddf28 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:35.377270 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1206/2417] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:32:35 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:32:41.621963 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fa664-3319-4304-a358-6929a091d93a None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:41.644061 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:32:41.691819 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fa664-3319-4304-a358-6929a091d93a None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:41.697223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675d0e9-a24a-4a21-9b17-75d2283ab66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:41.698003 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675d0e9-a24a-4a21-9b17-75d2283ab66e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:41.698337 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675d0e9-a24a-4a21-9b17-75d2283ab66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:41.698658 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675d0e9-a24a-4a21-9b17-75d2283ab66e admin admin] PATH_INFO: `/v3/users/fb6131299a8f49ff98ff10efcafc50df` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:41.700017 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675d0e9-a24a-4a21-9b17-75d2283ab66e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb6131299a8f49ff98ff10efcafc50df)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:41.702180 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675d0e9-a24a-4a21-9b17-75d2283ab66e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:41.748830 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c675d0e9-a24a-4a21-9b17-75d2283ab66e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb6131299a8f49ff98ff10efcafc50df'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:41.756329 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c675d0e9-a24a-4a21-9b17-75d2283ab66e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb6131299a8f49ff98ff10efcafc50df'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:41.763730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c675d0e9-a24a-4a21-9b17-75d2283ab66e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb6131299a8f49ff98ff10efcafc50df'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:41.764372 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c675d0e9-a24a-4a21-9b17-75d2283ab66e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb6131299a8f49ff98ff10efcafc50df'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:41.777146 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-c675d0e9-a24a-4a21-9b17-75d2283ab66e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb6131299a8f49ff98ff10efcafc50df'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:41.783713 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1212/2418] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:32:41 2022] DELETE /identity/v3/users/fb6131299a8f49ff98ff10efcafc50df => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:32:41.788288 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765de8fc-ac56-440a-b8a5-f0d007c991a5 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:41.788815 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765de8fc-ac56-440a-b8a5-f0d007c991a5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:41.788911 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765de8fc-ac56-440a-b8a5-f0d007c991a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:41.810977 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-765de8fc-ac56-440a-b8a5-f0d007c991a5 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:41.812200 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-765de8fc-ac56-440a-b8a5-f0d007c991a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:41.870363 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1207/2419] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:32:41.880569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675d0e9-a24a-4a21-9b17-75d2283ab66e admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:41.882027 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c675d0e9-a24a-4a21-9b17-75d2283ab66e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:41.942092 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675d0e9-a24a-4a21-9b17-75d2283ab66e admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:41.945954 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06c238-37ff-42ec-8dcd-5493da066692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:41.946734 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06c238-37ff-42ec-8dcd-5493da066692 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:41.946930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06c238-37ff-42ec-8dcd-5493da066692 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:41.947208 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06c238-37ff-42ec-8dcd-5493da066692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:41.956993 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06c238-37ff-42ec-8dcd-5493da066692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:41.958466 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06c238-37ff-42ec-8dcd-5493da066692 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:41.975976 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1213/2420] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:32:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:32:42.449688 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765de8fc-ac56-440a-b8a5-f0d007c991a5 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:42.458112 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-765de8fc-ac56-440a-b8a5-f0d007c991a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:42.486374 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765de8fc-ac56-440a-b8a5-f0d007c991a5 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:42.502046 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712eb8a2-6dd1-4b29-a0f6-4f0c98c44bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:42.504287 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712eb8a2-6dd1-4b29-a0f6-4f0c98c44bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:42.506321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712eb8a2-6dd1-4b29-a0f6-4f0c98c44bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:42.506656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712eb8a2-6dd1-4b29-a0f6-4f0c98c44bbb admin admin] PATH_INFO: `/v3/projects/e9d302fff73645d1b3ac39654a4e6f98` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:42.508069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712eb8a2-6dd1-4b29-a0f6-4f0c98c44bbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9d302fff73645d1b3ac39654a4e6f98)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:42.513968 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712eb8a2-6dd1-4b29-a0f6-4f0c98c44bbb admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:42.522207 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77780b-8483-438b-981f-6b09328b3951 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:42.522487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77780b-8483-438b-981f-6b09328b3951 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:42.523361 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77780b-8483-438b-981f-6b09328b3951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:42.561447 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-fc77780b-8483-438b-981f-6b09328b3951 None None] MFA Rules not processed for user `07041df2276d4dd58fb0e49417a26e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:42.562831 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-fc77780b-8483-438b-981f-6b09328b3951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:42.579320 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-712eb8a2-6dd1-4b29-a0f6-4f0c98c44bbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9d302fff73645d1b3ac39654a4e6f98', 'request_id': 'req-712eb8a2-6dd1-4b29-a0f6-4f0c98c44bbb'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:42.584715 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:32:42.588917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-712eb8a2-6dd1-4b29-a0f6-4f0c98c44bbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9d302fff73645d1b3ac39654a4e6f98', 'request_id': 'req-712eb8a2-6dd1-4b29-a0f6-4f0c98c44bbb'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:42.598440 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-712eb8a2-6dd1-4b29-a0f6-4f0c98c44bbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9d302fff73645d1b3ac39654a4e6f98', 'request_id': 'req-712eb8a2-6dd1-4b29-a0f6-4f0c98c44bbb'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:42.611827 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:32:42.614362 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-712eb8a2-6dd1-4b29-a0f6-4f0c98c44bbb admin admin] The token cache is being invalidate because project e9d302fff73645d1b3ac39654a4e6f98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:32:42.614873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-712eb8a2-6dd1-4b29-a0f6-4f0c98c44bbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:42.615668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-712eb8a2-6dd1-4b29-a0f6-4f0c98c44bbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:42.617362 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1208/2421] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:32:42 2022] DELETE /identity/v3/projects/e9d302fff73645d1b3ac39654a4e6f98 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:32:42.623758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76170f3d-21a7-4edd-a081-2220fbdeaaf4 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:42.624047 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76170f3d-21a7-4edd-a081-2220fbdeaaf4 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:42.624373 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76170f3d-21a7-4edd-a081-2220fbdeaaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:42.636538 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1214/2422] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 9 02:32:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:32:42.646526 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-76170f3d-21a7-4edd-a081-2220fbdeaaf4 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:42.647511 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-76170f3d-21a7-4edd-a081-2220fbdeaaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:42.651832 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77780b-8483-438b-981f-6b09328b3951 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:42.654436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-fc77780b-8483-438b-981f-6b09328b3951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:42.729289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1209/2423] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:32:42.736897 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313a5d3-0f60-42cd-8ee3-dda4c750b05e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:42.737216 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313a5d3-0f60-42cd-8ee3-dda4c750b05e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:42.738041 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313a5d3-0f60-42cd-8ee3-dda4c750b05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:42.756491 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77780b-8483-438b-981f-6b09328b3951 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:42.761521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-0313a5d3-0f60-42cd-8ee3-dda4c750b05e None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:42.762853 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0313a5d3-0f60-42cd-8ee3-dda4c750b05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:42.764673 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752cfc4-d719-44d3-bba8-f526d91ee426 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9151f210d29542dcb41ea3bc03390350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:42.765643 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752cfc4-d719-44d3-bba8-f526d91ee426 service swift] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:42.766616 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752cfc4-d719-44d3-bba8-f526d91ee426 service swift] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:42.766894 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752cfc4-d719-44d3-bba8-f526d91ee426 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:42.787038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1210/2424] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:32:42.788024 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313a5d3-0f60-42cd-8ee3-dda4c750b05e None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:42.789563 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752cfc4-d719-44d3-bba8-f526d91ee426 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:42.792302 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752cfc4-d719-44d3-bba8-f526d91ee426 service swift] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:42.799338 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313a5d3-0f60-42cd-8ee3-dda4c750b05e None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:42.805611 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a6ae4-24fc-46a4-9cbd-e6f04e55bd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:42.806229 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a6ae4-24fc-46a4-9cbd-e6f04e55bd4c admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:42.806538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a6ae4-24fc-46a4-9cbd-e6f04e55bd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:42.806867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1215/2425] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 9 02:32:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 09 02:32:42.806995 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a6ae4-24fc-46a4-9cbd-e6f04e55bd4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:42.815025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a6ae4-24fc-46a4-9cbd-e6f04e55bd4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:32:42.815574 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a6ae4-24fc-46a4-9cbd-e6f04e55bd4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:42.817674 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a6ae4-24fc-46a4-9cbd-e6f04e55bd4c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:42.831515 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1211/2426] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:32:42.835936 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752cfc4-d719-44d3-bba8-f526d91ee426 service swift] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:42.870700 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752cfc4-d719-44d3-bba8-f526d91ee426 service swift] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:42.881005 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67e5c0-8a12-411c-95fa-91ff87dfd1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:42.883111 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67e5c0-8a12-411c-95fa-91ff87dfd1d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:42.885312 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67e5c0-8a12-411c-95fa-91ff87dfd1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:42.885828 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67e5c0-8a12-411c-95fa-91ff87dfd1d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:42.889824 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67e5c0-8a12-411c-95fa-91ff87dfd1d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:42.891885 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67e5c0-8a12-411c-95fa-91ff87dfd1d0 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:42.932490 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1216/2427] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:32:42 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:32:42.936675 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a6ae4-24fc-46a4-9cbd-e6f04e55bd4c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:42.952513 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a6ae4-24fc-46a4-9cbd-e6f04e55bd4c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:43.045978 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a5c92-96a6-4fc8-8920-683b04bfcc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:43.047228 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a5c92-96a6-4fc8-8920-683b04bfcc64 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:43.048315 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a5c92-96a6-4fc8-8920-683b04bfcc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:43.048614 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a5c92-96a6-4fc8-8920-683b04bfcc64 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:43.049284 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a5c92-96a6-4fc8-8920-683b04bfcc64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:43.051935 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a5c92-96a6-4fc8-8920-683b04bfcc64 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:43.077492 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1212/2428] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:32:42 2022] POST /identity/v3/users => generated 292 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:32:43.093047 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67e5c0-8a12-411c-95fa-91ff87dfd1d0 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:43.105557 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67e5c0-8a12-411c-95fa-91ff87dfd1d0 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:43.110800 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3cf0d7-96da-436f-929d-87e650b403f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:43.111436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3cf0d7-96da-436f-929d-87e650b403f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:43.111743 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3cf0d7-96da-436f-929d-87e650b403f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:43.112014 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3cf0d7-96da-436f-929d-87e650b403f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:43.112663 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3cf0d7-96da-436f-929d-87e650b403f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:43.114317 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3cf0d7-96da-436f-929d-87e650b403f2 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:43.138721 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1217/2429] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:32:43.138870 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a5c92-96a6-4fc8-8920-683b04bfcc64 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:43.149347 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a5c92-96a6-4fc8-8920-683b04bfcc64 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:43.155038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febe554-7cb1-400a-9582-9a68c9ca390d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:43.155732 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febe554-7cb1-400a-9582-9a68c9ca390d admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:43.156082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febe554-7cb1-400a-9582-9a68c9ca390d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:43.156399 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febe554-7cb1-400a-9582-9a68c9ca390d admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:43.157173 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febe554-7cb1-400a-9582-9a68c9ca390d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:43.159049 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febe554-7cb1-400a-9582-9a68c9ca390d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:43.172410 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1213/2430] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:32:43.179085 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3cf0d7-96da-436f-929d-87e650b403f2 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:43.190227 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3cf0d7-96da-436f-929d-87e650b403f2 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:43.195545 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb3bb3-427e-40d0-89bd-56b251d6c325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:43.196188 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb3bb3-427e-40d0-89bd-56b251d6c325 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:43.196556 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb3bb3-427e-40d0-89bd-56b251d6c325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:43.196904 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb3bb3-427e-40d0-89bd-56b251d6c325 admin admin] PATH_INFO: `/v3/projects/4bcb9413e4f6464e9246059a2e344021/users/6ea01a2d415c48918e67eb9ea9369b81/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:43.345145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb3bb3-427e-40d0-89bd-56b251d6c325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bcb9413e4f6464e9246059a2e344021, user_id=6ea01a2d415c48918e67eb9ea9369b81, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:43.347798 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb3bb3-427e-40d0-89bd-56b251d6c325 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:43.368172 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1218/2431] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:32:43 2022] PUT /identity/v3/projects/4bcb9413e4f6464e9246059a2e344021/users/6ea01a2d415c48918e67eb9ea9369b81/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:32:43.372958 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfef9c-1be9-4004-a26b-0ddf5141ccbb None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:43.373716 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfef9c-1be9-4004-a26b-0ddf5141ccbb None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:43.374194 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfef9c-1be9-4004-a26b-0ddf5141ccbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:43.403177 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-16bfef9c-1be9-4004-a26b-0ddf5141ccbb None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:43.404288 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-16bfef9c-1be9-4004-a26b-0ddf5141ccbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:43.464364 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:32:43.497229 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1214/2432] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:32:43.507321 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb3bb3-427e-40d0-89bd-56b251d6c325 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:43.509600 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a8eb3bb3-427e-40d0-89bd-56b251d6c325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:43.540489 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b8001-1fbb-48ee-bf02-747a039fc12d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:43.540780 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b8001-1fbb-48ee-bf02-747a039fc12d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:43.541104 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b8001-1fbb-48ee-bf02-747a039fc12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:43.563214 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-d69b8001-1fbb-48ee-bf02-747a039fc12d None None] MFA Rules not processed for user `07041df2276d4dd58fb0e49417a26e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:43.564439 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-d69b8001-1fbb-48ee-bf02-747a039fc12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:43.597547 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb3bb3-427e-40d0-89bd-56b251d6c325 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:43.603675 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245f2f9-88db-463f-9c6d-d8988942b67f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:43.604298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245f2f9-88db-463f-9c6d-d8988942b67f service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:43.604812 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245f2f9-88db-463f-9c6d-d8988942b67f service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:43.605388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245f2f9-88db-463f-9c6d-d8988942b67f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:43.618306 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245f2f9-88db-463f-9c6d-d8988942b67f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:43.619955 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245f2f9-88db-463f-9c6d-d8988942b67f service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:43.631761 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1219/2433] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:32:43.632599 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245f2f9-88db-463f-9c6d-d8988942b67f service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:43.633977 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1245f2f9-88db-463f-9c6d-d8988942b67f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:43.645989 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1215/2434] 10.222.0.16 () {58 vars in 967 bytes} [Tue Aug 9 02:32:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:32:43.647621 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245f2f9-88db-463f-9c6d-d8988942b67f service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:43.654387 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4b76e-971f-48c4-ab0e-76ef2b99f328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:43.655049 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4b76e-971f-48c4-ab0e-76ef2b99f328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:43.657113 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b8001-1fbb-48ee-bf02-747a039fc12d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:43.657314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4b76e-971f-48c4-ab0e-76ef2b99f328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:43.657763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4b76e-971f-48c4-ab0e-76ef2b99f328 admin admin] PATH_INFO: `/v3/users/780952cbd0e04754bb2faf17e9f83362` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:43.659625 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb4b76e-971f-48c4-ab0e-76ef2b99f328 admin admin] RBAC: Authorizing `identity:delete_user(user_id=780952cbd0e04754bb2faf17e9f83362)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:43.662165 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb4b76e-971f-48c4-ab0e-76ef2b99f328 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:43.689293 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:32:43.749573 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-5cb4b76e-971f-48c4-ab0e-76ef2b99f328 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '780952cbd0e04754bb2faf17e9f83362'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:43.758880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-5cb4b76e-971f-48c4-ab0e-76ef2b99f328 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '780952cbd0e04754bb2faf17e9f83362'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:43.769933 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-5cb4b76e-971f-48c4-ab0e-76ef2b99f328 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '780952cbd0e04754bb2faf17e9f83362'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:43.778936 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-5cb4b76e-971f-48c4-ab0e-76ef2b99f328 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '780952cbd0e04754bb2faf17e9f83362'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:43.783519 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b8001-1fbb-48ee-bf02-747a039fc12d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:43.790020 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec791b4-0306-4b2f-9460-2df35e47a362 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9151f210d29542dcb41ea3bc03390350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:43.790883 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec791b4-0306-4b2f-9460-2df35e47a362 service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:43.791326 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec791b4-0306-4b2f-9460-2df35e47a362 service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:43.791668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec791b4-0306-4b2f-9460-2df35e47a362 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:43.794264 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fec791b4-0306-4b2f-9460-2df35e47a362 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:43.803481 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-5cb4b76e-971f-48c4-ab0e-76ef2b99f328 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '780952cbd0e04754bb2faf17e9f83362'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:43.808634 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec791b4-0306-4b2f-9460-2df35e47a362 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:43.810715 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1220/2435] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:32:43 2022] DELETE /identity/v3/users/780952cbd0e04754bb2faf17e9f83362 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:32:43.810882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec791b4-0306-4b2f-9460-2df35e47a362 service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:43.815888 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b723f05-5c1f-4cfc-9905-0121af4294ba None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:43.816172 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b723f05-5c1f-4cfc-9905-0121af4294ba None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:43.816732 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b723f05-5c1f-4cfc-9905-0121af4294ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:43.830830 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1216/2436] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 9 02:32:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 02:32:43.847009 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-8b723f05-5c1f-4cfc-9905-0121af4294ba None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:43.848584 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8b723f05-5c1f-4cfc-9905-0121af4294ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:43.959412 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1221/2437] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:32:43.970045 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec791b4-0306-4b2f-9460-2df35e47a362 service swift] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:43.971530 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fec791b4-0306-4b2f-9460-2df35e47a362 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:43.984684 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec791b4-0306-4b2f-9460-2df35e47a362 service swift] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:44.048560 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc1442-37dd-4c32-bd6e-b148a430f756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:44.049389 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc1442-37dd-4c32-bd6e-b148a430f756 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:44.049753 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc1442-37dd-4c32-bd6e-b148a430f756 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:44.050072 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc1442-37dd-4c32-bd6e-b148a430f756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:44.064302 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc1442-37dd-4c32-bd6e-b148a430f756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:44.065806 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc1442-37dd-4c32-bd6e-b148a430f756 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:44.077014 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1217/2438] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:32:44.174002 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd64ba-a0de-4439-88e0-5b6f033bbe5b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:44.174367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd64ba-a0de-4439-88e0-5b6f033bbe5b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:44.174900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd64ba-a0de-4439-88e0-5b6f033bbe5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:44.198626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-dffd64ba-a0de-4439-88e0-5b6f033bbe5b None None] MFA Rules not processed for user `07041df2276d4dd58fb0e49417a26e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:44.199585 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-dffd64ba-a0de-4439-88e0-5b6f033bbe5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:44.267917 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1222/2439] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 9 02:32:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:32:44.280887 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc1442-37dd-4c32-bd6e-b148a430f756 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:44.282777 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-72fc1442-37dd-4c32-bd6e-b148a430f756 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:44.307190 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:32:44.357325 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc1442-37dd-4c32-bd6e-b148a430f756 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:44.362301 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b1826-3b7b-4f71-8f07-c72ee1e8a9d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9151f210d29542dcb41ea3bc03390350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:44.362907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b1826-3b7b-4f71-8f07-c72ee1e8a9d2 service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:44.363183 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b1826-3b7b-4f71-8f07-c72ee1e8a9d2 service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:44.363451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b1826-3b7b-4f71-8f07-c72ee1e8a9d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:44.371862 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b1826-3b7b-4f71-8f07-c72ee1e8a9d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:44.373481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b1826-3b7b-4f71-8f07-c72ee1e8a9d2 service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:44.382102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1218/2440] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 9 02:32:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 02:32:44.764001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172318b0-8dae-4400-ae8d-5977737921f3 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:44.764813 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172318b0-8dae-4400-ae8d-5977737921f3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:44.765120 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172318b0-8dae-4400-ae8d-5977737921f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:44.796307 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-172318b0-8dae-4400-ae8d-5977737921f3 None None] MFA Rules not processed for user `07041df2276d4dd58fb0e49417a26e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:44.798124 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-172318b0-8dae-4400-ae8d-5977737921f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:44.806326 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1223/2441] 10.222.0.16 () {58 vars in 967 bytes} [Tue Aug 9 02:32:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:32:44.825596 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b1826-3b7b-4f71-8f07-c72ee1e8a9d2 service swift] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:44.845971 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b1826-3b7b-4f71-8f07-c72ee1e8a9d2 service swift] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:44.853719 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893c512-47b0-4e62-b7bc-5936f9519a54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9151f210d29542dcb41ea3bc03390350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:44.854359 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893c512-47b0-4e62-b7bc-5936f9519a54 service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:44.854772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893c512-47b0-4e62-b7bc-5936f9519a54 service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:44.855482 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893c512-47b0-4e62-b7bc-5936f9519a54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:44.873989 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893c512-47b0-4e62-b7bc-5936f9519a54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:44.876221 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893c512-47b0-4e62-b7bc-5936f9519a54 service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:44.891503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1219/2442] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 9 02:32:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 02:32:44.931179 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172318b0-8dae-4400-ae8d-5977737921f3 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:44.932945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-172318b0-8dae-4400-ae8d-5977737921f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:44.952094 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172318b0-8dae-4400-ae8d-5977737921f3 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:44.957972 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6a87d-59d7-4937-82ed-742f244e38f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:44.959219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6a87d-59d7-4937-82ed-742f244e38f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:44.959787 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6a87d-59d7-4937-82ed-742f244e38f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:44.960353 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6a87d-59d7-4937-82ed-742f244e38f9 admin admin] PATH_INFO: `/v3/projects/daf0834d7f4e4b02a690d8a038cb9e0b` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:44.961825 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6a87d-59d7-4937-82ed-742f244e38f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daf0834d7f4e4b02a690d8a038cb9e0b)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:44.964201 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6a87d-59d7-4937-82ed-742f244e38f9 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:45.033865 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:32:45.063789 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-35a6a87d-59d7-4937-82ed-742f244e38f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daf0834d7f4e4b02a690d8a038cb9e0b', 'request_id': 'req-35a6a87d-59d7-4937-82ed-742f244e38f9'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:45.075991 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-35a6a87d-59d7-4937-82ed-742f244e38f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daf0834d7f4e4b02a690d8a038cb9e0b', 'request_id': 'req-35a6a87d-59d7-4937-82ed-742f244e38f9'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:45.085766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-35a6a87d-59d7-4937-82ed-742f244e38f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daf0834d7f4e4b02a690d8a038cb9e0b', 'request_id': 'req-35a6a87d-59d7-4937-82ed-742f244e38f9'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:45.107832 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-35a6a87d-59d7-4937-82ed-742f244e38f9 admin admin] The token cache is being invalidate because project daf0834d7f4e4b02a690d8a038cb9e0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:32:45.108110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-35a6a87d-59d7-4937-82ed-742f244e38f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:45.108872 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-35a6a87d-59d7-4937-82ed-742f244e38f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:45.111541 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1224/2443] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:32:44 2022] DELETE /identity/v3/projects/daf0834d7f4e4b02a690d8a038cb9e0b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:32:45.116756 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fc326-6d0d-4942-9cfd-444bbaa2a983 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:45.117074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fc326-6d0d-4942-9cfd-444bbaa2a983 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:45.117389 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fc326-6d0d-4942-9cfd-444bbaa2a983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:45.144168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ae1fc326-6d0d-4942-9cfd-444bbaa2a983 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:45.145840 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ae1fc326-6d0d-4942-9cfd-444bbaa2a983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:45.249969 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1220/2444] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:32:45.253953 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b111a87-b9e3-4a0f-8012-096edf22d3df None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:45.254239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b111a87-b9e3-4a0f-8012-096edf22d3df None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:45.254509 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b111a87-b9e3-4a0f-8012-096edf22d3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:45.290845 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-3b111a87-b9e3-4a0f-8012-096edf22d3df None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:45.292073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3b111a87-b9e3-4a0f-8012-096edf22d3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:45.323278 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1225/2445] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:32:45.327754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fc326-6d0d-4942-9cfd-444bbaa2a983 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:45.353744 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fc326-6d0d-4942-9cfd-444bbaa2a983 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:45.359230 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e205d-f094-4bd7-91bf-9abfc6937f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:45.360123 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e205d-f094-4bd7-91bf-9abfc6937f88 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:45.360123 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e205d-f094-4bd7-91bf-9abfc6937f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:45.360424 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e205d-f094-4bd7-91bf-9abfc6937f88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:45.361052 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e205d-f094-4bd7-91bf-9abfc6937f88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:32:45.361381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e205d-f094-4bd7-91bf-9abfc6937f88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:45.363071 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e205d-f094-4bd7-91bf-9abfc6937f88 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:45.376514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1221/2446] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:32:45.380769 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b111a87-b9e3-4a0f-8012-096edf22d3df None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:45.392775 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b111a87-b9e3-4a0f-8012-096edf22d3df None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:45.398217 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47baa6c-d7a7-4908-905a-63b00b4a1498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:45.398992 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47baa6c-d7a7-4908-905a-63b00b4a1498 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:45.399109 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47baa6c-d7a7-4908-905a-63b00b4a1498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:45.399378 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47baa6c-d7a7-4908-905a-63b00b4a1498 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:45.400227 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47baa6c-d7a7-4908-905a-63b00b4a1498 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:45.402327 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47baa6c-d7a7-4908-905a-63b00b4a1498 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:45.442416 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1226/2447] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:32:45 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:32:45.447630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e205d-f094-4bd7-91bf-9abfc6937f88 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:45.468405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e205d-f094-4bd7-91bf-9abfc6937f88 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:45.556494 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8b659-2fd1-4dff-9c02-2ae4ad57c32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:45.557137 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8b659-2fd1-4dff-9c02-2ae4ad57c32d admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:45.557417 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8b659-2fd1-4dff-9c02-2ae4ad57c32d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:45.558029 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8b659-2fd1-4dff-9c02-2ae4ad57c32d admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:45.558546 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8b659-2fd1-4dff-9c02-2ae4ad57c32d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:45.560466 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8b659-2fd1-4dff-9c02-2ae4ad57c32d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:45.585763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1222/2448] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:32:45 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:32:45.590001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47baa6c-d7a7-4908-905a-63b00b4a1498 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:45.602010 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47baa6c-d7a7-4908-905a-63b00b4a1498 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:45.607285 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d678e-e7eb-4a68-a9ea-9b37de219bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:45.607908 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d678e-e7eb-4a68-a9ea-9b37de219bdc admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:45.608187 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d678e-e7eb-4a68-a9ea-9b37de219bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:45.608456 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d678e-e7eb-4a68-a9ea-9b37de219bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:45.609417 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d678e-e7eb-4a68-a9ea-9b37de219bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:45.611031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d678e-e7eb-4a68-a9ea-9b37de219bdc admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:45.626135 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1227/2449] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:32:45.628008 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8b659-2fd1-4dff-9c02-2ae4ad57c32d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:45.639150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8b659-2fd1-4dff-9c02-2ae4ad57c32d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:45.645516 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c27cc-f8b6-451b-82ad-1eab99841107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:45.646388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c27cc-f8b6-451b-82ad-1eab99841107 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:45.646676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c27cc-f8b6-451b-82ad-1eab99841107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:45.647001 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c27cc-f8b6-451b-82ad-1eab99841107 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:45.647656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c27cc-f8b6-451b-82ad-1eab99841107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:45.649477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c27cc-f8b6-451b-82ad-1eab99841107 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:45.669205 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d678e-e7eb-4a68-a9ea-9b37de219bdc admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:45.679663 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d678e-e7eb-4a68-a9ea-9b37de219bdc admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:45.680338 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1223/2450] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:32:45.692278 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ae835-a2c9-4493-b9c0-cc0e6eee3f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:45.693057 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ae835-a2c9-4493-b9c0-cc0e6eee3f8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:45.693263 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ae835-a2c9-4493-b9c0-cc0e6eee3f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:45.693527 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ae835-a2c9-4493-b9c0-cc0e6eee3f8d admin admin] PATH_INFO: `/v3/projects/4a72e708c1e34f2fae15f070b3a6d0c7/users/e1f92dc439154a6cb037c8970c3e3a70/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:45.719571 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ae835-a2c9-4493-b9c0-cc0e6eee3f8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a72e708c1e34f2fae15f070b3a6d0c7, user_id=e1f92dc439154a6cb037c8970c3e3a70, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:45.723095 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ae835-a2c9-4493-b9c0-cc0e6eee3f8d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:45.741772 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1228/2451] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:32:45 2022] PUT /identity/v3/projects/4a72e708c1e34f2fae15f070b3a6d0c7/users/e1f92dc439154a6cb037c8970c3e3a70/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:32:45.747686 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb892b-6392-4b6b-a307-af37c816af6b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:45.747980 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb892b-6392-4b6b-a307-af37c816af6b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:45.748234 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb892b-6392-4b6b-a307-af37c816af6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:45.756411 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:32:45.770272 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a7bb892b-6392-4b6b-a307-af37c816af6b None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:45.772532 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a7bb892b-6392-4b6b-a307-af37c816af6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:45.854846 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1224/2452] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:32:45.865094 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ae835-a2c9-4493-b9c0-cc0e6eee3f8d admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:45.867213 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0d9ae835-a2c9-4493-b9c0-cc0e6eee3f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:46.037643 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ae835-a2c9-4493-b9c0-cc0e6eee3f8d admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:46.044069 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2127ef-cc6a-479e-9180-229ea0e8f872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:46.047477 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2127ef-cc6a-479e-9180-229ea0e8f872 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:46.047943 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2127ef-cc6a-479e-9180-229ea0e8f872 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:46.048847 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2127ef-cc6a-479e-9180-229ea0e8f872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:46.067526 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2127ef-cc6a-479e-9180-229ea0e8f872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:46.068988 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2127ef-cc6a-479e-9180-229ea0e8f872 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:46.088000 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1229/2453] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:32:47.549130 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a1ec2-d3fb-48ed-9873-86da5e784773 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:47.549635 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a1ec2-d3fb-48ed-9873-86da5e784773 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:47.549719 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a1ec2-d3fb-48ed-9873-86da5e784773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:47.560865 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2127ef-cc6a-479e-9180-229ea0e8f872 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:47.562832 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-fa2127ef-cc6a-479e-9180-229ea0e8f872 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:47.576013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2127ef-cc6a-479e-9180-229ea0e8f872 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:47.581806 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60695385-bbc9-4940-bdea-061f6f0fbf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:47.582863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60695385-bbc9-4940-bdea-061f6f0fbf8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:47.583300 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60695385-bbc9-4940-bdea-061f6f0fbf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:47.583579 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60695385-bbc9-4940-bdea-061f6f0fbf8b admin admin] PATH_INFO: `/v3/users/f7bc2e536513466aa54ec6cb78401b99` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:47.584908 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60695385-bbc9-4940-bdea-061f6f0fbf8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7bc2e536513466aa54ec6cb78401b99)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:47.585721 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-246a1ec2-d3fb-48ed-9873-86da5e784773 None None] MFA Rules not processed for user `e1f92dc439154a6cb037c8970c3e3a70`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:47.586948 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60695385-bbc9-4940-bdea-061f6f0fbf8b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:47.587309 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-246a1ec2-d3fb-48ed-9873-86da5e784773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:47.667928 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-60695385-bbc9-4940-bdea-061f6f0fbf8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7bc2e536513466aa54ec6cb78401b99'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:47.670333 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:32:47.679137 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-60695385-bbc9-4940-bdea-061f6f0fbf8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7bc2e536513466aa54ec6cb78401b99'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:47.691895 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-60695385-bbc9-4940-bdea-061f6f0fbf8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7bc2e536513466aa54ec6cb78401b99'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:47.693127 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-60695385-bbc9-4940-bdea-061f6f0fbf8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7bc2e536513466aa54ec6cb78401b99'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:47.704181 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1225/2454] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:32:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:32:47.716318 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a1ec2-d3fb-48ed-9873-86da5e784773 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:47.717840 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-246a1ec2-d3fb-48ed-9873-86da5e784773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:47.720620 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-60695385-bbc9-4940-bdea-061f6f0fbf8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7bc2e536513466aa54ec6cb78401b99'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:47.728260 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1230/2455] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:32:47 2022] DELETE /identity/v3/users/f7bc2e536513466aa54ec6cb78401b99 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:32:47.735133 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae53c33-9cc5-4357-a413-e123492e3e74 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:47.735742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae53c33-9cc5-4357-a413-e123492e3e74 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:47.736429 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae53c33-9cc5-4357-a413-e123492e3e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:47.776304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-4ae53c33-9cc5-4357-a413-e123492e3e74 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:47.778217 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4ae53c33-9cc5-4357-a413-e123492e3e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:47.800960 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a1ec2-d3fb-48ed-9873-86da5e784773 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:47.894191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:32:47.897682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1231/2456] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:32:47.901010 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e25fd-be6d-4b28-bbbb-d0f1db1d6931 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:47.901955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e25fd-be6d-4b28-bbbb-d0f1db1d6931 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:47.902303 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e25fd-be6d-4b28-bbbb-d0f1db1d6931 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:47.902652 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e25fd-be6d-4b28-bbbb-d0f1db1d6931 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:47.904595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-568e25fd-be6d-4b28-bbbb-d0f1db1d6931 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:47.907292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae53c33-9cc5-4357-a413-e123492e3e74 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:47.908923 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4ae53c33-9cc5-4357-a413-e123492e3e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:48.005243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae53c33-9cc5-4357-a413-e123492e3e74 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:48.009628 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b8c34-4ccf-451d-8b6b-d62680bbefc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:48.010253 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b8c34-4ccf-451d-8b6b-d62680bbefc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:48.010535 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b8c34-4ccf-451d-8b6b-d62680bbefc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:48.010913 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b8c34-4ccf-451d-8b6b-d62680bbefc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:48.014926 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e25fd-be6d-4b28-bbbb-d0f1db1d6931 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:48.017082 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e25fd-be6d-4b28-bbbb-d0f1db1d6931 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:48.022910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b8c34-4ccf-451d-8b6b-d62680bbefc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:48.024647 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b8c34-4ccf-451d-8b6b-d62680bbefc5 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:48.028033 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1226/2457] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:32:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:32:48.036323 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1232/2458] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:32:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:32:48.275779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e25fd-be6d-4b28-bbbb-d0f1db1d6931 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:48.277673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-568e25fd-be6d-4b28-bbbb-d0f1db1d6931 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:48.294122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e25fd-be6d-4b28-bbbb-d0f1db1d6931 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:48.300588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d98b3c2-62cf-4fce-8033-d3412b3f78f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:48.301276 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98b3c2-62cf-4fce-8033-d3412b3f78f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:48.301559 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98b3c2-62cf-4fce-8033-d3412b3f78f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:48.301834 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98b3c2-62cf-4fce-8033-d3412b3f78f9 admin admin] PATH_INFO: `/v3/projects/0c325b7917544c9287d6961348b65137` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:48.303284 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98b3c2-62cf-4fce-8033-d3412b3f78f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c325b7917544c9287d6961348b65137)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:48.305234 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d98b3c2-62cf-4fce-8033-d3412b3f78f9 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:48.412402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2d98b3c2-62cf-4fce-8033-d3412b3f78f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c325b7917544c9287d6961348b65137', 'request_id': 'req-2d98b3c2-62cf-4fce-8033-d3412b3f78f9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:48.441380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2d98b3c2-62cf-4fce-8033-d3412b3f78f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c325b7917544c9287d6961348b65137', 'request_id': 'req-2d98b3c2-62cf-4fce-8033-d3412b3f78f9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:48.464002 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2d98b3c2-62cf-4fce-8033-d3412b3f78f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c325b7917544c9287d6961348b65137', 'request_id': 'req-2d98b3c2-62cf-4fce-8033-d3412b3f78f9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:48.499535 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2d98b3c2-62cf-4fce-8033-d3412b3f78f9 admin admin] The token cache is being invalidate because project 0c325b7917544c9287d6961348b65137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:32:48.500365 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2d98b3c2-62cf-4fce-8033-d3412b3f78f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:48.501071 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2d98b3c2-62cf-4fce-8033-d3412b3f78f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:32:48.502728 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1227/2459] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:32:48 2022] DELETE /identity/v3/projects/0c325b7917544c9287d6961348b65137 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:32:49.619624 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c608b-55b6-4759-86e3-870a2f41d179 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:49.620185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c608b-55b6-4759-86e3-870a2f41d179 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:49.620300 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c608b-55b6-4759-86e3-870a2f41d179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:49.630814 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968d29a-aa94-459c-948d-19052b136032 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:49.631340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968d29a-aa94-459c-948d-19052b136032 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:49.631340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968d29a-aa94-459c-948d-19052b136032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:49.653191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9968d29a-aa94-459c-948d-19052b136032 None None] MFA Rules not processed for user `e1f92dc439154a6cb037c8970c3e3a70`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:49.654646 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9968d29a-aa94-459c-948d-19052b136032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:49.655270 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a32c608b-55b6-4759-86e3-870a2f41d179 None None] MFA Rules not processed for user `6ea01a2d415c48918e67eb9ea9369b81`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:49.657214 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a32c608b-55b6-4759-86e3-870a2f41d179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:49.725390 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1228/2460] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:32:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:32:49.745817 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:32:49.751386 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1233/2461] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:32:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:32:49.756458 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968d29a-aa94-459c-948d-19052b136032 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:49.757974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9968d29a-aa94-459c-948d-19052b136032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:49.804907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:32:49.840892 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968d29a-aa94-459c-948d-19052b136032 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:49.846144 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5447f8f-35a2-4a85-887c-fc550345179a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:49.846756 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5447f8f-35a2-4a85-887c-fc550345179a admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:49.847035 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5447f8f-35a2-4a85-887c-fc550345179a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:49.847304 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5447f8f-35a2-4a85-887c-fc550345179a admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:49.847930 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5447f8f-35a2-4a85-887c-fc550345179a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:49.849870 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5447f8f-35a2-4a85-887c-fc550345179a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:49.894447 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1229/2462] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:32:49 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:32:49.900973 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c608b-55b6-4759-86e3-870a2f41d179 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:49.912504 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c608b-55b6-4759-86e3-870a2f41d179 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:50.009459 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a70e09-793f-4019-93de-deb27a627f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:50.010360 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a70e09-793f-4019-93de-deb27a627f06 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:50.010878 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a70e09-793f-4019-93de-deb27a627f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:50.010991 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a70e09-793f-4019-93de-deb27a627f06 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:50.011747 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a70e09-793f-4019-93de-deb27a627f06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:50.013915 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a70e09-793f-4019-93de-deb27a627f06 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:50.054504 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1234/2463] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:32:49 2022] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:32:50.058208 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5447f8f-35a2-4a85-887c-fc550345179a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:50.069426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5447f8f-35a2-4a85-887c-fc550345179a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:50.074849 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6805c2f-d2dd-411f-9c00-5a90a73481f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:50.075475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6805c2f-d2dd-411f-9c00-5a90a73481f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:50.075752 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6805c2f-d2dd-411f-9c00-5a90a73481f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:50.076021 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6805c2f-d2dd-411f-9c00-5a90a73481f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:50.076717 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6805c2f-d2dd-411f-9c00-5a90a73481f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:50.079262 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6805c2f-d2dd-411f-9c00-5a90a73481f8 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:50.094196 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1230/2464] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:32:50.095666 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a70e09-793f-4019-93de-deb27a627f06 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:50.106498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a70e09-793f-4019-93de-deb27a627f06 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:50.111628 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54bcc9-7271-4b5c-a525-1c6072a05062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:50.112289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54bcc9-7271-4b5c-a525-1c6072a05062 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:50.112571 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54bcc9-7271-4b5c-a525-1c6072a05062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:50.112847 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54bcc9-7271-4b5c-a525-1c6072a05062 admin admin] PATH_INFO: `/v3/projects/f69782c35ad34d879de23020d80829d7/users/3cbcf0a875b2437f89c3ea2edadc155b/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:50.129624 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54bcc9-7271-4b5c-a525-1c6072a05062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f69782c35ad34d879de23020d80829d7, user_id=3cbcf0a875b2437f89c3ea2edadc155b, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:50.132600 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54bcc9-7271-4b5c-a525-1c6072a05062 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:50.151256 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1235/2465] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:32:50 2022] PUT /identity/v3/projects/f69782c35ad34d879de23020d80829d7/users/3cbcf0a875b2437f89c3ea2edadc155b/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:32:50.160921 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6805c2f-d2dd-411f-9c00-5a90a73481f8 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:50.171248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6805c2f-d2dd-411f-9c00-5a90a73481f8 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:50.235213 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f33e4-439d-4876-a405-d6ecc74045fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:50.236057 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f33e4-439d-4876-a405-d6ecc74045fa admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:50.236557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f33e4-439d-4876-a405-d6ecc74045fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:50.236963 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f33e4-439d-4876-a405-d6ecc74045fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:50.237846 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f33e4-439d-4876-a405-d6ecc74045fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:50.239577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f33e4-439d-4876-a405-d6ecc74045fa admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:50.251051 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1231/2466] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:32:50.255172 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54bcc9-7271-4b5c-a525-1c6072a05062 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:50.286800 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54bcc9-7271-4b5c-a525-1c6072a05062 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:50.311385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f46338-d314-4bdd-817a-dcb3ef2bf4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:50.312695 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f46338-d314-4bdd-817a-dcb3ef2bf4ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:50.313128 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f46338-d314-4bdd-817a-dcb3ef2bf4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:50.313499 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f46338-d314-4bdd-817a-dcb3ef2bf4ed admin admin] PATH_INFO: `/v3/projects/f69782c35ad34d879de23020d80829d7/users/3cbcf0a875b2437f89c3ea2edadc155b/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:50.320509 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f46338-d314-4bdd-817a-dcb3ef2bf4ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=f69782c35ad34d879de23020d80829d7, user_id=3cbcf0a875b2437f89c3ea2edadc155b, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:50.323378 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f46338-d314-4bdd-817a-dcb3ef2bf4ed admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:50.341714 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1236/2467] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:32:50 2022] PUT /identity/v3/projects/f69782c35ad34d879de23020d80829d7/users/3cbcf0a875b2437f89c3ea2edadc155b/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:32:55.014794 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f33e4-439d-4876-a405-d6ecc74045fa admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:55.020224 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e88f33e4-439d-4876-a405-d6ecc74045fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:55.110780 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f33e4-439d-4876-a405-d6ecc74045fa admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:55.204714 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea432b-e204-41e9-b477-d731117c7364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:55.204714 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea432b-e204-41e9-b477-d731117c7364 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:55.204714 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea432b-e204-41e9-b477-d731117c7364 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:55.204714 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea432b-e204-41e9-b477-d731117c7364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:55.207626 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7dea432b-e204-41e9-b477-d731117c7364 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:55.236643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:32:55.351782 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea432b-e204-41e9-b477-d731117c7364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:55.353458 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea432b-e204-41e9-b477-d731117c7364 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:55.369371 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1232/2468] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:32:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:32:56.437829 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537afd20-f8ca-4a49-b94f-6c45e7338252 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:56.438820 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537afd20-f8ca-4a49-b94f-6c45e7338252 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:56.439261 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537afd20-f8ca-4a49-b94f-6c45e7338252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:56.489250 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-537afd20-f8ca-4a49-b94f-6c45e7338252 None None] MFA Rules not processed for user `3cbcf0a875b2437f89c3ea2edadc155b`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:56.490654 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-537afd20-f8ca-4a49-b94f-6c45e7338252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:56.629119 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1237/2469] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:32:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:32:56.643460 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea432b-e204-41e9-b477-d731117c7364 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:56.646112 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7dea432b-e204-41e9-b477-d731117c7364 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:56.753295 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea432b-e204-41e9-b477-d731117c7364 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:56.760352 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d789b6-945b-4c46-b6ed-809761c8316b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63645a88f5924a57b5b828aacd856902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:56.761467 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d789b6-945b-4c46-b6ed-809761c8316b service glance] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:56.761756 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d789b6-945b-4c46-b6ed-809761c8316b service glance] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:56.762034 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d789b6-945b-4c46-b6ed-809761c8316b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:56.851201 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d789b6-945b-4c46-b6ed-809761c8316b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:56.852829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d789b6-945b-4c46-b6ed-809761c8316b service glance] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:56.883289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1233/2470] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:32:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:32:57.034151 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90feb0d3-b910-491e-8523-e96989b63881 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:57.034947 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90feb0d3-b910-491e-8523-e96989b63881 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:57.034947 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90feb0d3-b910-491e-8523-e96989b63881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:57.057721 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-90feb0d3-b910-491e-8523-e96989b63881 None None] MFA Rules not processed for user `07041df2276d4dd58fb0e49417a26e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:32:57.059453 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-90feb0d3-b910-491e-8523-e96989b63881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:57.122433 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:32:57.170441 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1238/2471] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 9 02:32:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:32:57.183084 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d789b6-945b-4c46-b6ed-809761c8316b service glance] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:32:57.184998 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-38d789b6-945b-4c46-b6ed-809761c8316b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:32:57.269978 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:32:57.275464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d789b6-945b-4c46-b6ed-809761c8316b service glance] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:32:57.283109 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd5433-504b-4511-abc0-b4116afb7b8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9151f210d29542dcb41ea3bc03390350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:32:57.284007 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd5433-504b-4511-abc0-b4116afb7b8e service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:32:57.284411 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd5433-504b-4511-abc0-b4116afb7b8e service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:32:57.284781 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd5433-504b-4511-abc0-b4116afb7b8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:32:57.294289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd5433-504b-4511-abc0-b4116afb7b8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:32:57.296342 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd5433-504b-4511-abc0-b4116afb7b8e service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:32:57.310554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1234/2472] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 9 02:32:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 02:33:06.401390 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b97ad-b626-4e29-8522-75722d386e95 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:33:06.402000 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b97ad-b626-4e29-8522-75722d386e95 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:33:06.402000 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b97ad-b626-4e29-8522-75722d386e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:33:06.458974 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-970b97ad-b626-4e29-8522-75722d386e95 None None] MFA Rules not processed for user `2d8ebcd7b7cc43ad87dfff3d91a4d679`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:33:06.460213 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-970b97ad-b626-4e29-8522-75722d386e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:33:06.547500 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1239/2473] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:33:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:33:07.333628 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:33:11.847740 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b3839-ba33-4f59-9c32-f6bcafda7572 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:33:11.848708 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b3839-ba33-4f59-9c32-f6bcafda7572 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:33:11.849471 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b3839-ba33-4f59-9c32-f6bcafda7572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:33:11.876062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-174b3839-ba33-4f59-9c32-f6bcafda7572 None None] MFA Rules not processed for user `6ea01a2d415c48918e67eb9ea9369b81`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:33:11.877738 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-174b3839-ba33-4f59-9c32-f6bcafda7572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:33:11.891673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1235/2474] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:33:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:33:15.347979 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab8e9e-f606-4e84-8864-4e9f98ae057c None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:33:15.348437 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab8e9e-f606-4e84-8864-4e9f98ae057c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:33:15.348518 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab8e9e-f606-4e84-8864-4e9f98ae057c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:33:15.369844 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a2ab8e9e-f606-4e84-8864-4e9f98ae057c None None] MFA Rules not processed for user `0b20525bc3124888bbb1decbae15d3c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:33:15.371558 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a2ab8e9e-f606-4e84-8864-4e9f98ae057c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:33:15.433931 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1240/2475] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:33:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:33:15.540148 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c9f65-0c1b-40d4-b29c-b56580716954 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:33:15.540680 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c9f65-0c1b-40d4-b29c-b56580716954 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:33:15.540680 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c9f65-0c1b-40d4-b29c-b56580716954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:33:15.562972 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-684c9f65-0c1b-40d4-b29c-b56580716954 None None] MFA Rules not processed for user `07041df2276d4dd58fb0e49417a26e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:33:15.564121 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-684c9f65-0c1b-40d4-b29c-b56580716954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:33:15.573041 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1236/2476] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 9 02:33:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:33:15.590378 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab8e9e-f606-4e84-8864-4e9f98ae057c None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:33:15.604702 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab8e9e-f606-4e84-8864-4e9f98ae057c None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:33:15.611263 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84645407-5766-4268-8992-e6ada9ed0cb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9151f210d29542dcb41ea3bc03390350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:33:15.611914 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84645407-5766-4268-8992-e6ada9ed0cb8 service swift] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:33:15.612269 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84645407-5766-4268-8992-e6ada9ed0cb8 service swift] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:33:15.612624 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84645407-5766-4268-8992-e6ada9ed0cb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:33:15.625645 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84645407-5766-4268-8992-e6ada9ed0cb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:33:15.627386 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84645407-5766-4268-8992-e6ada9ed0cb8 service swift] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:33:15.637612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1241/2477] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 9 02:33:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 02:33:25.557735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=6 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:33:25.633114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=64 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:33:28.167873 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c9f65-0c1b-40d4-b29c-b56580716954 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:33:28.169396 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-684c9f65-0c1b-40d4-b29c-b56580716954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:33:28.251218 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c9f65-0c1b-40d4-b29c-b56580716954 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:33:28.256553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48aba4-81b6-4d1d-90bd-d091ab41b62b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fe21d9a65a34abeae7329df924d7998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:33:28.257204 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48aba4-81b6-4d1d-90bd-d091ab41b62b service placement] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:33:28.257485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48aba4-81b6-4d1d-90bd-d091ab41b62b service placement] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:33:28.257758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48aba4-81b6-4d1d-90bd-d091ab41b62b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:33:28.259818 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6d48aba4-81b6-4d1d-90bd-d091ab41b62b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:33:28.275264 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48aba4-81b6-4d1d-90bd-d091ab41b62b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:33:28.276845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d48aba4-81b6-4d1d-90bd-d091ab41b62b service placement] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:33:28.288602 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1237/2478] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:33:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:33:36.204299 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f9dda-214a-4028-b8a9-a03e162091fc None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:33:36.204879 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f9dda-214a-4028-b8a9-a03e162091fc None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:33:36.204879 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f9dda-214a-4028-b8a9-a03e162091fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:33:36.224676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-882f9dda-214a-4028-b8a9-a03e162091fc None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:33:36.225913 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-882f9dda-214a-4028-b8a9-a03e162091fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:33:36.286415 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1242/2479] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 9 02:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:33:36.312625 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48aba4-81b6-4d1d-90bd-d091ab41b62b service placement] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:33:36.314147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6d48aba4-81b6-4d1d-90bd-d091ab41b62b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:33:36.386578 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d48aba4-81b6-4d1d-90bd-d091ab41b62b service placement] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:33:36.392528 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcde2f7-2909-46fc-aa7b-8fd62de8f9c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:33:36.393159 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcde2f7-2909-46fc-aa7b-8fd62de8f9c1 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:33:36.393437 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcde2f7-2909-46fc-aa7b-8fd62de8f9c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:33:36.393707 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcde2f7-2909-46fc-aa7b-8fd62de8f9c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:33:36.402230 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcde2f7-2909-46fc-aa7b-8fd62de8f9c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:33:36.404395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcde2f7-2909-46fc-aa7b-8fd62de8f9c1 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:33:36.414036 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1238/2480] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:33:40.429165 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8848aee-c893-4696-a2bc-9bc45a0655d9 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:33:40.429684 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8848aee-c893-4696-a2bc-9bc45a0655d9 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:33:40.429788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8848aee-c893-4696-a2bc-9bc45a0655d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:33:40.448990 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-d8848aee-c893-4696-a2bc-9bc45a0655d9 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:33:40.450227 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d8848aee-c893-4696-a2bc-9bc45a0655d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:33:40.457858 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1243/2481] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 9 02:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:33:40.478177 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcde2f7-2909-46fc-aa7b-8fd62de8f9c1 service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:33:40.489699 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcde2f7-2909-46fc-aa7b-8fd62de8f9c1 service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:33:40.495132 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d189af6-731a-4ed1-9618-b889a7ca6a80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:33:40.495711 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d189af6-731a-4ed1-9618-b889a7ca6a80 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:33:40.495985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d189af6-731a-4ed1-9618-b889a7ca6a80 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:33:40.496252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d189af6-731a-4ed1-9618-b889a7ca6a80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:33:40.504315 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d189af6-731a-4ed1-9618-b889a7ca6a80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:33:40.505933 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d189af6-731a-4ed1-9618-b889a7ca6a80 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:33:40.515442 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1239/2482] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:33:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:33:44.668430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d8a04-b24f-4401-8cad-94edebf4d002 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:33:44.669528 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d8a04-b24f-4401-8cad-94edebf4d002 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:33:44.669628 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d8a04-b24f-4401-8cad-94edebf4d002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:33:44.689359 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-853d8a04-b24f-4401-8cad-94edebf4d002 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:33:44.690569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-853d8a04-b24f-4401-8cad-94edebf4d002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:33:44.698589 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1244/2483] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 9 02:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:33:44.731020 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d189af6-731a-4ed1-9618-b889a7ca6a80 service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:33:44.737783 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d189af6-731a-4ed1-9618-b889a7ca6a80 service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:33:44.743325 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f81737-2b52-4d1e-b51d-98013de7013c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:33:44.743915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f81737-2b52-4d1e-b51d-98013de7013c service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:33:44.744193 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f81737-2b52-4d1e-b51d-98013de7013c service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:33:44.744507 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f81737-2b52-4d1e-b51d-98013de7013c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:33:44.754879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f81737-2b52-4d1e-b51d-98013de7013c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:33:44.756501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f81737-2b52-4d1e-b51d-98013de7013c service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:33:44.766697 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1240/2484] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:33:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:33:48.763116 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877c084-07ff-4d0c-a8af-ce70a8dfc2d3 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:33:48.763702 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877c084-07ff-4d0c-a8af-ce70a8dfc2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:33:48.763702 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877c084-07ff-4d0c-a8af-ce70a8dfc2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:33:48.784244 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c877c084-07ff-4d0c-a8af-ce70a8dfc2d3 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:33:48.785628 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c877c084-07ff-4d0c-a8af-ce70a8dfc2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:33:48.793628 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1245/2485] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 9 02:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:33:48.844367 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f81737-2b52-4d1e-b51d-98013de7013c service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:33:48.845903 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-28f81737-2b52-4d1e-b51d-98013de7013c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:33:48.860717 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f81737-2b52-4d1e-b51d-98013de7013c service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:33:48.866287 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61daef-f5b0-4834-b023-9bcb6049da02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:33:48.866882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61daef-f5b0-4834-b023-9bcb6049da02 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:33:48.867352 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61daef-f5b0-4834-b023-9bcb6049da02 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:33:48.867625 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61daef-f5b0-4834-b023-9bcb6049da02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:33:48.876496 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61daef-f5b0-4834-b023-9bcb6049da02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:33:48.878098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61daef-f5b0-4834-b023-9bcb6049da02 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:33:48.887598 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1241/2486] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:33:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:33:51.938975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877c084-07ff-4d0c-a8af-ce70a8dfc2d3 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:33:51.949240 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877c084-07ff-4d0c-a8af-ce70a8dfc2d3 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:33:51.953486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b08f1d-57e4-4e4c-809f-2b39329fd3a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:33:51.954431 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b08f1d-57e4-4e4c-809f-2b39329fd3a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:33:51.954717 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b08f1d-57e4-4e4c-809f-2b39329fd3a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:33:51.954992 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b08f1d-57e4-4e4c-809f-2b39329fd3a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:33:51.963960 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b08f1d-57e4-4e4c-809f-2b39329fd3a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:33:51.965450 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b08f1d-57e4-4e4c-809f-2b39329fd3a7 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:33:51.975094 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1246/2487] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:33:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:33:52.941759 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a738a92-820a-424f-b2f5-c54bf011513d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:33:52.942328 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a738a92-820a-424f-b2f5-c54bf011513d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:33:52.942328 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a738a92-820a-424f-b2f5-c54bf011513d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:33:52.963334 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9a738a92-820a-424f-b2f5-c54bf011513d None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:33:52.964571 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9a738a92-820a-424f-b2f5-c54bf011513d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:33:52.973555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1242/2488] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 9 02:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:33:52.997295 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b08f1d-57e4-4e4c-809f-2b39329fd3a7 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:33:53.011234 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b08f1d-57e4-4e4c-809f-2b39329fd3a7 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:33:53.018188 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e19c6-724b-48d3-928e-b7904f99ce39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:33:53.019019 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e19c6-724b-48d3-928e-b7904f99ce39 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:33:53.019298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e19c6-724b-48d3-928e-b7904f99ce39 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:33:53.019568 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e19c6-724b-48d3-928e-b7904f99ce39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:33:53.028099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e19c6-724b-48d3-928e-b7904f99ce39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:33:53.029736 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e19c6-724b-48d3-928e-b7904f99ce39 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:33:53.039703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1247/2489] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:33:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:33:56.142672 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8837989-1240-4e29-834f-52186b1c1795 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:33:56.143411 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8837989-1240-4e29-834f-52186b1c1795 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:33:56.143724 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8837989-1240-4e29-834f-52186b1c1795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:33:56.152467 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=88 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:33:56.171910 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c8837989-1240-4e29-834f-52186b1c1795 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:33:56.173157 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c8837989-1240-4e29-834f-52186b1c1795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:33:56.181813 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1243/2490] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 9 02:33:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:33:56.207781 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e19c6-724b-48d3-928e-b7904f99ce39 service nova] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:33:56.219853 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e19c6-724b-48d3-928e-b7904f99ce39 service nova] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:33:56.225384 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d55ee4-dcc1-417e-ad1c-3278480bd393 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:33:56.225984 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d55ee4-dcc1-417e-ad1c-3278480bd393 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:33:56.226262 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d55ee4-dcc1-417e-ad1c-3278480bd393 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:33:56.226532 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d55ee4-dcc1-417e-ad1c-3278480bd393 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:33:56.235506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d55ee4-dcc1-417e-ad1c-3278480bd393 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:33:56.237100 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d55ee4-dcc1-417e-ad1c-3278480bd393 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:33:56.246336 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1248/2491] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:33:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:34:06.166477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:34:06.242150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=54 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:34:12.346031 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f32720-6178-4630-ac8d-194818edb008 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:34:12.346885 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f32720-6178-4630-ac8d-194818edb008 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:34:12.347063 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f32720-6178-4630-ac8d-194818edb008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:34:12.366880 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-08f32720-6178-4630-ac8d-194818edb008 None None] MFA Rules not processed for user `e1f92dc439154a6cb037c8970c3e3a70`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:34:12.368081 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-08f32720-6178-4630-ac8d-194818edb008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:34:12.421213 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1244/2492] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:34:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:34:22.414395 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=25 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:34:26.911674 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cf0c1-5741-427b-8bc2-f2a715b4dd1f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:34:26.912275 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cf0c1-5741-427b-8bc2-f2a715b4dd1f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:34:26.912275 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cf0c1-5741-427b-8bc2-f2a715b4dd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:34:26.931923 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-606cf0c1-5741-427b-8bc2-f2a715b4dd1f None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:34:26.933224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-606cf0c1-5741-427b-8bc2-f2a715b4dd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:34:26.940875 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1249/2493] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 9 02:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:34:26.977803 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f32720-6178-4630-ac8d-194818edb008 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:34:26.991223 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f32720-6178-4630-ac8d-194818edb008 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:34:26.996487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d70cd-1b3d-494e-b568-2fc5daaa1e82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:34:26.997238 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d70cd-1b3d-494e-b568-2fc5daaa1e82 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:34:26.997517 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d70cd-1b3d-494e-b568-2fc5daaa1e82 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:34:26.997777 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d70cd-1b3d-494e-b568-2fc5daaa1e82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:34:27.005852 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d70cd-1b3d-494e-b568-2fc5daaa1e82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:34:27.007439 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d70cd-1b3d-494e-b568-2fc5daaa1e82 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:34:27.016751 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1245/2494] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:34:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:34:32.285483 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52068c8-5212-4ecc-b781-691c270674ee None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:34:32.285958 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52068c8-5212-4ecc-b781-691c270674ee None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:34:32.286041 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52068c8-5212-4ecc-b781-691c270674ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:34:32.306983 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-b52068c8-5212-4ecc-b781-691c270674ee None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:34:32.308230 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b52068c8-5212-4ecc-b781-691c270674ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:34:32.316164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1250/2495] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 9 02:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:34:32.343710 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d70cd-1b3d-494e-b568-2fc5daaa1e82 service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:34:32.355473 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d70cd-1b3d-494e-b568-2fc5daaa1e82 service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:34:32.361670 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c299f4-cdd0-4ba6-ad6a-01df7f971bf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:34:32.362335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c299f4-cdd0-4ba6-ad6a-01df7f971bf8 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:34:32.362704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c299f4-cdd0-4ba6-ad6a-01df7f971bf8 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:34:32.363040 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c299f4-cdd0-4ba6-ad6a-01df7f971bf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:34:32.371370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c299f4-cdd0-4ba6-ad6a-01df7f971bf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:34:32.372939 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c299f4-cdd0-4ba6-ad6a-01df7f971bf8 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:34:32.382808 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1246/2496] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:34:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:34:35.356795 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80356d04-f72e-472e-81a2-a4964e633dab None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:34:35.357805 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80356d04-f72e-472e-81a2-a4964e633dab None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:34:35.357984 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80356d04-f72e-472e-81a2-a4964e633dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:34:35.376913 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-80356d04-f72e-472e-81a2-a4964e633dab None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:34:35.378126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-80356d04-f72e-472e-81a2-a4964e633dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:34:35.386675 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1251/2497] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 9 02:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:34:35.407754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c299f4-cdd0-4ba6-ad6a-01df7f971bf8 service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:34:35.418828 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c299f4-cdd0-4ba6-ad6a-01df7f971bf8 service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:34:35.424851 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d834636-bdff-4365-b24e-0f15a557da48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:34:35.425503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d834636-bdff-4365-b24e-0f15a557da48 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:34:35.425786 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d834636-bdff-4365-b24e-0f15a557da48 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:34:35.426057 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d834636-bdff-4365-b24e-0f15a557da48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:34:35.433889 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d834636-bdff-4365-b24e-0f15a557da48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:34:35.435461 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d834636-bdff-4365-b24e-0f15a557da48 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:34:35.444928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1247/2498] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:34:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:34:38.404486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e57f32-2022-4c5c-ac80-95d824a243ae None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:34:38.404966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e57f32-2022-4c5c-ac80-95d824a243ae None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:34:38.405496 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e57f32-2022-4c5c-ac80-95d824a243ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:34:38.423932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a7e57f32-2022-4c5c-ac80-95d824a243ae None None] MFA Rules not processed for user `f3e3f74a4757432da1bb1e5f3a7685dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:34:38.425175 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a7e57f32-2022-4c5c-ac80-95d824a243ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:34:38.492036 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1252/2499] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:34:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:34:38.543220 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb7422-a67d-4a1b-aea8-951fee3c9ce0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:34:38.543621 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb7422-a67d-4a1b-aea8-951fee3c9ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:34:38.543776 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb7422-a67d-4a1b-aea8-951fee3c9ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:34:38.564666 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-fbeb7422-a67d-4a1b-aea8-951fee3c9ce0 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:34:38.565914 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fbeb7422-a67d-4a1b-aea8-951fee3c9ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:34:38.574473 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1248/2500] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 9 02:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:34:38.598501 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e57f32-2022-4c5c-ac80-95d824a243ae None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:34:38.614240 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e57f32-2022-4c5c-ac80-95d824a243ae None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:34:38.621095 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac0024-1794-4928-b407-03b481bb3307 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:34:38.621941 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac0024-1794-4928-b407-03b481bb3307 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:34:38.622273 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac0024-1794-4928-b407-03b481bb3307 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:34:38.623233 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac0024-1794-4928-b407-03b481bb3307 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:34:38.632255 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac0024-1794-4928-b407-03b481bb3307 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:34:38.634231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac0024-1794-4928-b407-03b481bb3307 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:34:38.644530 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1253/2501] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:34:42.743050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc084c3-d16d-4da5-84ac-be1f560dd2fc None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:34:42.743603 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc084c3-d16d-4da5-84ac-be1f560dd2fc None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:34:42.743603 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc084c3-d16d-4da5-84ac-be1f560dd2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:34:42.763662 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-3bc084c3-d16d-4da5-84ac-be1f560dd2fc None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:34:42.764796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3bc084c3-d16d-4da5-84ac-be1f560dd2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:34:42.772539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1249/2502] 10.222.0.17 () {58 vars in 1016 bytes} [Tue Aug 9 02:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:34:42.794250 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac0024-1794-4928-b407-03b481bb3307 service nova] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:34:42.805209 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac0024-1794-4928-b407-03b481bb3307 service nova] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:34:42.811265 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29ee91-7957-4de5-b587-71da17bbd6c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:34:42.811867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29ee91-7957-4de5-b587-71da17bbd6c5 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:34:42.812145 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29ee91-7957-4de5-b587-71da17bbd6c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:34:42.812413 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29ee91-7957-4de5-b587-71da17bbd6c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:34:42.822322 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29ee91-7957-4de5-b587-71da17bbd6c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:34:42.824095 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29ee91-7957-4de5-b587-71da17bbd6c5 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:34:42.837173 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1254/2503] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:34:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:34:47.969892 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3eb408-e8ac-4219-9527-96e8c8787809 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:34:47.970371 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3eb408-e8ac-4219-9527-96e8c8787809 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:34:47.970477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3eb408-e8ac-4219-9527-96e8c8787809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:34:47.989729 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ca3eb408-e8ac-4219-9527-96e8c8787809 None None] MFA Rules not processed for user `2d8ebcd7b7cc43ad87dfff3d91a4d679`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:34:47.990937 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ca3eb408-e8ac-4219-9527-96e8c8787809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:34:47.998322 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1250/2504] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:34:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:34:52.831479 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=46 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:34:57.984926 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=27 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:35:02.944073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a578a-7567-4f63-81a5-bac62c86e376 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:35:02.944536 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a578a-7567-4f63-81a5-bac62c86e376 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:35:02.944815 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a578a-7567-4f63-81a5-bac62c86e376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:35:02.976457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-ba1a578a-7567-4f63-81a5-bac62c86e376 None None] MFA Rules not processed for user `0b20525bc3124888bbb1decbae15d3c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:35:02.979555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ba1a578a-7567-4f63-81a5-bac62c86e376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:35:02.994117 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1255/2505] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:35:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:35:10.568393 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3eb408-e8ac-4219-9527-96e8c8787809 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:35:10.578869 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3eb408-e8ac-4219-9527-96e8c8787809 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:35:10.582438 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680d880-f7cf-435a-b952-b62ec1f015b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:35:10.583027 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680d880-f7cf-435a-b952-b62ec1f015b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:35:10.583303 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680d880-f7cf-435a-b952-b62ec1f015b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:35:10.583569 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680d880-f7cf-435a-b952-b62ec1f015b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:35:10.585301 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7680d880-f7cf-435a-b952-b62ec1f015b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:35:10.598183 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680d880-f7cf-435a-b952-b62ec1f015b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:35:10.599847 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680d880-f7cf-435a-b952-b62ec1f015b3 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:35:10.610908 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1251/2506] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:35:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:35:12.967137 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:35:14.185244 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a578a-7567-4f63-81a5-bac62c86e376 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:35:14.194856 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a578a-7567-4f63-81a5-bac62c86e376 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:35:14.198336 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8f1e4-856a-40c5-8319-7796944eac32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:35:14.198922 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8f1e4-856a-40c5-8319-7796944eac32 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:35:14.199196 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8f1e4-856a-40c5-8319-7796944eac32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:35:14.199463 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8f1e4-856a-40c5-8319-7796944eac32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:35:14.202033 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-33e8f1e4-856a-40c5-8319-7796944eac32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:35:14.216160 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8f1e4-856a-40c5-8319-7796944eac32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:35:14.217724 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8f1e4-856a-40c5-8319-7796944eac32 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:35:14.229453 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1256/2507] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:35:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:35:18.964294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680d880-f7cf-435a-b952-b62ec1f015b3 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:35:18.965795 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7680d880-f7cf-435a-b952-b62ec1f015b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:35:18.991212 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680d880-f7cf-435a-b952-b62ec1f015b3 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:35:18.992919 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b11d8d-d5a2-4c01-bdda-044bda1e7431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:35:18.993595 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b11d8d-d5a2-4c01-bdda-044bda1e7431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:35:18.993876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b11d8d-d5a2-4c01-bdda-044bda1e7431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:35:18.994155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b11d8d-d5a2-4c01-bdda-044bda1e7431 admin admin] PATH_INFO: `/v3/users/e1f92dc439154a6cb037c8970c3e3a70` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:35:18.995295 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b11d8d-d5a2-4c01-bdda-044bda1e7431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1f92dc439154a6cb037c8970c3e3a70)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:35:18.997950 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b11d8d-d5a2-4c01-bdda-044bda1e7431 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:35:19.043432 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a6b11d8d-d5a2-4c01-bdda-044bda1e7431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1f92dc439154a6cb037c8970c3e3a70'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:19.050302 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a6b11d8d-d5a2-4c01-bdda-044bda1e7431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1f92dc439154a6cb037c8970c3e3a70'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:19.050955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a6b11d8d-d5a2-4c01-bdda-044bda1e7431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1f92dc439154a6cb037c8970c3e3a70'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:19.063387 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a6b11d8d-d5a2-4c01-bdda-044bda1e7431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1f92dc439154a6cb037c8970c3e3a70'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:19.070204 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-a6b11d8d-d5a2-4c01-bdda-044bda1e7431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1f92dc439154a6cb037c8970c3e3a70'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:19.076027 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1252/2508] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:35:18 2022] DELETE /identity/v3/users/e1f92dc439154a6cb037c8970c3e3a70 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:35:19.268889 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8f1e4-856a-40c5-8319-7796944eac32 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:35:19.280162 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8f1e4-856a-40c5-8319-7796944eac32 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:35:19.339993 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3ae98-1a8d-414c-adfa-3e4c6f9dc187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:35:19.340627 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3ae98-1a8d-414c-adfa-3e4c6f9dc187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:35:19.340910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3ae98-1a8d-414c-adfa-3e4c6f9dc187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:35:19.341224 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3ae98-1a8d-414c-adfa-3e4c6f9dc187 admin admin] PATH_INFO: `/v3/projects/4a72e708c1e34f2fae15f070b3a6d0c7` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:35:19.342385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3ae98-1a8d-414c-adfa-3e4c6f9dc187 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a72e708c1e34f2fae15f070b3a6d0c7)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:35:19.344281 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3ae98-1a8d-414c-adfa-3e4c6f9dc187 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:35:19.391142 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dde3ae98-1a8d-414c-adfa-3e4c6f9dc187 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a72e708c1e34f2fae15f070b3a6d0c7', 'request_id': 'req-dde3ae98-1a8d-414c-adfa-3e4c6f9dc187'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:19.396523 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dde3ae98-1a8d-414c-adfa-3e4c6f9dc187 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a72e708c1e34f2fae15f070b3a6d0c7', 'request_id': 'req-dde3ae98-1a8d-414c-adfa-3e4c6f9dc187'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:19.402473 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dde3ae98-1a8d-414c-adfa-3e4c6f9dc187 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a72e708c1e34f2fae15f070b3a6d0c7', 'request_id': 'req-dde3ae98-1a8d-414c-adfa-3e4c6f9dc187'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:19.415257 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dde3ae98-1a8d-414c-adfa-3e4c6f9dc187 admin admin] The token cache is being invalidate because project 4a72e708c1e34f2fae15f070b3a6d0c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:35:19.415547 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dde3ae98-1a8d-414c-adfa-3e4c6f9dc187 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:19.416188 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dde3ae98-1a8d-414c-adfa-3e4c6f9dc187 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:19.417931 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1257/2509] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:35:19 2022] DELETE /identity/v3/projects/4a72e708c1e34f2fae15f070b3a6d0c7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:35:21.893322 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bf20d-b624-46fa-998e-2a887f887e10 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:35:21.893943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bf20d-b624-46fa-998e-2a887f887e10 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:35:21.894052 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bf20d-b624-46fa-998e-2a887f887e10 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:35:21.895506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1253/2510] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 9 02:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:35:21.901647 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb6bc2-31cc-4fb6-aa7d-7a8fca1cbdf0 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:35:21.902106 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb6bc2-31cc-4fb6-aa7d-7a8fca1cbdf0 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:35:21.902287 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb6bc2-31cc-4fb6-aa7d-7a8fca1cbdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:35:21.922336 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-1afb6bc2-31cc-4fb6-aa7d-7a8fca1cbdf0 None None] MFA Rules not processed for user `d608fede6f5e4b339f8de0354cc0562b`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:35:21.923563 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1afb6bc2-31cc-4fb6-aa7d-7a8fca1cbdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:35:21.982841 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1258/2511] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 9 02:35:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:35:21.995405 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bf20d-b624-46fa-998e-2a887f887e10 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:35:21.997682 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-667bf20d-b624-46fa-998e-2a887f887e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:35:22.010914 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bf20d-b624-46fa-998e-2a887f887e10 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:35:22.014713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb603bc-77f0-43e9-a64c-cca46eb79870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:35:22.015560 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb603bc-77f0-43e9-a64c-cca46eb79870 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:35:22.015844 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb603bc-77f0-43e9-a64c-cca46eb79870 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:35:22.016122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb603bc-77f0-43e9-a64c-cca46eb79870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:35:22.023904 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb603bc-77f0-43e9-a64c-cca46eb79870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:35:22.025434 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb603bc-77f0-43e9-a64c-cca46eb79870 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:35:22.033480 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1254/2512] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:35:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:35:22.118446 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d648989-0a9d-4454-aea0-ea9a59affa29 None None] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:35:22.118732 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d648989-0a9d-4454-aea0-ea9a59affa29 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:35:22.119002 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d648989-0a9d-4454-aea0-ea9a59affa29 None None] PATH_INFO: `/` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:35:22.120397 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1259/2513] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 9 02:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 02:35:22.126181 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea2d51-52c7-4194-b88d-06bc65c40c89 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:35:22.126463 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea2d51-52c7-4194-b88d-06bc65c40c89 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:35:22.126846 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea2d51-52c7-4194-b88d-06bc65c40c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:35:22.146386 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e0ea2d51-52c7-4194-b88d-06bc65c40c89 None None] MFA Rules not processed for user `78fff294b9794a26aa1bbc231fa1133c`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:35:22.147640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e0ea2d51-52c7-4194-b88d-06bc65c40c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:35:22.212867 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1255/2514] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 9 02:35:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:35:22.223992 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d648989-0a9d-4454-aea0-ea9a59affa29 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:35:22.235227 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d648989-0a9d-4454-aea0-ea9a59affa29 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:35:22.238798 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342f3e5-2fdf-4a08-be78-75ebe1542fa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:35:22.239387 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342f3e5-2fdf-4a08-be78-75ebe1542fa8 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:35:22.239669 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342f3e5-2fdf-4a08-be78-75ebe1542fa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:35:22.239942 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342f3e5-2fdf-4a08-be78-75ebe1542fa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:35:22.250378 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342f3e5-2fdf-4a08-be78-75ebe1542fa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:35:22.251817 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342f3e5-2fdf-4a08-be78-75ebe1542fa8 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:35:22.262318 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1260/2515] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:35:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:35:32.203642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=72,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:35:32.257794 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:35:37.914501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923d59d-654a-4fdb-857f-2e53cdb072c8 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:35:37.914939 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923d59d-654a-4fdb-857f-2e53cdb072c8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:35:37.915055 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923d59d-654a-4fdb-857f-2e53cdb072c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:35:37.936229 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-3923d59d-654a-4fdb-857f-2e53cdb072c8 None None] MFA Rules not processed for user `07041df2276d4dd58fb0e49417a26e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:35:37.937468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3923d59d-654a-4fdb-857f-2e53cdb072c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:35:37.993704 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1256/2516] 10.222.0.16 () {58 vars in 967 bytes} [Tue Aug 9 02:35:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:35:38.033933 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342f3e5-2fdf-4a08-be78-75ebe1542fa8 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:35:38.035463 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4342f3e5-2fdf-4a08-be78-75ebe1542fa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:35:38.102335 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342f3e5-2fdf-4a08-be78-75ebe1542fa8 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:35:38.107162 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79ee24-ec6f-4e40-a5a9-abe40646ce7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9151f210d29542dcb41ea3bc03390350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:35:38.107755 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79ee24-ec6f-4e40-a5a9-abe40646ce7f service swift] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:35:38.108034 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79ee24-ec6f-4e40-a5a9-abe40646ce7f service swift] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:35:38.108304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79ee24-ec6f-4e40-a5a9-abe40646ce7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:35:38.116459 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79ee24-ec6f-4e40-a5a9-abe40646ce7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:35:38.118059 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79ee24-ec6f-4e40-a5a9-abe40646ce7f service swift] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:35:38.126548 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1261/2517] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 9 02:35:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 02:35:45.023842 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923d59d-654a-4fdb-857f-2e53cdb072c8 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:35:45.026028 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3923d59d-654a-4fdb-857f-2e53cdb072c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:35:45.093388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923d59d-654a-4fdb-857f-2e53cdb072c8 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:35:45.098213 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29109390-154b-4a3c-8593-e3993ef034ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:35:45.098841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29109390-154b-4a3c-8593-e3993ef034ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:35:45.099126 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29109390-154b-4a3c-8593-e3993ef034ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:35:45.099419 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29109390-154b-4a3c-8593-e3993ef034ce admin admin] PATH_INFO: `/v3/users/6ea01a2d415c48918e67eb9ea9369b81` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:35:45.100544 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29109390-154b-4a3c-8593-e3993ef034ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ea01a2d415c48918e67eb9ea9369b81)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:35:45.102513 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29109390-154b-4a3c-8593-e3993ef034ce admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:35:45.150163 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-29109390-154b-4a3c-8593-e3993ef034ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ea01a2d415c48918e67eb9ea9369b81'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:45.157700 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-29109390-154b-4a3c-8593-e3993ef034ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ea01a2d415c48918e67eb9ea9369b81'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:45.158370 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-29109390-154b-4a3c-8593-e3993ef034ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ea01a2d415c48918e67eb9ea9369b81'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:45.170231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-29109390-154b-4a3c-8593-e3993ef034ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ea01a2d415c48918e67eb9ea9369b81'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:45.176992 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-29109390-154b-4a3c-8593-e3993ef034ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ea01a2d415c48918e67eb9ea9369b81'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:45.182850 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1257/2518] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:35:45 2022] DELETE /identity/v3/users/6ea01a2d415c48918e67eb9ea9369b81 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:35:45.362225 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79ee24-ec6f-4e40-a5a9-abe40646ce7f service swift] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:35:45.375772 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79ee24-ec6f-4e40-a5a9-abe40646ce7f service swift] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:35:45.430928 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7eb98-d985-490f-a531-170d57f755a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:35:45.431480 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7eb98-d985-490f-a531-170d57f755a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:35:45.432390 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7eb98-d985-490f-a531-170d57f755a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:35:45.432662 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7eb98-d985-490f-a531-170d57f755a8 admin admin] PATH_INFO: `/v3/projects/4bcb9413e4f6464e9246059a2e344021` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:35:45.433796 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7eb98-d985-490f-a531-170d57f755a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bcb9413e4f6464e9246059a2e344021)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:35:45.435667 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7eb98-d985-490f-a531-170d57f755a8 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:35:45.481163 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-74d7eb98-d985-490f-a531-170d57f755a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bcb9413e4f6464e9246059a2e344021', 'request_id': 'req-74d7eb98-d985-490f-a531-170d57f755a8'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:45.486570 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-74d7eb98-d985-490f-a531-170d57f755a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bcb9413e4f6464e9246059a2e344021', 'request_id': 'req-74d7eb98-d985-490f-a531-170d57f755a8'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:45.492502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-74d7eb98-d985-490f-a531-170d57f755a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bcb9413e4f6464e9246059a2e344021', 'request_id': 'req-74d7eb98-d985-490f-a531-170d57f755a8'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:45.504632 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-74d7eb98-d985-490f-a531-170d57f755a8 admin admin] The token cache is being invalidate because project 4bcb9413e4f6464e9246059a2e344021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:35:45.504946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-74d7eb98-d985-490f-a531-170d57f755a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:45.505602 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-74d7eb98-d985-490f-a531-170d57f755a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:45.507069 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1262/2519] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:35:45 2022] DELETE /identity/v3/projects/4bcb9413e4f6464e9246059a2e344021 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:35:45.511846 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29109390-154b-4a3c-8593-e3993ef034ce admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:35:45.513318 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-29109390-154b-4a3c-8593-e3993ef034ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:35:45.526923 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29109390-154b-4a3c-8593-e3993ef034ce admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:35:45.546768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:35:45.585937 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b638f-671b-4a76-8842-1c992c9a0a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:35:45.586568 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b638f-671b-4a76-8842-1c992c9a0a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:35:45.586828 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b638f-671b-4a76-8842-1c992c9a0a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:35:45.587093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b638f-671b-4a76-8842-1c992c9a0a47 admin admin] PATH_INFO: `/v3/users/3cbcf0a875b2437f89c3ea2edadc155b` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:35:45.588232 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b638f-671b-4a76-8842-1c992c9a0a47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cbcf0a875b2437f89c3ea2edadc155b)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:35:45.590187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b638f-671b-4a76-8842-1c992c9a0a47 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:35:45.636093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fa4b638f-671b-4a76-8842-1c992c9a0a47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cbcf0a875b2437f89c3ea2edadc155b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:45.643501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fa4b638f-671b-4a76-8842-1c992c9a0a47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cbcf0a875b2437f89c3ea2edadc155b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:45.644220 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fa4b638f-671b-4a76-8842-1c992c9a0a47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cbcf0a875b2437f89c3ea2edadc155b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:45.656234 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fa4b638f-671b-4a76-8842-1c992c9a0a47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cbcf0a875b2437f89c3ea2edadc155b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:45.663149 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fa4b638f-671b-4a76-8842-1c992c9a0a47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cbcf0a875b2437f89c3ea2edadc155b'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:45.669767 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1258/2520] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:35:45 2022] DELETE /identity/v3/users/3cbcf0a875b2437f89c3ea2edadc155b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:35:45.848368 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7eb98-d985-490f-a531-170d57f755a8 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:35:45.849806 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-74d7eb98-d985-490f-a531-170d57f755a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:35:45.862318 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7eb98-d985-490f-a531-170d57f755a8 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:35:45.881171 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:35:45.924924 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db290f-c5e8-4ac9-9953-05590257bfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:35:45.925617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db290f-c5e8-4ac9-9953-05590257bfd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:35:45.925890 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db290f-c5e8-4ac9-9953-05590257bfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:35:45.926163 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db290f-c5e8-4ac9-9953-05590257bfd9 admin admin] PATH_INFO: `/v3/projects/f69782c35ad34d879de23020d80829d7` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:35:45.927377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db290f-c5e8-4ac9-9953-05590257bfd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f69782c35ad34d879de23020d80829d7)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:35:45.929320 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db290f-c5e8-4ac9-9953-05590257bfd9 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:35:45.990799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-27db290f-c5e8-4ac9-9953-05590257bfd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f69782c35ad34d879de23020d80829d7', 'request_id': 'req-27db290f-c5e8-4ac9-9953-05590257bfd9'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:45.996751 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-27db290f-c5e8-4ac9-9953-05590257bfd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f69782c35ad34d879de23020d80829d7', 'request_id': 'req-27db290f-c5e8-4ac9-9953-05590257bfd9'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:46.003323 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-27db290f-c5e8-4ac9-9953-05590257bfd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f69782c35ad34d879de23020d80829d7', 'request_id': 'req-27db290f-c5e8-4ac9-9953-05590257bfd9'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:46.018844 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-27db290f-c5e8-4ac9-9953-05590257bfd9 admin admin] The token cache is being invalidate because project f69782c35ad34d879de23020d80829d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:35:46.019140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-27db290f-c5e8-4ac9-9953-05590257bfd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:46.019777 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-27db290f-c5e8-4ac9-9953-05590257bfd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:35:46.021277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1263/2521] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:35:45 2022] DELETE /identity/v3/projects/f69782c35ad34d879de23020d80829d7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:35:46.102576 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b638f-671b-4a76-8842-1c992c9a0a47 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:35:46.104798 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fa4b638f-671b-4a76-8842-1c992c9a0a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:35:46.194827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b638f-671b-4a76-8842-1c992c9a0a47 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:35:46.242488 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:35:46.273709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c18f7b-569a-495f-abb8-289cb7bfe921 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:35:46.274330 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c18f7b-569a-495f-abb8-289cb7bfe921 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:35:46.274611 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c18f7b-569a-495f-abb8-289cb7bfe921 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:35:46.274934 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c18f7b-569a-495f-abb8-289cb7bfe921 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:35:46.277256 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-89c18f7b-569a-495f-abb8-289cb7bfe921 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:35:46.335798 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c18f7b-569a-495f-abb8-289cb7bfe921 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:35:46.337431 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c18f7b-569a-495f-abb8-289cb7bfe921 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:35:46.347121 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1259/2522] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:35:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:35:46.841767 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db290f-c5e8-4ac9-9953-05590257bfd9 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:35:46.844263 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-27db290f-c5e8-4ac9-9953-05590257bfd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:35:46.868160 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db290f-c5e8-4ac9-9953-05590257bfd9 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:35:46.881636 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511a4a5-1283-40eb-a6a4-4578b1a72343 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:35:46.882937 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511a4a5-1283-40eb-a6a4-4578b1a72343 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:35:46.883442 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511a4a5-1283-40eb-a6a4-4578b1a72343 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:35:46.883874 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511a4a5-1283-40eb-a6a4-4578b1a72343 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:35:46.886533 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d511a4a5-1283-40eb-a6a4-4578b1a72343 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:35:46.916408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511a4a5-1283-40eb-a6a4-4578b1a72343 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:35:46.918115 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511a4a5-1283-40eb-a6a4-4578b1a72343 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:35:46.937699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1264/2523] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:35:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:35:56.342660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=37 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:35:56.926606 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:35:59.137743 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c18f7b-569a-495f-abb8-289cb7bfe921 service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:35:59.139315 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-89c18f7b-569a-495f-abb8-289cb7bfe921 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:35:59.157648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c18f7b-569a-495f-abb8-289cb7bfe921 service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:35:59.163342 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a3e0b-ec8a-448d-9e8f-19e9b1ef3a94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:35:59.163974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a3e0b-ec8a-448d-9e8f-19e9b1ef3a94 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:35:59.164252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a3e0b-ec8a-448d-9e8f-19e9b1ef3a94 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:35:59.164522 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a3e0b-ec8a-448d-9e8f-19e9b1ef3a94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:35:59.166812 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-039a3e0b-ec8a-448d-9e8f-19e9b1ef3a94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:35:59.223251 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a3e0b-ec8a-448d-9e8f-19e9b1ef3a94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:35:59.224840 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a3e0b-ec8a-448d-9e8f-19e9b1ef3a94 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:35:59.234455 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1260/2524] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:35:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:05.086678 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511a4a5-1283-40eb-a6a4-4578b1a72343 service nova] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:05.088730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d511a4a5-1283-40eb-a6a4-4578b1a72343 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:05.174408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a3e0b-ec8a-448d-9e8f-19e9b1ef3a94 service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:05.178273 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-039a3e0b-ec8a-448d-9e8f-19e9b1ef3a94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:05.197930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511a4a5-1283-40eb-a6a4-4578b1a72343 service nova] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:05.202905 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ac913-ac1b-44ed-aec6-db9721e278fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fe21d9a65a34abeae7329df924d7998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:05.203515 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ac913-ac1b-44ed-aec6-db9721e278fb service placement] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:05.203801 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ac913-ac1b-44ed-aec6-db9721e278fb service placement] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:05.204077 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ac913-ac1b-44ed-aec6-db9721e278fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:05.205873 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1c1ac913-ac1b-44ed-aec6-db9721e278fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:05.218876 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ac913-ac1b-44ed-aec6-db9721e278fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:05.220726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ac913-ac1b-44ed-aec6-db9721e278fb service placement] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:05.233191 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1265/2525] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:36:05.253949 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a3e0b-ec8a-448d-9e8f-19e9b1ef3a94 service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:05.258175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceae880-2317-4ebc-84c6-c3327a1d881f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:05.258852 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceae880-2317-4ebc-84c6-c3327a1d881f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:05.259126 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceae880-2317-4ebc-84c6-c3327a1d881f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:05.259398 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceae880-2317-4ebc-84c6-c3327a1d881f admin admin] PATH_INFO: `/v3/users/2d8ebcd7b7cc43ad87dfff3d91a4d679` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:05.260531 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceae880-2317-4ebc-84c6-c3327a1d881f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d8ebcd7b7cc43ad87dfff3d91a4d679)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:05.262489 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceae880-2317-4ebc-84c6-c3327a1d881f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:05.314597 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cceae880-2317-4ebc-84c6-c3327a1d881f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d8ebcd7b7cc43ad87dfff3d91a4d679'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:05.323401 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cceae880-2317-4ebc-84c6-c3327a1d881f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d8ebcd7b7cc43ad87dfff3d91a4d679'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:05.324092 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cceae880-2317-4ebc-84c6-c3327a1d881f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d8ebcd7b7cc43ad87dfff3d91a4d679'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:05.339005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cceae880-2317-4ebc-84c6-c3327a1d881f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d8ebcd7b7cc43ad87dfff3d91a4d679'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:05.347963 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-cceae880-2317-4ebc-84c6-c3327a1d881f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d8ebcd7b7cc43ad87dfff3d91a4d679'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:05.358342 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1261/2526] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:36:05 2022] DELETE /identity/v3/users/2d8ebcd7b7cc43ad87dfff3d91a4d679 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:05.615789 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ac913-ac1b-44ed-aec6-db9721e278fb service placement] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:05.633390 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ac913-ac1b-44ed-aec6-db9721e278fb service placement] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:05.704602 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f26da-9896-40ed-8bb4-877e92ce6ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:05.705233 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f26da-9896-40ed-8bb4-877e92ce6ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:05.705491 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f26da-9896-40ed-8bb4-877e92ce6ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:05.705766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f26da-9896-40ed-8bb4-877e92ce6ce6 admin admin] PATH_INFO: `/v3/projects/f3310fae1a8b4eb2a3a16eef007cf57b` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:05.706918 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f26da-9896-40ed-8bb4-877e92ce6ce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3310fae1a8b4eb2a3a16eef007cf57b)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:05.708816 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f26da-9896-40ed-8bb4-877e92ce6ce6 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:05.757961 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-499f26da-9896-40ed-8bb4-877e92ce6ce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3310fae1a8b4eb2a3a16eef007cf57b', 'request_id': 'req-499f26da-9896-40ed-8bb4-877e92ce6ce6'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:05.767118 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-499f26da-9896-40ed-8bb4-877e92ce6ce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3310fae1a8b4eb2a3a16eef007cf57b', 'request_id': 'req-499f26da-9896-40ed-8bb4-877e92ce6ce6'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:05.773434 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-499f26da-9896-40ed-8bb4-877e92ce6ce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3310fae1a8b4eb2a3a16eef007cf57b', 'request_id': 'req-499f26da-9896-40ed-8bb4-877e92ce6ce6'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:05.788734 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-499f26da-9896-40ed-8bb4-877e92ce6ce6 admin admin] The token cache is being invalidate because project f3310fae1a8b4eb2a3a16eef007cf57b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:36:05.789137 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-499f26da-9896-40ed-8bb4-877e92ce6ce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:05.789894 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-499f26da-9896-40ed-8bb4-877e92ce6ce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:05.795028 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1266/2527] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:36:05 2022] DELETE /identity/v3/projects/f3310fae1a8b4eb2a3a16eef007cf57b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:05.796826 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4a44a-d390-4116-9ec6-9c7554383e11 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:05.797147 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4a44a-d390-4116-9ec6-9c7554383e11 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:05.797425 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4a44a-d390-4116-9ec6-9c7554383e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:05.824061 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a4d4a44a-d390-4116-9ec6-9c7554383e11 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:05.825367 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a4d4a44a-d390-4116-9ec6-9c7554383e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:05.839353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:05.916067 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1262/2528] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:05.924151 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30b085-dde4-4604-885c-0a8bb2b5d5ad None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:05.924610 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30b085-dde4-4604-885c-0a8bb2b5d5ad None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:05.925059 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30b085-dde4-4604-885c-0a8bb2b5d5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:05.947335 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-1c30b085-dde4-4604-885c-0a8bb2b5d5ad None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:05.948890 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1c30b085-dde4-4604-885c-0a8bb2b5d5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:05.959310 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1267/2529] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:05.964248 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4a44a-d390-4116-9ec6-9c7554383e11 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:05.989418 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4a44a-d390-4116-9ec6-9c7554383e11 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:06.003465 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5ef00-a434-465b-a698-e776578fc50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:06.004371 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5ef00-a434-465b-a698-e776578fc50a admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:06.004748 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5ef00-a434-465b-a698-e776578fc50a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:06.005159 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5ef00-a434-465b-a698-e776578fc50a admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:06.005955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5ef00-a434-465b-a698-e776578fc50a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:36:06.006377 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5ef00-a434-465b-a698-e776578fc50a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:06.009417 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5ef00-a434-465b-a698-e776578fc50a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:06.030059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1263/2530] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:36:06.034488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30b085-dde4-4604-885c-0a8bb2b5d5ad None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:06.047546 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30b085-dde4-4604-885c-0a8bb2b5d5ad None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:06.053879 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67a89e-900e-4eed-8443-e2737dea6339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:06.054647 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67a89e-900e-4eed-8443-e2737dea6339 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:06.055093 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67a89e-900e-4eed-8443-e2737dea6339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:06.055474 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67a89e-900e-4eed-8443-e2737dea6339 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:06.056228 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67a89e-900e-4eed-8443-e2737dea6339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:06.058419 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67a89e-900e-4eed-8443-e2737dea6339 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:06.075076 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:06.108929 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1268/2531] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:36:06 2022] POST /identity/v3/projects => generated 389 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:06.113497 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5ef00-a434-465b-a698-e776578fc50a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:06.127913 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5ef00-a434-465b-a698-e776578fc50a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:06.224444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f5088-86ad-4417-99b8-e7ecf83e2298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:06.225160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f5088-86ad-4417-99b8-e7ecf83e2298 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:06.225264 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f5088-86ad-4417-99b8-e7ecf83e2298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:06.225616 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f5088-86ad-4417-99b8-e7ecf83e2298 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:06.226250 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f5088-86ad-4417-99b8-e7ecf83e2298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:06.228494 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f5088-86ad-4417-99b8-e7ecf83e2298 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:06.264685 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1264/2532] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:36:06 2022] POST /identity/v3/users => generated 295 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:06.266038 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67a89e-900e-4eed-8443-e2737dea6339 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:06.278962 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67a89e-900e-4eed-8443-e2737dea6339 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:06.283811 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9c116-0576-486c-bb25-c08f2f6f1c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:06.284412 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9c116-0576-486c-bb25-c08f2f6f1c41 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:06.284701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9c116-0576-486c-bb25-c08f2f6f1c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:06.284977 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9c116-0576-486c-bb25-c08f2f6f1c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:06.285818 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9c116-0576-486c-bb25-c08f2f6f1c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:06.287583 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9c116-0576-486c-bb25-c08f2f6f1c41 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:06.298274 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1269/2533] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:06.302454 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f5088-86ad-4417-99b8-e7ecf83e2298 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:06.313193 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f5088-86ad-4417-99b8-e7ecf83e2298 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:06.318034 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a815a-ece3-424c-9e36-f63570fc38be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:06.318648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a815a-ece3-424c-9e36-f63570fc38be admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:06.318954 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a815a-ece3-424c-9e36-f63570fc38be admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:06.319229 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a815a-ece3-424c-9e36-f63570fc38be admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:06.319875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a815a-ece3-424c-9e36-f63570fc38be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:06.322073 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a815a-ece3-424c-9e36-f63570fc38be admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:06.333173 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1265/2534] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:06.338061 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9c116-0576-486c-bb25-c08f2f6f1c41 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:06.351712 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9c116-0576-486c-bb25-c08f2f6f1c41 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:06.357643 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bfe59-763f-4b35-ac01-8d862f6b7f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:06.358867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bfe59-763f-4b35-ac01-8d862f6b7f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:06.358982 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bfe59-763f-4b35-ac01-8d862f6b7f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:06.359260 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bfe59-763f-4b35-ac01-8d862f6b7f25 admin admin] PATH_INFO: `/v3/projects/40fcdb5a3c584d8fb5abdf91779508c4/users/0aa33ae8162c4e0f80965298def294c5/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:06.379053 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bfe59-763f-4b35-ac01-8d862f6b7f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40fcdb5a3c584d8fb5abdf91779508c4, user_id=0aa33ae8162c4e0f80965298def294c5, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:06.381922 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8bfe59-763f-4b35-ac01-8d862f6b7f25 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:06.401146 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1270/2535] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:36:06 2022] PUT /identity/v3/projects/40fcdb5a3c584d8fb5abdf91779508c4/users/0aa33ae8162c4e0f80965298def294c5/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:06.406019 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2792699-c302-439a-810b-2061e318ce92 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:06.406390 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2792699-c302-439a-810b-2061e318ce92 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:06.406740 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2792699-c302-439a-810b-2061e318ce92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:06.427175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f2792699-c302-439a-810b-2061e318ce92 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:06.428486 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f2792699-c302-439a-810b-2061e318ce92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:06.496780 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1266/2536] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:06.506909 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bfe59-763f-4b35-ac01-8d862f6b7f25 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:06.508701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-9e8bfe59-763f-4b35-ac01-8d862f6b7f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:06.568179 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bfe59-763f-4b35-ac01-8d862f6b7f25 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:06.571916 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618a45f-1141-4969-8263-9a4b02c9fa56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:06.572529 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618a45f-1141-4969-8263-9a4b02c9fa56 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:06.572810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618a45f-1141-4969-8263-9a4b02c9fa56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:06.573116 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618a45f-1141-4969-8263-9a4b02c9fa56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:06.584792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618a45f-1141-4969-8263-9a4b02c9fa56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:06.586853 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618a45f-1141-4969-8263-9a4b02c9fa56 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:06.601689 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1271/2537] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:11.407972 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc41a02-e4a9-4ad5-95cb-29e019b80dcb None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:11.408902 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc41a02-e4a9-4ad5-95cb-29e019b80dcb None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:11.409497 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc41a02-e4a9-4ad5-95cb-29e019b80dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:11.444305 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-edc41a02-e4a9-4ad5-95cb-29e019b80dcb None None] MFA Rules not processed for user `0aa33ae8162c4e0f80965298def294c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:11.446128 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-edc41a02-e4a9-4ad5-95cb-29e019b80dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:11.463415 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:11.564986 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1267/2538] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:11.577855 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618a45f-1141-4969-8263-9a4b02c9fa56 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:11.585533 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc41a02-e4a9-4ad5-95cb-29e019b80dcb None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:11.587638 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-edc41a02-e4a9-4ad5-95cb-29e019b80dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:11.591180 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618a45f-1141-4969-8263-9a4b02c9fa56 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:11.596817 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4425dd-6727-420c-b2eb-919c542d5761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:11.597685 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4425dd-6727-420c-b2eb-919c542d5761 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:11.598259 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4425dd-6727-420c-b2eb-919c542d5761 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:11.598685 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4425dd-6727-420c-b2eb-919c542d5761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:11.601400 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-cf4425dd-6727-420c-b2eb-919c542d5761 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:11.620720 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4425dd-6727-420c-b2eb-919c542d5761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:11.626305 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4425dd-6727-420c-b2eb-919c542d5761 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:11.641276 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1272/2539] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:11.678211 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc41a02-e4a9-4ad5-95cb-29e019b80dcb None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:11.684790 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e483bd-5225-46fc-a15c-aa1e454287b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:11.685465 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e483bd-5225-46fc-a15c-aa1e454287b9 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:11.685740 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e483bd-5225-46fc-a15c-aa1e454287b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:11.686011 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e483bd-5225-46fc-a15c-aa1e454287b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:11.694649 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e483bd-5225-46fc-a15c-aa1e454287b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:11.696309 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e483bd-5225-46fc-a15c-aa1e454287b9 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:11.706188 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1268/2540] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:11 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:36:13.163140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7446d-e026-40bb-aaac-f4af98f9e1d7 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:13.163667 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7446d-e026-40bb-aaac-f4af98f9e1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:13.163785 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7446d-e026-40bb-aaac-f4af98f9e1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:13.182603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-31e7446d-e026-40bb-aaac-f4af98f9e1d7 None None] MFA Rules not processed for user `0aa33ae8162c4e0f80965298def294c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:13.184114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-31e7446d-e026-40bb-aaac-f4af98f9e1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:13.191475 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1273/2541] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:13.596005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e483bd-5225-46fc-a15c-aa1e454287b9 service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:13.599022 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-76e483bd-5225-46fc-a15c-aa1e454287b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:13.621775 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e483bd-5225-46fc-a15c-aa1e454287b9 service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:13.638793 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca191ab8-15e0-47e6-b3b4-aa97dd402597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:13.639339 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca191ab8-15e0-47e6-b3b4-aa97dd402597 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:13.639623 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca191ab8-15e0-47e6-b3b4-aa97dd402597 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:13.640056 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca191ab8-15e0-47e6-b3b4-aa97dd402597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:13.646548 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ca191ab8-15e0-47e6-b3b4-aa97dd402597 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:13.660627 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca191ab8-15e0-47e6-b3b4-aa97dd402597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:13.662610 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca191ab8-15e0-47e6-b3b4-aa97dd402597 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:13.678324 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1269/2542] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:14.242701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7446d-e026-40bb-aaac-f4af98f9e1d7 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:14.244842 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-31e7446d-e026-40bb-aaac-f4af98f9e1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:14.336861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7446d-e026-40bb-aaac-f4af98f9e1d7 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:14.342248 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2318fbe-abe7-4377-83fa-9e03b1b8512e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fe21d9a65a34abeae7329df924d7998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:14.342882 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2318fbe-abe7-4377-83fa-9e03b1b8512e service placement] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:14.343160 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2318fbe-abe7-4377-83fa-9e03b1b8512e service placement] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:14.343430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2318fbe-abe7-4377-83fa-9e03b1b8512e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:14.345663 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e2318fbe-abe7-4377-83fa-9e03b1b8512e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:14.359031 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2318fbe-abe7-4377-83fa-9e03b1b8512e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:14.360888 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2318fbe-abe7-4377-83fa-9e03b1b8512e service placement] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:14.373701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1274/2543] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:15.098762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca191ab8-15e0-47e6-b3b4-aa97dd402597 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:15.126287 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca191ab8-15e0-47e6-b3b4-aa97dd402597 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:15.136999 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356a8ff-5e41-44e1-a158-9dfa205ef7a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:15.137785 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356a8ff-5e41-44e1-a158-9dfa205ef7a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:15.138260 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356a8ff-5e41-44e1-a158-9dfa205ef7a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:15.138754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356a8ff-5e41-44e1-a158-9dfa205ef7a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:15.143816 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9356a8ff-5e41-44e1-a158-9dfa205ef7a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:15.198826 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356a8ff-5e41-44e1-a158-9dfa205ef7a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:15.212191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356a8ff-5e41-44e1-a158-9dfa205ef7a2 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:15.232392 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1270/2544] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:15.706473 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2318fbe-abe7-4377-83fa-9e03b1b8512e service placement] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:15.708613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-e2318fbe-abe7-4377-83fa-9e03b1b8512e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:15.737692 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2318fbe-abe7-4377-83fa-9e03b1b8512e service placement] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:15.743947 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ce63f-be65-43fe-88a3-4e3c4925e4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:15.744875 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ce63f-be65-43fe-88a3-4e3c4925e4a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:15.745648 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ce63f-be65-43fe-88a3-4e3c4925e4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:15.746149 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ce63f-be65-43fe-88a3-4e3c4925e4a4 admin admin] PATH_INFO: `/v3/users/f3e3f74a4757432da1bb1e5f3a7685dd` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:15.747514 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ce63f-be65-43fe-88a3-4e3c4925e4a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e3f74a4757432da1bb1e5f3a7685dd)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:15.749777 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ce63f-be65-43fe-88a3-4e3c4925e4a4 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:15.787272 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:15.832806 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-119ce63f-be65-43fe-88a3-4e3c4925e4a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e3f74a4757432da1bb1e5f3a7685dd'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:15.841930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-119ce63f-be65-43fe-88a3-4e3c4925e4a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e3f74a4757432da1bb1e5f3a7685dd'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:15.852570 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-119ce63f-be65-43fe-88a3-4e3c4925e4a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e3f74a4757432da1bb1e5f3a7685dd'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:15.853393 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-119ce63f-be65-43fe-88a3-4e3c4925e4a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e3f74a4757432da1bb1e5f3a7685dd'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:15.869742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-119ce63f-be65-43fe-88a3-4e3c4925e4a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e3f74a4757432da1bb1e5f3a7685dd'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:15.879835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1275/2545] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:36:15 2022] DELETE /identity/v3/users/f3e3f74a4757432da1bb1e5f3a7685dd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:16.152733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356a8ff-5e41-44e1-a158-9dfa205ef7a2 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:16.182425 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356a8ff-5e41-44e1-a158-9dfa205ef7a2 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:16.269046 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da72b85-73b1-4a31-9218-aed22ac7bd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:16.269783 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da72b85-73b1-4a31-9218-aed22ac7bd5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:16.270142 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da72b85-73b1-4a31-9218-aed22ac7bd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:16.270546 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da72b85-73b1-4a31-9218-aed22ac7bd5a admin admin] PATH_INFO: `/v3/projects/a9a1c4c1a74d4f08a6964b20832c5d5f` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:16.272453 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da72b85-73b1-4a31-9218-aed22ac7bd5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a1c4c1a74d4f08a6964b20832c5d5f)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:16.275078 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da72b85-73b1-4a31-9218-aed22ac7bd5a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:16.302391 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:16.352848 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7da72b85-73b1-4a31-9218-aed22ac7bd5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a1c4c1a74d4f08a6964b20832c5d5f', 'request_id': 'req-7da72b85-73b1-4a31-9218-aed22ac7bd5a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:16.361139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7da72b85-73b1-4a31-9218-aed22ac7bd5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a1c4c1a74d4f08a6964b20832c5d5f', 'request_id': 'req-7da72b85-73b1-4a31-9218-aed22ac7bd5a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:16.370593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7da72b85-73b1-4a31-9218-aed22ac7bd5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a1c4c1a74d4f08a6964b20832c5d5f', 'request_id': 'req-7da72b85-73b1-4a31-9218-aed22ac7bd5a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:16.386787 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7da72b85-73b1-4a31-9218-aed22ac7bd5a admin admin] The token cache is being invalidate because project a9a1c4c1a74d4f08a6964b20832c5d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:36:16.387163 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7da72b85-73b1-4a31-9218-aed22ac7bd5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:16.387925 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7da72b85-73b1-4a31-9218-aed22ac7bd5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:16.389872 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1271/2546] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:36:16 2022] DELETE /identity/v3/projects/a9a1c4c1a74d4f08a6964b20832c5d5f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:16.395016 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5068ec-5a8f-47c1-a26c-b1444adb239c None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:16.395617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5068ec-5a8f-47c1-a26c-b1444adb239c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:16.396111 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5068ec-5a8f-47c1-a26c-b1444adb239c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:16.425963 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-4d5068ec-5a8f-47c1-a26c-b1444adb239c None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:16.427445 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4d5068ec-5a8f-47c1-a26c-b1444adb239c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:16.548360 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1276/2547] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:16.550017 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495aa80-ae51-438c-8f70-f34955ba3282 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:16.550313 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495aa80-ae51-438c-8f70-f34955ba3282 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:16.550591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495aa80-ae51-438c-8f70-f34955ba3282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:16.592364 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-b495aa80-ae51-438c-8f70-f34955ba3282 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:16.594285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b495aa80-ae51-438c-8f70-f34955ba3282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:16.604680 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1272/2548] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:16.612556 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5068ec-5a8f-47c1-a26c-b1444adb239c None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:16.624362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5068ec-5a8f-47c1-a26c-b1444adb239c None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:16.630522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bac37c-b27f-4e5c-83ff-966e7004a5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:16.631460 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bac37c-b27f-4e5c-83ff-966e7004a5ff admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:16.631932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bac37c-b27f-4e5c-83ff-966e7004a5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:16.632220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bac37c-b27f-4e5c-83ff-966e7004a5ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:16.633473 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bac37c-b27f-4e5c-83ff-966e7004a5ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:36:16.633930 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bac37c-b27f-4e5c-83ff-966e7004a5ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:16.635594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bac37c-b27f-4e5c-83ff-966e7004a5ff admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:16.649644 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1277/2549] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:36:16.654217 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495aa80-ae51-438c-8f70-f34955ba3282 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:16.665403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495aa80-ae51-438c-8f70-f34955ba3282 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:16.671548 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c712c83-733e-4ffe-8517-d56a8b10a4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:16.673044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c712c83-733e-4ffe-8517-d56a8b10a4ac admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:16.673459 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c712c83-733e-4ffe-8517-d56a8b10a4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:16.673833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c712c83-733e-4ffe-8517-d56a8b10a4ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:16.674577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c712c83-733e-4ffe-8517-d56a8b10a4ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:16.677369 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c712c83-733e-4ffe-8517-d56a8b10a4ac admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:16.717625 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1273/2550] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:36:16 2022] POST /identity/v3/projects => generated 365 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:16.721729 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bac37c-b27f-4e5c-83ff-966e7004a5ff admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:16.735961 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bac37c-b27f-4e5c-83ff-966e7004a5ff admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:16.802625 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4db1ee-ff54-45d8-a5a4-d474685b992b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:16.803234 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4db1ee-ff54-45d8-a5a4-d474685b992b admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:16.803516 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4db1ee-ff54-45d8-a5a4-d474685b992b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:16.803788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4db1ee-ff54-45d8-a5a4-d474685b992b admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:16.804469 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4db1ee-ff54-45d8-a5a4-d474685b992b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:16.806864 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4db1ee-ff54-45d8-a5a4-d474685b992b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:16.833133 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1278/2551] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:36:16 2022] POST /identity/v3/users => generated 283 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:16.836622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c712c83-733e-4ffe-8517-d56a8b10a4ac admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:16.849582 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c712c83-733e-4ffe-8517-d56a8b10a4ac admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:16.855327 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8666c3-824a-439c-ac40-d96185f6a639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:16.856186 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8666c3-824a-439c-ac40-d96185f6a639 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:16.856304 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8666c3-824a-439c-ac40-d96185f6a639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:16.856479 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8666c3-824a-439c-ac40-d96185f6a639 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:16.857170 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8666c3-824a-439c-ac40-d96185f6a639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:16.858970 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8666c3-824a-439c-ac40-d96185f6a639 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:16.875066 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1274/2552] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:16.876106 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4db1ee-ff54-45d8-a5a4-d474685b992b admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:16.892060 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4db1ee-ff54-45d8-a5a4-d474685b992b admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:16.903507 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff4f63-8ea5-4c08-b713-1fe2b66a40bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:16.904198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff4f63-8ea5-4c08-b713-1fe2b66a40bd admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:16.904575 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff4f63-8ea5-4c08-b713-1fe2b66a40bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:16.905070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff4f63-8ea5-4c08-b713-1fe2b66a40bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:16.907613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff4f63-8ea5-4c08-b713-1fe2b66a40bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:16.912412 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff4f63-8ea5-4c08-b713-1fe2b66a40bd admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:16.928623 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1279/2553] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:16.932750 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8666c3-824a-439c-ac40-d96185f6a639 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:16.944019 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8666c3-824a-439c-ac40-d96185f6a639 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:16.950502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06d4df-18da-4d60-b3d5-2e7c30398dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:16.951190 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06d4df-18da-4d60-b3d5-2e7c30398dab admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:16.951593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06d4df-18da-4d60-b3d5-2e7c30398dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:16.951875 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06d4df-18da-4d60-b3d5-2e7c30398dab admin admin] PATH_INFO: `/v3/projects/352b00746c734712872830e8c4b85a4c/users/d9653c472e3b415980d6b505fb240491/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:16.972146 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06d4df-18da-4d60-b3d5-2e7c30398dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=352b00746c734712872830e8c4b85a4c, user_id=d9653c472e3b415980d6b505fb240491, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:16.974931 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06d4df-18da-4d60-b3d5-2e7c30398dab admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:16.997542 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1275/2554] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:36:16 2022] PUT /identity/v3/projects/352b00746c734712872830e8c4b85a4c/users/d9653c472e3b415980d6b505fb240491/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:36:17.008665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e018e4e-ee26-446f-8353-89fdb9977f1f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:17.008958 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e018e4e-ee26-446f-8353-89fdb9977f1f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:17.009268 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e018e4e-ee26-446f-8353-89fdb9977f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:17.025272 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:17.047449 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-0e018e4e-ee26-446f-8353-89fdb9977f1f None None] MFA Rules not processed for user `d9653c472e3b415980d6b505fb240491`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:17.048994 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0e018e4e-ee26-446f-8353-89fdb9977f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:17.135889 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1280/2555] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:17.150273 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06d4df-18da-4d60-b3d5-2e7c30398dab admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:17.152629 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-aa06d4df-18da-4d60-b3d5-2e7c30398dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:17.217747 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06d4df-18da-4d60-b3d5-2e7c30398dab admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:17.222037 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87093e-185a-4c85-80e8-ec6862be4501 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:17.222687 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87093e-185a-4c85-80e8-ec6862be4501 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:17.222977 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87093e-185a-4c85-80e8-ec6862be4501 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:17.223256 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87093e-185a-4c85-80e8-ec6862be4501 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:17.232259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87093e-185a-4c85-80e8-ec6862be4501 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:17.233746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87093e-185a-4c85-80e8-ec6862be4501 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:17.243213 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1276/2556] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:17.443661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e018e4e-ee26-446f-8353-89fdb9977f1f None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:17.446284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0e018e4e-ee26-446f-8353-89fdb9977f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:17.521176 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e018e4e-ee26-446f-8353-89fdb9977f1f None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:17.526918 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d9836-f1fe-4354-b072-314e239bd205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:17.527577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d9836-f1fe-4354-b072-314e239bd205 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:17.533199 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d9836-f1fe-4354-b072-314e239bd205 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:17.533770 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d9836-f1fe-4354-b072-314e239bd205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:17.535713 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-666d9836-f1fe-4354-b072-314e239bd205 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:17.547171 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d9836-f1fe-4354-b072-314e239bd205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:17.548621 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d9836-f1fe-4354-b072-314e239bd205 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:17.561865 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1281/2557] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:20.349542 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87093e-185a-4c85-80e8-ec6862be4501 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:20.352150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-df87093e-185a-4c85-80e8-ec6862be4501 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:20.415628 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:20.461280 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87093e-185a-4c85-80e8-ec6862be4501 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:20.468735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e235fad-e55f-471d-bac8-8c90cc2f4b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:20.470341 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e235fad-e55f-471d-bac8-8c90cc2f4b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:20.470795 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e235fad-e55f-471d-bac8-8c90cc2f4b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:20.471526 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e235fad-e55f-471d-bac8-8c90cc2f4b06 admin admin] PATH_INFO: `/v3/users/0b20525bc3124888bbb1decbae15d3c2` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:20.473510 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e235fad-e55f-471d-bac8-8c90cc2f4b06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b20525bc3124888bbb1decbae15d3c2)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:20.477310 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e235fad-e55f-471d-bac8-8c90cc2f4b06 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:20.530674 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7e235fad-e55f-471d-bac8-8c90cc2f4b06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b20525bc3124888bbb1decbae15d3c2'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:20.549234 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7e235fad-e55f-471d-bac8-8c90cc2f4b06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b20525bc3124888bbb1decbae15d3c2'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:20.550047 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7e235fad-e55f-471d-bac8-8c90cc2f4b06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b20525bc3124888bbb1decbae15d3c2'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:20.565487 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7e235fad-e55f-471d-bac8-8c90cc2f4b06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b20525bc3124888bbb1decbae15d3c2'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:20.573169 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-7e235fad-e55f-471d-bac8-8c90cc2f4b06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b20525bc3124888bbb1decbae15d3c2'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:20.587913 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1277/2558] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:36:20 2022] DELETE /identity/v3/users/0b20525bc3124888bbb1decbae15d3c2 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:20.773542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d9836-f1fe-4354-b072-314e239bd205 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:20.787558 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d9836-f1fe-4354-b072-314e239bd205 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:20.851003 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970761ae-3c7c-4f5a-87dc-f66ce441d09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:20.851645 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970761ae-3c7c-4f5a-87dc-f66ce441d09c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:20.851926 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970761ae-3c7c-4f5a-87dc-f66ce441d09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:20.852197 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970761ae-3c7c-4f5a-87dc-f66ce441d09c admin admin] PATH_INFO: `/v3/projects/42954936b14c4efbb981cb4bced6fbe4` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:20.853412 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970761ae-3c7c-4f5a-87dc-f66ce441d09c admin admin] RBAC: Authorizing `identity:delete_project(project_id=42954936b14c4efbb981cb4bced6fbe4)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:20.855322 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970761ae-3c7c-4f5a-87dc-f66ce441d09c admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:20.896415 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:20.904651 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-970761ae-3c7c-4f5a-87dc-f66ce441d09c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42954936b14c4efbb981cb4bced6fbe4', 'request_id': 'req-970761ae-3c7c-4f5a-87dc-f66ce441d09c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:20.910320 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-970761ae-3c7c-4f5a-87dc-f66ce441d09c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42954936b14c4efbb981cb4bced6fbe4', 'request_id': 'req-970761ae-3c7c-4f5a-87dc-f66ce441d09c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:20.917100 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-970761ae-3c7c-4f5a-87dc-f66ce441d09c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42954936b14c4efbb981cb4bced6fbe4', 'request_id': 'req-970761ae-3c7c-4f5a-87dc-f66ce441d09c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:20.930925 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-970761ae-3c7c-4f5a-87dc-f66ce441d09c admin admin] The token cache is being invalidate because project 42954936b14c4efbb981cb4bced6fbe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:36:20.931195 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-970761ae-3c7c-4f5a-87dc-f66ce441d09c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:20.931867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-970761ae-3c7c-4f5a-87dc-f66ce441d09c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:20.933761 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1282/2559] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:36:20 2022] DELETE /identity/v3/projects/42954936b14c4efbb981cb4bced6fbe4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:20.938506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fb13c-008a-4345-87d1-1ddb0a2b966b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:20.938795 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fb13c-008a-4345-87d1-1ddb0a2b966b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:20.939073 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9fb13c-008a-4345-87d1-1ddb0a2b966b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:20.960029 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8a9fb13c-008a-4345-87d1-1ddb0a2b966b None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:20.961917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8a9fb13c-008a-4345-87d1-1ddb0a2b966b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:21.033908 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1278/2560] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:21.042120 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79157a3-de98-493e-adbd-37cefabb204a None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:21.042410 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79157a3-de98-493e-adbd-37cefabb204a None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:21.042695 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79157a3-de98-493e-adbd-37cefabb204a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:21.062340 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-a79157a3-de98-493e-adbd-37cefabb204a None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:21.063595 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a79157a3-de98-493e-adbd-37cefabb204a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:21.071556 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1283/2561] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:21.075741 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9fb13c-008a-4345-87d1-1ddb0a2b966b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:21.085838 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9fb13c-008a-4345-87d1-1ddb0a2b966b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:21.090672 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577f4c2-eb4a-444f-9033-151997e38f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:21.091284 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577f4c2-eb4a-444f-9033-151997e38f29 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:21.091651 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577f4c2-eb4a-444f-9033-151997e38f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:21.091911 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577f4c2-eb4a-444f-9033-151997e38f29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:21.092554 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577f4c2-eb4a-444f-9033-151997e38f29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:36:21.092855 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577f4c2-eb4a-444f-9033-151997e38f29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:21.094462 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577f4c2-eb4a-444f-9033-151997e38f29 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:21.106754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1279/2562] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:36:21.111243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79157a3-de98-493e-adbd-37cefabb204a None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:21.121081 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79157a3-de98-493e-adbd-37cefabb204a None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:21.125857 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd077cd-bcc8-4e62-981b-2e34c6204004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:21.126477 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd077cd-bcc8-4e62-981b-2e34c6204004 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:21.126757 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd077cd-bcc8-4e62-981b-2e34c6204004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:21.127030 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd077cd-bcc8-4e62-981b-2e34c6204004 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:21.127648 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd077cd-bcc8-4e62-981b-2e34c6204004 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:21.129593 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd077cd-bcc8-4e62-981b-2e34c6204004 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:21.156868 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1284/2563] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:36:21 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:21.160972 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577f4c2-eb4a-444f-9033-151997e38f29 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:21.171602 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577f4c2-eb4a-444f-9033-151997e38f29 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:21.215720 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:21.230013 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379bf872-8140-495c-b807-5dd9fe15bc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:21.230617 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bf872-8140-495c-b807-5dd9fe15bc23 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:21.230898 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bf872-8140-495c-b807-5dd9fe15bc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:21.231172 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379bf872-8140-495c-b807-5dd9fe15bc23 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:21.231795 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379bf872-8140-495c-b807-5dd9fe15bc23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:21.233766 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379bf872-8140-495c-b807-5dd9fe15bc23 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:21.255398 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1280/2564] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:36:21 2022] POST /identity/v3/users => generated 303 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:21.259520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd077cd-bcc8-4e62-981b-2e34c6204004 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:21.270032 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd077cd-bcc8-4e62-981b-2e34c6204004 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:21.274557 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc237f7-eb22-41d8-bd28-90e1581f9197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:21.275150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc237f7-eb22-41d8-bd28-90e1581f9197 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:21.275427 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc237f7-eb22-41d8-bd28-90e1581f9197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:21.275695 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc237f7-eb22-41d8-bd28-90e1581f9197 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:21.276325 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc237f7-eb22-41d8-bd28-90e1581f9197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:21.277935 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc237f7-eb22-41d8-bd28-90e1581f9197 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:21.287752 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1285/2565] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:21.292044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379bf872-8140-495c-b807-5dd9fe15bc23 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:21.302253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379bf872-8140-495c-b807-5dd9fe15bc23 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:21.307384 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b43853-c0ca-440c-ae10-2f2485a9f192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:21.307971 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b43853-c0ca-440c-ae10-2f2485a9f192 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:21.308254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b43853-c0ca-440c-ae10-2f2485a9f192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:21.308527 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b43853-c0ca-440c-ae10-2f2485a9f192 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:21.309205 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b43853-c0ca-440c-ae10-2f2485a9f192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:21.310864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b43853-c0ca-440c-ae10-2f2485a9f192 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:21.321290 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1281/2566] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:21.325476 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc237f7-eb22-41d8-bd28-90e1581f9197 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:21.335229 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc237f7-eb22-41d8-bd28-90e1581f9197 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:21.339841 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900b0ee-99d5-429a-9e6c-793f965c7e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:21.340477 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900b0ee-99d5-429a-9e6c-793f965c7e13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:21.340753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900b0ee-99d5-429a-9e6c-793f965c7e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:21.341048 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900b0ee-99d5-429a-9e6c-793f965c7e13 admin admin] PATH_INFO: `/v3/projects/4797d740dff9429ab24284f60bfbdd9b/users/5c46d0f4c9b946d7a3889c9e7d4e2a82/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:21.356411 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900b0ee-99d5-429a-9e6c-793f965c7e13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4797d740dff9429ab24284f60bfbdd9b, user_id=5c46d0f4c9b946d7a3889c9e7d4e2a82, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:21.359140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900b0ee-99d5-429a-9e6c-793f965c7e13 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:21.376552 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1286/2567] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:36:21 2022] PUT /identity/v3/projects/4797d740dff9429ab24284f60bfbdd9b/users/5c46d0f4c9b946d7a3889c9e7d4e2a82/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:36:21.386757 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce924c-dfec-4f29-94a8-9b067d118bff None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:21.387282 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce924c-dfec-4f29-94a8-9b067d118bff None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:21.387394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce924c-dfec-4f29-94a8-9b067d118bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:21.416678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-92ce924c-dfec-4f29-94a8-9b067d118bff None None] MFA Rules not processed for user `5c46d0f4c9b946d7a3889c9e7d4e2a82`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:21.418278 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-92ce924c-dfec-4f29-94a8-9b067d118bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:21.494318 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1282/2568] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:21 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:21.498873 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900b0ee-99d5-429a-9e6c-793f965c7e13 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:21.574640 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900b0ee-99d5-429a-9e6c-793f965c7e13 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:21.579411 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec794794-abf4-45eb-a3b3-9ac60203835f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:21.580018 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec794794-abf4-45eb-a3b3-9ac60203835f admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:21.580301 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec794794-abf4-45eb-a3b3-9ac60203835f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:21.580575 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec794794-abf4-45eb-a3b3-9ac60203835f admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:21.581249 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec794794-abf4-45eb-a3b3-9ac60203835f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:21.583150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec794794-abf4-45eb-a3b3-9ac60203835f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:21.610337 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1287/2569] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:36:21 2022] POST /identity/v3/projects => generated 405 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:21.614642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce924c-dfec-4f29-94a8-9b067d118bff None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:21.626241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce924c-dfec-4f29-94a8-9b067d118bff None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:21.687815 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19588364-dbfe-45a3-989d-4173b4d7afdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:21.688439 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19588364-dbfe-45a3-989d-4173b4d7afdf admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:21.689316 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19588364-dbfe-45a3-989d-4173b4d7afdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:21.689612 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19588364-dbfe-45a3-989d-4173b4d7afdf admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:21.690373 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19588364-dbfe-45a3-989d-4173b4d7afdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:21.692160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19588364-dbfe-45a3-989d-4173b4d7afdf admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:21.718538 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1283/2570] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:36:21 2022] POST /identity/v3/users => generated 309 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:36:21.719701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec794794-abf4-45eb-a3b3-9ac60203835f admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:21.732528 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec794794-abf4-45eb-a3b3-9ac60203835f admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:21.737235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b37f0b-43e2-46ba-bec0-2795f8a82bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:21.737860 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b37f0b-43e2-46ba-bec0-2795f8a82bcd admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:21.738163 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b37f0b-43e2-46ba-bec0-2795f8a82bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:21.739274 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b37f0b-43e2-46ba-bec0-2795f8a82bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:21.740333 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b37f0b-43e2-46ba-bec0-2795f8a82bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:21.742443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b37f0b-43e2-46ba-bec0-2795f8a82bcd admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:21.762254 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1288/2571] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:21.763838 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19588364-dbfe-45a3-989d-4173b4d7afdf admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:21.774908 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19588364-dbfe-45a3-989d-4173b4d7afdf admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:21.779500 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b144b-b391-4bce-a88d-494beab45ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:21.780140 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b144b-b391-4bce-a88d-494beab45ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:21.780416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b144b-b391-4bce-a88d-494beab45ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:21.780686 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b144b-b391-4bce-a88d-494beab45ff3 admin admin] PATH_INFO: `/v3/projects/3efc65e3f6e9469b9430c54e5f95ebfa/users/d0cd3df2b55b4f7ebc0cd888c8d4790d/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:21.796454 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b144b-b391-4bce-a88d-494beab45ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3efc65e3f6e9469b9430c54e5f95ebfa, user_id=d0cd3df2b55b4f7ebc0cd888c8d4790d, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:21.799122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b144b-b391-4bce-a88d-494beab45ff3 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:21.815236 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1284/2572] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:36:21 2022] PUT /identity/v3/projects/3efc65e3f6e9469b9430c54e5f95ebfa/users/d0cd3df2b55b4f7ebc0cd888c8d4790d/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:21.819240 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b37f0b-43e2-46ba-bec0-2795f8a82bcd admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:21.830596 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b37f0b-43e2-46ba-bec0-2795f8a82bcd admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:21.877485 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:21.908305 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaef298-c8a6-4524-b4e6-dfe9c7e2918e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:21.909206 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaef298-c8a6-4524-b4e6-dfe9c7e2918e admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:21.909630 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaef298-c8a6-4524-b4e6-dfe9c7e2918e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:21.909965 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaef298-c8a6-4524-b4e6-dfe9c7e2918e admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:21.910841 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaef298-c8a6-4524-b4e6-dfe9c7e2918e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:21.913657 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaef298-c8a6-4524-b4e6-dfe9c7e2918e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:21.925135 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1289/2573] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:21.929263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b144b-b391-4bce-a88d-494beab45ff3 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:21.940482 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b144b-b391-4bce-a88d-494beab45ff3 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:21.946418 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b4a8f-0e16-46ae-a299-49dc108febdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:21.947073 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b4a8f-0e16-46ae-a299-49dc108febdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:21.947325 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b4a8f-0e16-46ae-a299-49dc108febdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:21.947598 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b4a8f-0e16-46ae-a299-49dc108febdf admin admin] PATH_INFO: `/v3/projects/3efc65e3f6e9469b9430c54e5f95ebfa/users/d0cd3df2b55b4f7ebc0cd888c8d4790d/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:21.949576 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b4a8f-0e16-46ae-a299-49dc108febdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3efc65e3f6e9469b9430c54e5f95ebfa, user_id=d0cd3df2b55b4f7ebc0cd888c8d4790d, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:21.956431 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b4a8f-0e16-46ae-a299-49dc108febdf admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:21.978123 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1285/2574] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:36:21 2022] PUT /identity/v3/projects/3efc65e3f6e9469b9430c54e5f95ebfa/users/d0cd3df2b55b4f7ebc0cd888c8d4790d/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:21.989534 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885ccef-d858-40e8-9fa8-ca53e7dcefdd None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:21.989647 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885ccef-d858-40e8-9fa8-ca53e7dcefdd None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:21.989865 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885ccef-d858-40e8-9fa8-ca53e7dcefdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:22.021999 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c885ccef-d858-40e8-9fa8-ca53e7dcefdd None None] MFA Rules not processed for user `d0cd3df2b55b4f7ebc0cd888c8d4790d`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:22.024172 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c885ccef-d858-40e8-9fa8-ca53e7dcefdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:22.096073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1290/2575] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:21 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:22.107502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b4a8f-0e16-46ae-a299-49dc108febdf admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:22.109284 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-971b4a8f-0e16-46ae-a299-49dc108febdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:22.124026 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:22.177186 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b4a8f-0e16-46ae-a299-49dc108febdf admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:22.178594 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1eb776-8deb-487a-9987-802cde009119 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:22.179757 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1eb776-8deb-487a-9987-802cde009119 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:22.180034 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1eb776-8deb-487a-9987-802cde009119 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:22.180301 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1eb776-8deb-487a-9987-802cde009119 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:22.189678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1eb776-8deb-487a-9987-802cde009119 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:22.191144 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1eb776-8deb-487a-9987-802cde009119 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:22.200739 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1286/2576] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:22 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:22.350181 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885ccef-d858-40e8-9fa8-ca53e7dcefdd None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:22.415569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885ccef-d858-40e8-9fa8-ca53e7dcefdd None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:22.420006 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e8290-68a7-4154-8177-77c181fdd750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:22.420628 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e8290-68a7-4154-8177-77c181fdd750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:22.420904 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e8290-68a7-4154-8177-77c181fdd750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:22.421202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e8290-68a7-4154-8177-77c181fdd750 admin admin] PATH_INFO: `/v3/users/5c46d0f4c9b946d7a3889c9e7d4e2a82` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:22.422301 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e8290-68a7-4154-8177-77c181fdd750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c46d0f4c9b946d7a3889c9e7d4e2a82)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:22.424189 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e8290-68a7-4154-8177-77c181fdd750 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:22.476378 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-068e8290-68a7-4154-8177-77c181fdd750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c46d0f4c9b946d7a3889c9e7d4e2a82'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:22.483518 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-068e8290-68a7-4154-8177-77c181fdd750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c46d0f4c9b946d7a3889c9e7d4e2a82'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:22.492280 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-068e8290-68a7-4154-8177-77c181fdd750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c46d0f4c9b946d7a3889c9e7d4e2a82'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:22.492888 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-068e8290-68a7-4154-8177-77c181fdd750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c46d0f4c9b946d7a3889c9e7d4e2a82'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:22.494180 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:22.508302 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-068e8290-68a7-4154-8177-77c181fdd750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c46d0f4c9b946d7a3889c9e7d4e2a82'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:22.514320 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1291/2577] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:36:22 2022] DELETE /identity/v3/users/5c46d0f4c9b946d7a3889c9e7d4e2a82 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:22.518874 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73eb558-6f95-4323-a19c-19d0c6dca4e1 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:22.519365 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73eb558-6f95-4323-a19c-19d0c6dca4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:22.519466 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73eb558-6f95-4323-a19c-19d0c6dca4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:22.538135 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e73eb558-6f95-4323-a19c-19d0c6dca4e1 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:22.539384 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e73eb558-6f95-4323-a19c-19d0c6dca4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:22.609547 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1287/2578] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:22.621897 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e8290-68a7-4154-8177-77c181fdd750 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:22.624202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-068e8290-68a7-4154-8177-77c181fdd750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:22.712810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e8290-68a7-4154-8177-77c181fdd750 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:22.717265 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d707202-faed-40b4-a44f-11fad0f359c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:22.717873 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d707202-faed-40b4-a44f-11fad0f359c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:22.718149 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d707202-faed-40b4-a44f-11fad0f359c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:22.718419 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d707202-faed-40b4-a44f-11fad0f359c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:22.730906 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d707202-faed-40b4-a44f-11fad0f359c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:22.732427 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d707202-faed-40b4-a44f-11fad0f359c1 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:22.742960 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1292/2579] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:36:23.027315 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73eb558-6f95-4323-a19c-19d0c6dca4e1 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:23.034030 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e73eb558-6f95-4323-a19c-19d0c6dca4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:23.054457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73eb558-6f95-4323-a19c-19d0c6dca4e1 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:23.059957 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4f005-9f03-4cfb-9e90-d96aeec37f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:23.060689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4f005-9f03-4cfb-9e90-d96aeec37f4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:23.061060 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4f005-9f03-4cfb-9e90-d96aeec37f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:23.061407 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4f005-9f03-4cfb-9e90-d96aeec37f4a admin admin] PATH_INFO: `/v3/projects/4797d740dff9429ab24284f60bfbdd9b` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:23.062652 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4f005-9f03-4cfb-9e90-d96aeec37f4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4797d740dff9429ab24284f60bfbdd9b)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:23.064552 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4f005-9f03-4cfb-9e90-d96aeec37f4a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:23.115225 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-79d4f005-9f03-4cfb-9e90-d96aeec37f4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4797d740dff9429ab24284f60bfbdd9b', 'request_id': 'req-79d4f005-9f03-4cfb-9e90-d96aeec37f4a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:23.124841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-79d4f005-9f03-4cfb-9e90-d96aeec37f4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4797d740dff9429ab24284f60bfbdd9b', 'request_id': 'req-79d4f005-9f03-4cfb-9e90-d96aeec37f4a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:23.131507 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-79d4f005-9f03-4cfb-9e90-d96aeec37f4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4797d740dff9429ab24284f60bfbdd9b', 'request_id': 'req-79d4f005-9f03-4cfb-9e90-d96aeec37f4a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:23.144501 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-79d4f005-9f03-4cfb-9e90-d96aeec37f4a admin admin] The token cache is being invalidate because project 4797d740dff9429ab24284f60bfbdd9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:36:23.144793 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-79d4f005-9f03-4cfb-9e90-d96aeec37f4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:23.145440 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-79d4f005-9f03-4cfb-9e90-d96aeec37f4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:23.147133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1288/2580] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:36:23 2022] DELETE /identity/v3/projects/4797d740dff9429ab24284f60bfbdd9b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:23.152107 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d707202-faed-40b4-a44f-11fad0f359c1 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:23.162906 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d707202-faed-40b4-a44f-11fad0f359c1 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:23.220894 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fc1eb-b59e-47d4-b220-3624b2950ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:23.221909 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fc1eb-b59e-47d4-b220-3624b2950ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:23.222189 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fc1eb-b59e-47d4-b220-3624b2950ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:23.222460 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fc1eb-b59e-47d4-b220-3624b2950ca8 admin admin] PATH_INFO: `/v3/users/d0cd3df2b55b4f7ebc0cd888c8d4790d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:23.223588 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8fc1eb-b59e-47d4-b220-3624b2950ca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0cd3df2b55b4f7ebc0cd888c8d4790d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:23.225591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8fc1eb-b59e-47d4-b220-3624b2950ca8 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:23.272450 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8c8fc1eb-b59e-47d4-b220-3624b2950ca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0cd3df2b55b4f7ebc0cd888c8d4790d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:23.279401 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8c8fc1eb-b59e-47d4-b220-3624b2950ca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0cd3df2b55b4f7ebc0cd888c8d4790d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:23.286184 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8c8fc1eb-b59e-47d4-b220-3624b2950ca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0cd3df2b55b4f7ebc0cd888c8d4790d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:23.286872 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8c8fc1eb-b59e-47d4-b220-3624b2950ca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0cd3df2b55b4f7ebc0cd888c8d4790d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:23.298623 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8c8fc1eb-b59e-47d4-b220-3624b2950ca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0cd3df2b55b4f7ebc0cd888c8d4790d'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:23.305177 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1293/2581] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:36:23 2022] DELETE /identity/v3/users/d0cd3df2b55b4f7ebc0cd888c8d4790d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:23.549284 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4f005-9f03-4cfb-9e90-d96aeec37f4a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:23.550745 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-79d4f005-9f03-4cfb-9e90-d96aeec37f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:23.586476 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fc1eb-b59e-47d4-b220-3624b2950ca8 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:23.588924 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8c8fc1eb-b59e-47d4-b220-3624b2950ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:23.601508 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:23.602444 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:23.645798 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4f005-9f03-4cfb-9e90-d96aeec37f4a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:23.672882 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fc1eb-b59e-47d4-b220-3624b2950ca8 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:23.677484 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5d8e3-f7a5-47de-b567-660ee677c67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:23.678110 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5d8e3-f7a5-47de-b567-660ee677c67b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:23.678390 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5d8e3-f7a5-47de-b567-660ee677c67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:23.678664 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5d8e3-f7a5-47de-b567-660ee677c67b admin admin] PATH_INFO: `/v3/projects/3efc65e3f6e9469b9430c54e5f95ebfa` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:23.679815 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5d8e3-f7a5-47de-b567-660ee677c67b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3efc65e3f6e9469b9430c54e5f95ebfa)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:23.681777 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5d8e3-f7a5-47de-b567-660ee677c67b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:23.712000 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90b283-ee29-424a-a437-248e603c9ae2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:23.712619 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90b283-ee29-424a-a437-248e603c9ae2 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:23.712898 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90b283-ee29-424a-a437-248e603c9ae2 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:23.713271 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90b283-ee29-424a-a437-248e603c9ae2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:23.715116 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7f90b283-ee29-424a-a437-248e603c9ae2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:23.729677 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90b283-ee29-424a-a437-248e603c9ae2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:23.731124 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90b283-ee29-424a-a437-248e603c9ae2 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:23.736828 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-02f5d8e3-f7a5-47de-b567-660ee677c67b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3efc65e3f6e9469b9430c54e5f95ebfa', 'request_id': 'req-02f5d8e3-f7a5-47de-b567-660ee677c67b'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:23.742489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-02f5d8e3-f7a5-47de-b567-660ee677c67b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3efc65e3f6e9469b9430c54e5f95ebfa', 'request_id': 'req-02f5d8e3-f7a5-47de-b567-660ee677c67b'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:23.743467 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1289/2582] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:23.748701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-02f5d8e3-f7a5-47de-b567-660ee677c67b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3efc65e3f6e9469b9430c54e5f95ebfa', 'request_id': 'req-02f5d8e3-f7a5-47de-b567-660ee677c67b'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:23.767558 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-02f5d8e3-f7a5-47de-b567-660ee677c67b admin admin] The token cache is being invalidate because project 3efc65e3f6e9469b9430c54e5f95ebfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:36:23.769430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-02f5d8e3-f7a5-47de-b567-660ee677c67b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:23.769966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-02f5d8e3-f7a5-47de-b567-660ee677c67b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:23.780030 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed47a6c-d992-4718-a936-8d44a74c7df7 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:23.780321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed47a6c-d992-4718-a936-8d44a74c7df7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:23.780779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed47a6c-d992-4718-a936-8d44a74c7df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:23.783751 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1294/2583] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:36:23 2022] DELETE /identity/v3/projects/3efc65e3f6e9469b9430c54e5f95ebfa => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:36:23.808758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-4ed47a6c-d992-4718-a936-8d44a74c7df7 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:23.810148 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4ed47a6c-d992-4718-a936-8d44a74c7df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:23.892159 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1290/2584] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:23.896639 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ceb6ff-cce9-4e8f-982c-7a5cda340d32 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:23.897275 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ceb6ff-cce9-4e8f-982c-7a5cda340d32 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:23.897634 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ceb6ff-cce9-4e8f-982c-7a5cda340d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:23.929391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-d8ceb6ff-cce9-4e8f-982c-7a5cda340d32 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:23.930739 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d8ceb6ff-cce9-4e8f-982c-7a5cda340d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:23.941069 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1295/2585] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:23.950202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed47a6c-d992-4718-a936-8d44a74c7df7 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:23.963297 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed47a6c-d992-4718-a936-8d44a74c7df7 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:23.981053 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f227c-b052-410b-93ed-67cdd745e9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:23.981778 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f227c-b052-410b-93ed-67cdd745e9fe admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:23.982119 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f227c-b052-410b-93ed-67cdd745e9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:23.982771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f227c-b052-410b-93ed-67cdd745e9fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:23.983069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f227c-b052-410b-93ed-67cdd745e9fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:36:23.983545 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f227c-b052-410b-93ed-67cdd745e9fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:23.985270 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f227c-b052-410b-93ed-67cdd745e9fe admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:24.003742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1291/2586] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:36:24.005507 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ceb6ff-cce9-4e8f-982c-7a5cda340d32 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:24.015647 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ceb6ff-cce9-4e8f-982c-7a5cda340d32 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:24.020668 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d1bc6-10b2-4183-94d6-2ed9f27882f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:24.021334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d1bc6-10b2-4183-94d6-2ed9f27882f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:24.021643 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d1bc6-10b2-4183-94d6-2ed9f27882f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:24.021915 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d1bc6-10b2-4183-94d6-2ed9f27882f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:24.023063 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d1bc6-10b2-4183-94d6-2ed9f27882f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:24.024987 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d1bc6-10b2-4183-94d6-2ed9f27882f5 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:24.052454 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1296/2587] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:36:24 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:24.056823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f227c-b052-410b-93ed-67cdd745e9fe admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:24.068872 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f227c-b052-410b-93ed-67cdd745e9fe admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:24.116290 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=100 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:24.129187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42587218-8bb0-49c6-b137-7407544e736e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:24.129815 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42587218-8bb0-49c6-b137-7407544e736e admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:24.130093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42587218-8bb0-49c6-b137-7407544e736e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:24.130388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42587218-8bb0-49c6-b137-7407544e736e admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:24.131002 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42587218-8bb0-49c6-b137-7407544e736e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:24.133458 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42587218-8bb0-49c6-b137-7407544e736e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:24.154362 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1292/2588] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:36:24 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:36:24.158600 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d1bc6-10b2-4183-94d6-2ed9f27882f5 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:24.169104 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d1bc6-10b2-4183-94d6-2ed9f27882f5 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:24.173913 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5bd15-5b51-4bc1-9636-524aed96d540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:24.174502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5bd15-5b51-4bc1-9636-524aed96d540 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:24.174779 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5bd15-5b51-4bc1-9636-524aed96d540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:24.175053 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5bd15-5b51-4bc1-9636-524aed96d540 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:24.175687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5bd15-5b51-4bc1-9636-524aed96d540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:24.177284 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5bd15-5b51-4bc1-9636-524aed96d540 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:24.187936 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1297/2589] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:24.191880 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42587218-8bb0-49c6-b137-7407544e736e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:24.203053 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42587218-8bb0-49c6-b137-7407544e736e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:24.207726 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5268f-8b5a-44c0-bbc7-600e2db2b0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:24.208320 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5268f-8b5a-44c0-bbc7-600e2db2b0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:24.208597 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5268f-8b5a-44c0-bbc7-600e2db2b0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:24.208864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5268f-8b5a-44c0-bbc7-600e2db2b0f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:24.209533 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5268f-8b5a-44c0-bbc7-600e2db2b0f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:24.211167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5268f-8b5a-44c0-bbc7-600e2db2b0f7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:24.222158 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1293/2590] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:24.226932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5bd15-5b51-4bc1-9636-524aed96d540 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:24.236676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5bd15-5b51-4bc1-9636-524aed96d540 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:24.241292 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc655ff-3e33-4df9-a1cb-ba875b9f9324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:24.242444 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc655ff-3e33-4df9-a1cb-ba875b9f9324 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:24.242719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc655ff-3e33-4df9-a1cb-ba875b9f9324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:24.242982 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc655ff-3e33-4df9-a1cb-ba875b9f9324 admin admin] PATH_INFO: `/v3/projects/b6e74f8b3e3a4a4a9cda629d618008cc/users/3be510e3ee9b47839765299de839bad4/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:24.256847 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc655ff-3e33-4df9-a1cb-ba875b9f9324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e74f8b3e3a4a4a9cda629d618008cc, user_id=3be510e3ee9b47839765299de839bad4, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:24.259808 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc655ff-3e33-4df9-a1cb-ba875b9f9324 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:24.272007 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1298/2591] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:36:24 2022] PUT /identity/v3/projects/b6e74f8b3e3a4a4a9cda629d618008cc/users/3be510e3ee9b47839765299de839bad4/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:24.282416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783415a0-6e4c-4b42-ade6-f2672110036b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:24.282644 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783415a0-6e4c-4b42-ade6-f2672110036b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:24.282924 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783415a0-6e4c-4b42-ade6-f2672110036b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:24.311185 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-783415a0-6e4c-4b42-ade6-f2672110036b None None] MFA Rules not processed for user `3be510e3ee9b47839765299de839bad4`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:24.312392 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-783415a0-6e4c-4b42-ade6-f2672110036b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:24.374342 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1294/2592] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:24.378876 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc655ff-3e33-4df9-a1cb-ba875b9f9324 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:24.409377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:24.441295 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc655ff-3e33-4df9-a1cb-ba875b9f9324 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:24.446407 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b45b0f-0629-4d54-b2ae-0cb55702321b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:24.447004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b45b0f-0629-4d54-b2ae-0cb55702321b admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:24.447285 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b45b0f-0629-4d54-b2ae-0cb55702321b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:24.447561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b45b0f-0629-4d54-b2ae-0cb55702321b admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:24.448200 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b45b0f-0629-4d54-b2ae-0cb55702321b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:24.450119 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b45b0f-0629-4d54-b2ae-0cb55702321b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:24.477659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1299/2593] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:36:24 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:24.481778 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783415a0-6e4c-4b42-ade6-f2672110036b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:24.492965 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783415a0-6e4c-4b42-ade6-f2672110036b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:24.549633 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed039a9-9c58-4d43-8543-476b12f8a8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:24.550202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed039a9-9c58-4d43-8543-476b12f8a8be admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:24.550469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed039a9-9c58-4d43-8543-476b12f8a8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:24.550744 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed039a9-9c58-4d43-8543-476b12f8a8be admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:24.551372 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed039a9-9c58-4d43-8543-476b12f8a8be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:24.553335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed039a9-9c58-4d43-8543-476b12f8a8be admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:24.572960 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1295/2594] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:36:24 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:24.576886 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b45b0f-0629-4d54-b2ae-0cb55702321b admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:24.587577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b45b0f-0629-4d54-b2ae-0cb55702321b admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:24.592171 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f90d6-2fea-462a-9f2a-4db52c0f527b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:24.592767 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f90d6-2fea-462a-9f2a-4db52c0f527b admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:24.593078 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f90d6-2fea-462a-9f2a-4db52c0f527b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:24.593357 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f90d6-2fea-462a-9f2a-4db52c0f527b admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:24.593998 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f90d6-2fea-462a-9f2a-4db52c0f527b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:24.595569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f90d6-2fea-462a-9f2a-4db52c0f527b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:24.606711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1300/2595] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:24.610648 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed039a9-9c58-4d43-8543-476b12f8a8be admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:24.621102 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed039a9-9c58-4d43-8543-476b12f8a8be admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:24.625642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7992f7-5245-4806-85c1-a03024486624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:24.626276 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7992f7-5245-4806-85c1-a03024486624 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:24.626553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7992f7-5245-4806-85c1-a03024486624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:24.626823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7992f7-5245-4806-85c1-a03024486624 admin admin] PATH_INFO: `/v3/projects/8763c289918942f88f4587039a375d34/users/496eff4913664d2a913b060354e04cc6/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:24.641740 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7992f7-5245-4806-85c1-a03024486624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8763c289918942f88f4587039a375d34, user_id=496eff4913664d2a913b060354e04cc6, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:24.644385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7992f7-5245-4806-85c1-a03024486624 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:24.659094 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1296/2596] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:36:24 2022] PUT /identity/v3/projects/8763c289918942f88f4587039a375d34/users/496eff4913664d2a913b060354e04cc6/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:36:24.662959 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f90d6-2fea-462a-9f2a-4db52c0f527b admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:24.674035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f90d6-2fea-462a-9f2a-4db52c0f527b admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:24.731514 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5653cb1-7d56-4bbd-af36-4f7071dd7e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:24.732119 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5653cb1-7d56-4bbd-af36-4f7071dd7e2d admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:24.732397 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5653cb1-7d56-4bbd-af36-4f7071dd7e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:24.732667 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5653cb1-7d56-4bbd-af36-4f7071dd7e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:24.733340 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5653cb1-7d56-4bbd-af36-4f7071dd7e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:24.734967 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5653cb1-7d56-4bbd-af36-4f7071dd7e2d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:24.744444 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1301/2597] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:36:24.748828 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7992f7-5245-4806-85c1-a03024486624 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:24.759355 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7992f7-5245-4806-85c1-a03024486624 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:24.764537 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c2c89-7614-46a0-8dbb-bd196cd8a57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:24.765224 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c2c89-7614-46a0-8dbb-bd196cd8a57e admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:24.765506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c2c89-7614-46a0-8dbb-bd196cd8a57e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:24.765779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c2c89-7614-46a0-8dbb-bd196cd8a57e admin admin] PATH_INFO: `/v3/projects/8763c289918942f88f4587039a375d34/users/496eff4913664d2a913b060354e04cc6/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:24.767672 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c2c89-7614-46a0-8dbb-bd196cd8a57e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8763c289918942f88f4587039a375d34, user_id=496eff4913664d2a913b060354e04cc6, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:24.770349 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c2c89-7614-46a0-8dbb-bd196cd8a57e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:24.780941 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1297/2598] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:36:24 2022] PUT /identity/v3/projects/8763c289918942f88f4587039a375d34/users/496eff4913664d2a913b060354e04cc6/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:24.793092 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4fc76-fd00-4e23-a59c-96d3e67182c6 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:24.793388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4fc76-fd00-4e23-a59c-96d3e67182c6 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:24.793668 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4fc76-fd00-4e23-a59c-96d3e67182c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:24.821254 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-0bb4fc76-fd00-4e23-a59c-96d3e67182c6 None None] MFA Rules not processed for user `496eff4913664d2a913b060354e04cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:24.822453 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0bb4fc76-fd00-4e23-a59c-96d3e67182c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:24.891223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1302/2599] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:24.902973 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c2c89-7614-46a0-8dbb-bd196cd8a57e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:24.904696 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c61c2c89-7614-46a0-8dbb-bd196cd8a57e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:24.915805 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:24.969614 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c2c89-7614-46a0-8dbb-bd196cd8a57e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:24.976634 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c95a6-09a5-4f4c-a288-cfebde49688d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:24.977277 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c95a6-09a5-4f4c-a288-cfebde49688d service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:24.977716 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c95a6-09a5-4f4c-a288-cfebde49688d service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:24.978009 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c95a6-09a5-4f4c-a288-cfebde49688d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:24.991838 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c95a6-09a5-4f4c-a288-cfebde49688d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:24.993691 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c95a6-09a5-4f4c-a288-cfebde49688d service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:25.003823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1298/2600] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:24 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:25.033152 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4fc76-fd00-4e23-a59c-96d3e67182c6 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:25.066056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:25.115408 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4fc76-fd00-4e23-a59c-96d3e67182c6 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:25.120865 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea25f22-463e-4051-a278-92ff5e4b8cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:25.121744 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea25f22-463e-4051-a278-92ff5e4b8cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:25.122147 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea25f22-463e-4051-a278-92ff5e4b8cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:25.122564 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea25f22-463e-4051-a278-92ff5e4b8cfd admin admin] PATH_INFO: `/v3/users/3be510e3ee9b47839765299de839bad4` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:25.123972 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea25f22-463e-4051-a278-92ff5e4b8cfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3be510e3ee9b47839765299de839bad4)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:25.126183 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea25f22-463e-4051-a278-92ff5e4b8cfd admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:25.178344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dea25f22-463e-4051-a278-92ff5e4b8cfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3be510e3ee9b47839765299de839bad4'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:25.186069 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dea25f22-463e-4051-a278-92ff5e4b8cfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3be510e3ee9b47839765299de839bad4'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:25.193571 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dea25f22-463e-4051-a278-92ff5e4b8cfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3be510e3ee9b47839765299de839bad4'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:25.194229 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dea25f22-463e-4051-a278-92ff5e4b8cfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3be510e3ee9b47839765299de839bad4'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:25.205977 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dea25f22-463e-4051-a278-92ff5e4b8cfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3be510e3ee9b47839765299de839bad4'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:25.215051 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1303/2601] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:36:25 2022] DELETE /identity/v3/users/3be510e3ee9b47839765299de839bad4 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:25.216223 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8e0b1-7428-46d6-af90-c1434afa34f9 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:25.216507 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8e0b1-7428-46d6-af90-c1434afa34f9 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:25.216780 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8e0b1-7428-46d6-af90-c1434afa34f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:25.237488 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-76d8e0b1-7428-46d6-af90-c1434afa34f9 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:25.238953 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-76d8e0b1-7428-46d6-af90-c1434afa34f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:25.297459 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1299/2602] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:25.307430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea25f22-463e-4051-a278-92ff5e4b8cfd admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:25.308816 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-dea25f22-463e-4051-a278-92ff5e4b8cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:25.365688 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea25f22-463e-4051-a278-92ff5e4b8cfd admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:25.369183 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7b937-b2af-4cdc-8f07-ca4b854fce6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:25.369777 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7b937-b2af-4cdc-8f07-ca4b854fce6e service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:25.370056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7b937-b2af-4cdc-8f07-ca4b854fce6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:25.370323 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7b937-b2af-4cdc-8f07-ca4b854fce6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:25.379048 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7b937-b2af-4cdc-8f07-ca4b854fce6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:25.380544 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7b937-b2af-4cdc-8f07-ca4b854fce6e service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:25.389816 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1304/2603] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:25.662250 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8e0b1-7428-46d6-af90-c1434afa34f9 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:25.664234 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-76d8e0b1-7428-46d6-af90-c1434afa34f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:25.680146 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8e0b1-7428-46d6-af90-c1434afa34f9 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:25.685663 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e618ddf-d34e-44e4-8514-28d0fbc4c0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:25.686333 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e618ddf-d34e-44e4-8514-28d0fbc4c0a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:25.686610 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e618ddf-d34e-44e4-8514-28d0fbc4c0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:25.686880 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e618ddf-d34e-44e4-8514-28d0fbc4c0a7 admin admin] PATH_INFO: `/v3/projects/b6e74f8b3e3a4a4a9cda629d618008cc` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:25.688064 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e618ddf-d34e-44e4-8514-28d0fbc4c0a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6e74f8b3e3a4a4a9cda629d618008cc)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:25.690118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e618ddf-d34e-44e4-8514-28d0fbc4c0a7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:25.745066 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4e618ddf-d34e-44e4-8514-28d0fbc4c0a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6e74f8b3e3a4a4a9cda629d618008cc', 'request_id': 'req-4e618ddf-d34e-44e4-8514-28d0fbc4c0a7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:25.751563 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4e618ddf-d34e-44e4-8514-28d0fbc4c0a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6e74f8b3e3a4a4a9cda629d618008cc', 'request_id': 'req-4e618ddf-d34e-44e4-8514-28d0fbc4c0a7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:25.758688 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4e618ddf-d34e-44e4-8514-28d0fbc4c0a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6e74f8b3e3a4a4a9cda629d618008cc', 'request_id': 'req-4e618ddf-d34e-44e4-8514-28d0fbc4c0a7'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:25.772847 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4e618ddf-d34e-44e4-8514-28d0fbc4c0a7 admin admin] The token cache is being invalidate because project b6e74f8b3e3a4a4a9cda629d618008cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:36:25.773184 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4e618ddf-d34e-44e4-8514-28d0fbc4c0a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:25.773852 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4e618ddf-d34e-44e4-8514-28d0fbc4c0a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:25.775519 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1300/2604] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:36:25 2022] DELETE /identity/v3/projects/b6e74f8b3e3a4a4a9cda629d618008cc => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:36:25.779606 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7b937-b2af-4cdc-8f07-ca4b854fce6e service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:25.790504 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7b937-b2af-4cdc-8f07-ca4b854fce6e service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:25.844796 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:25.860484 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a55c0-691c-4233-84b5-0319dd18dac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:25.861154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a55c0-691c-4233-84b5-0319dd18dac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:25.861435 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a55c0-691c-4233-84b5-0319dd18dac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:25.861731 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a55c0-691c-4233-84b5-0319dd18dac8 admin admin] PATH_INFO: `/v3/users/496eff4913664d2a913b060354e04cc6` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:25.862858 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a55c0-691c-4233-84b5-0319dd18dac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=496eff4913664d2a913b060354e04cc6)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:25.864771 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a55c0-691c-4233-84b5-0319dd18dac8 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:25.912949 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-699a55c0-691c-4233-84b5-0319dd18dac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '496eff4913664d2a913b060354e04cc6'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:25.919846 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-699a55c0-691c-4233-84b5-0319dd18dac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '496eff4913664d2a913b060354e04cc6'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:25.927148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-699a55c0-691c-4233-84b5-0319dd18dac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '496eff4913664d2a913b060354e04cc6'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:25.927790 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-699a55c0-691c-4233-84b5-0319dd18dac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '496eff4913664d2a913b060354e04cc6'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:25.939457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-699a55c0-691c-4233-84b5-0319dd18dac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '496eff4913664d2a913b060354e04cc6'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:25.945785 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1305/2605] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:36:25 2022] DELETE /identity/v3/users/496eff4913664d2a913b060354e04cc6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:26.020885 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e618ddf-d34e-44e4-8514-28d0fbc4c0a7 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:26.023046 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4e618ddf-d34e-44e4-8514-28d0fbc4c0a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:26.036006 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e618ddf-d34e-44e4-8514-28d0fbc4c0a7 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:26.067640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:26.105365 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275cf62-db53-4824-bfed-0d81c1b3a071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:26.106034 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275cf62-db53-4824-bfed-0d81c1b3a071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:26.106311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275cf62-db53-4824-bfed-0d81c1b3a071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:26.106579 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275cf62-db53-4824-bfed-0d81c1b3a071 admin admin] PATH_INFO: `/v3/users/d9653c472e3b415980d6b505fb240491` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:26.107710 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2275cf62-db53-4824-bfed-0d81c1b3a071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9653c472e3b415980d6b505fb240491)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:26.109816 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2275cf62-db53-4824-bfed-0d81c1b3a071 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:26.162909 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2275cf62-db53-4824-bfed-0d81c1b3a071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9653c472e3b415980d6b505fb240491'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:26.171900 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2275cf62-db53-4824-bfed-0d81c1b3a071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9653c472e3b415980d6b505fb240491'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:26.172553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2275cf62-db53-4824-bfed-0d81c1b3a071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9653c472e3b415980d6b505fb240491'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:26.186036 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2275cf62-db53-4824-bfed-0d81c1b3a071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9653c472e3b415980d6b505fb240491'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:26.193468 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2275cf62-db53-4824-bfed-0d81c1b3a071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9653c472e3b415980d6b505fb240491'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:26.200076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1301/2606] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:36:26 2022] DELETE /identity/v3/users/d9653c472e3b415980d6b505fb240491 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:26.204922 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7daae2-cafe-4463-b73b-55a930d147af None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:26.205393 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7daae2-cafe-4463-b73b-55a930d147af None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:26.205506 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7daae2-cafe-4463-b73b-55a930d147af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:26.226351 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-ba7daae2-cafe-4463-b73b-55a930d147af None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:26.227900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ba7daae2-cafe-4463-b73b-55a930d147af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:26.228300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275cf62-db53-4824-bfed-0d81c1b3a071 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:26.229813 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2275cf62-db53-4824-bfed-0d81c1b3a071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:26.324616 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275cf62-db53-4824-bfed-0d81c1b3a071 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:26.327691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1306/2607] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:26.334513 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfc6bd-1da2-410c-96fd-f28cc39422f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:26.335197 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfc6bd-1da2-410c-96fd-f28cc39422f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:26.335473 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfc6bd-1da2-410c-96fd-f28cc39422f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:26.335741 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfc6bd-1da2-410c-96fd-f28cc39422f9 admin admin] PATH_INFO: `/v3/projects/8763c289918942f88f4587039a375d34` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:26.336908 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dfc6bd-1da2-410c-96fd-f28cc39422f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8763c289918942f88f4587039a375d34)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:26.338848 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dfc6bd-1da2-410c-96fd-f28cc39422f9 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:26.341781 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7daae2-cafe-4463-b73b-55a930d147af None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:26.343240 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ba7daae2-cafe-4463-b73b-55a930d147af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:26.393150 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-32dfc6bd-1da2-410c-96fd-f28cc39422f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8763c289918942f88f4587039a375d34', 'request_id': 'req-32dfc6bd-1da2-410c-96fd-f28cc39422f9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:26.398245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:26.400685 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-32dfc6bd-1da2-410c-96fd-f28cc39422f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8763c289918942f88f4587039a375d34', 'request_id': 'req-32dfc6bd-1da2-410c-96fd-f28cc39422f9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:26.409183 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-32dfc6bd-1da2-410c-96fd-f28cc39422f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8763c289918942f88f4587039a375d34', 'request_id': 'req-32dfc6bd-1da2-410c-96fd-f28cc39422f9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:26.431381 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7daae2-cafe-4463-b73b-55a930d147af None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:26.443845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-32dfc6bd-1da2-410c-96fd-f28cc39422f9 admin admin] The token cache is being invalidate because project 8763c289918942f88f4587039a375d34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:36:26.444158 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-32dfc6bd-1da2-410c-96fd-f28cc39422f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:26.445202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-32dfc6bd-1da2-410c-96fd-f28cc39422f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:26.449074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1302/2608] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:36:26 2022] DELETE /identity/v3/projects/8763c289918942f88f4587039a375d34 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:36:26.452264 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3a85a-c3e4-4285-9f9f-43b88e5747bb None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:26.452553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3a85a-c3e4-4285-9f9f-43b88e5747bb None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:26.452982 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3a85a-c3e4-4285-9f9f-43b88e5747bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:26.453617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:26.477328 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e1d3a85a-c3e4-4285-9f9f-43b88e5747bb None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:26.478959 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e1d3a85a-c3e4-4285-9f9f-43b88e5747bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:26.505645 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3ec78-c4a6-4bd2-bea4-ac4bfe475f04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:26.507858 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3ec78-c4a6-4bd2-bea4-ac4bfe475f04 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:26.508277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3ec78-c4a6-4bd2-bea4-ac4bfe475f04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:26.508562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3ec78-c4a6-4bd2-bea4-ac4bfe475f04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:26.510500 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-65d3ec78-c4a6-4bd2-bea4-ac4bfe475f04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:26.555794 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1303/2609] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:26.563081 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313e46c-c4a2-4277-bcee-4992c8a80a8e None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:26.563423 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313e46c-c4a2-4277-bcee-4992c8a80a8e None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:26.563832 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313e46c-c4a2-4277-bcee-4992c8a80a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:26.586330 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a313e46c-c4a2-4277-bcee-4992c8a80a8e None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:26.588294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a313e46c-c4a2-4277-bcee-4992c8a80a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:26.602557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1304/2610] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:26.604444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313e46c-c4a2-4277-bcee-4992c8a80a8e None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:26.606034 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3ec78-c4a6-4bd2-bea4-ac4bfe475f04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:26.607547 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3ec78-c4a6-4bd2-bea4-ac4bfe475f04 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:26.615676 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313e46c-c4a2-4277-bcee-4992c8a80a8e None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:26.621669 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3814ca-9eab-4e3d-a8ea-5a7b9a7cab11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:26.622718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3814ca-9eab-4e3d-a8ea-5a7b9a7cab11 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:26.623049 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1307/2611] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:36:26.623456 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3814ca-9eab-4e3d-a8ea-5a7b9a7cab11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:26.624059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3814ca-9eab-4e3d-a8ea-5a7b9a7cab11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:26.626293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3814ca-9eab-4e3d-a8ea-5a7b9a7cab11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:36:26.626775 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3814ca-9eab-4e3d-a8ea-5a7b9a7cab11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:26.628616 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3814ca-9eab-4e3d-a8ea-5a7b9a7cab11 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:26.644505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1305/2612] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:36:26.645757 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3ec78-c4a6-4bd2-bea4-ac4bfe475f04 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:26.665810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3ec78-c4a6-4bd2-bea4-ac4bfe475f04 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:26.673954 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd430b-55e5-4ddf-94d1-9817cdbd0962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:26.674799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd430b-55e5-4ddf-94d1-9817cdbd0962 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:26.674799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd430b-55e5-4ddf-94d1-9817cdbd0962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:26.675090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd430b-55e5-4ddf-94d1-9817cdbd0962 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:26.675809 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd430b-55e5-4ddf-94d1-9817cdbd0962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:26.678418 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd430b-55e5-4ddf-94d1-9817cdbd0962 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:26.712747 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1308/2613] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:36:26 2022] POST /identity/v3/projects => generated 381 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:26.717109 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3814ca-9eab-4e3d-a8ea-5a7b9a7cab11 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:26.731951 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3814ca-9eab-4e3d-a8ea-5a7b9a7cab11 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:26.805219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2741a17-e807-4ea7-8bd1-120b7b4b332d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:26.805588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2741a17-e807-4ea7-8bd1-120b7b4b332d admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:26.805868 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2741a17-e807-4ea7-8bd1-120b7b4b332d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:26.806138 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2741a17-e807-4ea7-8bd1-120b7b4b332d admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:26.806763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2741a17-e807-4ea7-8bd1-120b7b4b332d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:26.808768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2741a17-e807-4ea7-8bd1-120b7b4b332d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:26.834156 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1306/2614] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:36:26 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:36:26.838475 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd430b-55e5-4ddf-94d1-9817cdbd0962 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:26.855250 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd430b-55e5-4ddf-94d1-9817cdbd0962 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:26.860392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d090b-cdc7-4f2d-b08d-adc0ac77b6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:26.861112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d090b-cdc7-4f2d-b08d-adc0ac77b6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:26.861464 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d090b-cdc7-4f2d-b08d-adc0ac77b6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:26.861839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d090b-cdc7-4f2d-b08d-adc0ac77b6d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:26.862558 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d090b-cdc7-4f2d-b08d-adc0ac77b6d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:26.864249 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d090b-cdc7-4f2d-b08d-adc0ac77b6d8 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:26.878621 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1309/2615] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:26.883935 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2741a17-e807-4ea7-8bd1-120b7b4b332d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:26.896076 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2741a17-e807-4ea7-8bd1-120b7b4b332d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:26.901646 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b443f7-6653-4a5c-9547-afa9ecc1fbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:26.902273 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b443f7-6653-4a5c-9547-afa9ecc1fbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:26.902557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b443f7-6653-4a5c-9547-afa9ecc1fbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:26.902834 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b443f7-6653-4a5c-9547-afa9ecc1fbc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:26.903572 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b443f7-6653-4a5c-9547-afa9ecc1fbc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:26.914783 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b443f7-6653-4a5c-9547-afa9ecc1fbc7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:26.934561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1307/2616] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:26.938293 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d090b-cdc7-4f2d-b08d-adc0ac77b6d8 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:26.951398 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d090b-cdc7-4f2d-b08d-adc0ac77b6d8 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:26.957580 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020e5ac-9904-46cd-9e7b-151836429816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:26.957878 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020e5ac-9904-46cd-9e7b-151836429816 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:26.958114 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020e5ac-9904-46cd-9e7b-151836429816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:26.958471 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020e5ac-9904-46cd-9e7b-151836429816 admin admin] PATH_INFO: `/v3/projects/29d5e2b0e36041d5b6ef03ac02b09a90/users/59c7fcbfb52a47b5a0c92031409961a8/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:26.986888 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020e5ac-9904-46cd-9e7b-151836429816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29d5e2b0e36041d5b6ef03ac02b09a90, user_id=59c7fcbfb52a47b5a0c92031409961a8, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:26.989633 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020e5ac-9904-46cd-9e7b-151836429816 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:27.007078 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1310/2617] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:36:26 2022] PUT /identity/v3/projects/29d5e2b0e36041d5b6ef03ac02b09a90/users/59c7fcbfb52a47b5a0c92031409961a8/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:27.017335 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33c35c-b5a6-4c57-9c4e-9fe78e7ea4c9 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:27.017697 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33c35c-b5a6-4c57-9c4e-9fe78e7ea4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:27.017984 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33c35c-b5a6-4c57-9c4e-9fe78e7ea4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:27.051249 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-db33c35c-b5a6-4c57-9c4e-9fe78e7ea4c9 None None] MFA Rules not processed for user `59c7fcbfb52a47b5a0c92031409961a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:27.052914 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-db33c35c-b5a6-4c57-9c4e-9fe78e7ea4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:27.088857 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:27.137504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1308/2618] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:27.139291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020e5ac-9904-46cd-9e7b-151836429816 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:27.193167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33c35c-b5a6-4c57-9c4e-9fe78e7ea4c9 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:27.195369 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-db33c35c-b5a6-4c57-9c4e-9fe78e7ea4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:27.233971 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020e5ac-9904-46cd-9e7b-151836429816 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:27.239943 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831b234-4b80-4bfd-92c8-d2184a04dc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:27.240626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831b234-4b80-4bfd-92c8-d2184a04dc33 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:27.240977 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831b234-4b80-4bfd-92c8-d2184a04dc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:27.242672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831b234-4b80-4bfd-92c8-d2184a04dc33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:27.242672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831b234-4b80-4bfd-92c8-d2184a04dc33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:27.244463 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831b234-4b80-4bfd-92c8-d2184a04dc33 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:27.270187 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:27.281780 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1311/2619] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:36:27 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:27.281984 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33c35c-b5a6-4c57-9c4e-9fe78e7ea4c9 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:27.282923 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831b234-4b80-4bfd-92c8-d2184a04dc33 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:27.344755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba3efc-ef14-4c5c-a1a3-cde970862360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:27.345427 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba3efc-ef14-4c5c-a1a3-cde970862360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:27.345710 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba3efc-ef14-4c5c-a1a3-cde970862360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:27.346281 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba3efc-ef14-4c5c-a1a3-cde970862360 admin admin] PATH_INFO: `/v3/projects/352b00746c734712872830e8c4b85a4c` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:27.347470 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba3efc-ef14-4c5c-a1a3-cde970862360 admin admin] RBAC: Authorizing `identity:delete_project(project_id=352b00746c734712872830e8c4b85a4c)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:27.349453 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba3efc-ef14-4c5c-a1a3-cde970862360 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:27.355895 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831b234-4b80-4bfd-92c8-d2184a04dc33 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:27.361696 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1918045-d697-4e9b-b5ec-9fd351e21dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:27.362319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1918045-d697-4e9b-b5ec-9fd351e21dbe admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:27.362625 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1918045-d697-4e9b-b5ec-9fd351e21dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:27.362896 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1918045-d697-4e9b-b5ec-9fd351e21dbe admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:27.363533 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1918045-d697-4e9b-b5ec-9fd351e21dbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:27.365489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1918045-d697-4e9b-b5ec-9fd351e21dbe admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:27.389212 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1312/2620] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:36:27 2022] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:36:27.394989 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1918045-d697-4e9b-b5ec-9fd351e21dbe admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:27.407074 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1918045-d697-4e9b-b5ec-9fd351e21dbe admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:27.407259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4dba3efc-ef14-4c5c-a1a3-cde970862360 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '352b00746c734712872830e8c4b85a4c', 'request_id': 'req-4dba3efc-ef14-4c5c-a1a3-cde970862360'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:27.414022 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4dba3efc-ef14-4c5c-a1a3-cde970862360 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '352b00746c734712872830e8c4b85a4c', 'request_id': 'req-4dba3efc-ef14-4c5c-a1a3-cde970862360'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:27.420635 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4dba3efc-ef14-4c5c-a1a3-cde970862360 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '352b00746c734712872830e8c4b85a4c', 'request_id': 'req-4dba3efc-ef14-4c5c-a1a3-cde970862360'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:27.436298 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4dba3efc-ef14-4c5c-a1a3-cde970862360 admin admin] The token cache is being invalidate because project 352b00746c734712872830e8c4b85a4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:36:27.436516 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4dba3efc-ef14-4c5c-a1a3-cde970862360 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:27.437474 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4dba3efc-ef14-4c5c-a1a3-cde970862360 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:27.442374 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1309/2621] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:36:27 2022] DELETE /identity/v3/projects/352b00746c734712872830e8c4b85a4c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:27.443855 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06939372-dc16-4297-b1c7-b7bc1249684b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:27.445057 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06939372-dc16-4297-b1c7-b7bc1249684b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:27.445447 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06939372-dc16-4297-b1c7-b7bc1249684b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:27.466488 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-06939372-dc16-4297-b1c7-b7bc1249684b None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:27.467828 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-06939372-dc16-4297-b1c7-b7bc1249684b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:27.474234 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:27.477255 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1617e-f145-412f-a5cb-9df1bb739066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:27.478344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1617e-f145-412f-a5cb-9df1bb739066 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:27.479244 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1617e-f145-412f-a5cb-9df1bb739066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:27.479391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1617e-f145-412f-a5cb-9df1bb739066 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:27.480069 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be1617e-f145-412f-a5cb-9df1bb739066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:27.482030 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be1617e-f145-412f-a5cb-9df1bb739066 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:27.494659 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1313/2622] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:27.499619 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1617e-f145-412f-a5cb-9df1bb739066 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:27.501516 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6be1617e-f145-412f-a5cb-9df1bb739066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:27.515367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1617e-f145-412f-a5cb-9df1bb739066 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:27.520336 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608e34f-072a-4713-8a52-b80dacc4624d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:27.521111 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608e34f-072a-4713-8a52-b80dacc4624d admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:27.521334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608e34f-072a-4713-8a52-b80dacc4624d admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:27.521614 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608e34f-072a-4713-8a52-b80dacc4624d admin admin] PATH_INFO: `/v3/projects/dd5eece65a4b4b708b5f0b0706f38252/users/83f03710b1ca41e38c510c1709fe459b/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:27.539958 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608e34f-072a-4713-8a52-b80dacc4624d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5eece65a4b4b708b5f0b0706f38252, user_id=83f03710b1ca41e38c510c1709fe459b, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:27.542319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608e34f-072a-4713-8a52-b80dacc4624d admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:27.546269 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1310/2623] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:27.555861 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e703ee4-dd3a-4396-8a4c-27294bae9e8d None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:27.556207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e703ee4-dd3a-4396-8a4c-27294bae9e8d None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:27.556502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e703ee4-dd3a-4396-8a4c-27294bae9e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:27.560174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1314/2624] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:36:27 2022] PUT /identity/v3/projects/dd5eece65a4b4b708b5f0b0706f38252/users/83f03710b1ca41e38c510c1709fe459b/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:27.563772 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608e34f-072a-4713-8a52-b80dacc4624d admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:27.579271 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-2e703ee4-dd3a-4396-8a4c-27294bae9e8d None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:27.580506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2e703ee4-dd3a-4396-8a4c-27294bae9e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:27.635032 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608e34f-072a-4713-8a52-b80dacc4624d admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:27.640608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc593e-4066-4d4a-8976-0b1f4f0dca8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:27.641447 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc593e-4066-4d4a-8976-0b1f4f0dca8a admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:27.641907 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc593e-4066-4d4a-8976-0b1f4f0dca8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:27.642337 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc593e-4066-4d4a-8976-0b1f4f0dca8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:27.643138 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc593e-4066-4d4a-8976-0b1f4f0dca8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:27.644928 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc593e-4066-4d4a-8976-0b1f4f0dca8a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:27.648521 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:27.648698 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1311/2625] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:36:27.654006 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e703ee4-dd3a-4396-8a4c-27294bae9e8d None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:27.661803 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1315/2626] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:36:27.662649 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc593e-4066-4d4a-8976-0b1f4f0dca8a admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:27.665063 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e703ee4-dd3a-4396-8a4c-27294bae9e8d None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:27.670492 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20913b00-e54f-4450-88ee-a115da6271fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:27.670915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20913b00-e54f-4450-88ee-a115da6271fb admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:27.671290 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20913b00-e54f-4450-88ee-a115da6271fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:27.671656 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20913b00-e54f-4450-88ee-a115da6271fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:27.672372 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20913b00-e54f-4450-88ee-a115da6271fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:36:27.672741 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20913b00-e54f-4450-88ee-a115da6271fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:27.674442 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20913b00-e54f-4450-88ee-a115da6271fb admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:27.674689 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc593e-4066-4d4a-8976-0b1f4f0dca8a admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:27.681374 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6954082-dee4-426b-93b1-12fcb99c1cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:27.682341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6954082-dee4-426b-93b1-12fcb99c1cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:27.682630 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6954082-dee4-426b-93b1-12fcb99c1cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:27.682903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6954082-dee4-426b-93b1-12fcb99c1cf6 admin admin] PATH_INFO: `/v3/projects/dd5eece65a4b4b708b5f0b0706f38252/users/83f03710b1ca41e38c510c1709fe459b/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:27.685311 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6954082-dee4-426b-93b1-12fcb99c1cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5eece65a4b4b708b5f0b0706f38252, user_id=83f03710b1ca41e38c510c1709fe459b, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:27.687783 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1312/2627] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:36:27.688577 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6954082-dee4-426b-93b1-12fcb99c1cf6 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:27.695938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20913b00-e54f-4450-88ee-a115da6271fb admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:27.702079 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1316/2628] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:36:27 2022] PUT /identity/v3/projects/dd5eece65a4b4b708b5f0b0706f38252/users/83f03710b1ca41e38c510c1709fe459b/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:27.707552 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20913b00-e54f-4450-88ee-a115da6271fb admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:27.714193 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e103f20-98ea-431b-83ab-a3773cc3dd68 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:27.714540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e103f20-98ea-431b-83ab-a3773cc3dd68 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:27.714862 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e103f20-98ea-431b-83ab-a3773cc3dd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:27.747947 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-4e103f20-98ea-431b-83ab-a3773cc3dd68 None None] MFA Rules not processed for user `83f03710b1ca41e38c510c1709fe459b`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:27.749142 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4e103f20-98ea-431b-83ab-a3773cc3dd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:27.785331 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb853802-9cce-4a31-8110-f3a21bfcf1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:27.786025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb853802-9cce-4a31-8110-f3a21bfcf1cb admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:27.786558 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb853802-9cce-4a31-8110-f3a21bfcf1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:27.786558 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb853802-9cce-4a31-8110-f3a21bfcf1cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:27.787142 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb853802-9cce-4a31-8110-f3a21bfcf1cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:27.789092 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb853802-9cce-4a31-8110-f3a21bfcf1cb admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:27.821363 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1313/2629] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:36:27 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:27.825868 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb853802-9cce-4a31-8110-f3a21bfcf1cb admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:27.837490 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1317/2630] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:27 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:27.853174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e103f20-98ea-431b-83ab-a3773cc3dd68 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:27.854595 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4e103f20-98ea-431b-83ab-a3773cc3dd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:27.863543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:27.914196 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb853802-9cce-4a31-8110-f3a21bfcf1cb admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:27.918999 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42883bd8-cf42-4c9a-85ab-cb3953b4f699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:27.919692 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42883bd8-cf42-4c9a-85ab-cb3953b4f699 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:27.920001 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42883bd8-cf42-4c9a-85ab-cb3953b4f699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:27.920336 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42883bd8-cf42-4c9a-85ab-cb3953b4f699 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:27.921039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42883bd8-cf42-4c9a-85ab-cb3953b4f699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:27.923118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42883bd8-cf42-4c9a-85ab-cb3953b4f699 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:27.923430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e103f20-98ea-431b-83ab-a3773cc3dd68 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:27.951170 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1314/2631] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:36:27 2022] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:27.951170 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42883bd8-cf42-4c9a-85ab-cb3953b4f699 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:27.953052 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-42883bd8-cf42-4c9a-85ab-cb3953b4f699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:27.977978 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc3fd0-5418-47d1-997d-c5756d732f40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:27.978597 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc3fd0-5418-47d1-997d-c5756d732f40 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:27.978882 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc3fd0-5418-47d1-997d-c5756d732f40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:27.979156 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc3fd0-5418-47d1-997d-c5756d732f40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:28.027704 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:28.046627 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42883bd8-cf42-4c9a-85ab-cb3953b4f699 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:28.053465 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d17717-35ab-4acd-84d8-fcd2e36c79b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:28.054232 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d17717-35ab-4acd-84d8-fcd2e36c79b5 service nova] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:28.054516 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d17717-35ab-4acd-84d8-fcd2e36c79b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:28.054732 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc3fd0-5418-47d1-997d-c5756d732f40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:28.054847 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d17717-35ab-4acd-84d8-fcd2e36c79b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:28.056218 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc3fd0-5418-47d1-997d-c5756d732f40 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:28.056584 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-53d17717-35ab-4acd-84d8-fcd2e36c79b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:28.066919 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1318/2632] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:27 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:36:28.067547 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc3fd0-5418-47d1-997d-c5756d732f40 service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:28.069909 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d17717-35ab-4acd-84d8-fcd2e36c79b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:28.071585 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d17717-35ab-4acd-84d8-fcd2e36c79b5 service nova] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:28.080608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc3fd0-5418-47d1-997d-c5756d732f40 service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:28.085965 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1315/2633] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:28.091303 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42dba0-8daa-4c22-9140-0ac6533951a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:28.092784 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42dba0-8daa-4c22-9140-0ac6533951a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:28.093291 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42dba0-8daa-4c22-9140-0ac6533951a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:28.093725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42dba0-8daa-4c22-9140-0ac6533951a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:28.094705 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42dba0-8daa-4c22-9140-0ac6533951a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:28.096842 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42dba0-8daa-4c22-9140-0ac6533951a8 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:28.113207 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1319/2634] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:28.115115 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d17717-35ab-4acd-84d8-fcd2e36c79b5 service nova] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:28.126330 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d17717-35ab-4acd-84d8-fcd2e36c79b5 service nova] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:28.135767 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c7904-6b85-4328-972e-6843a415789f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:28.136496 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c7904-6b85-4328-972e-6843a415789f admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:28.136976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c7904-6b85-4328-972e-6843a415789f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:28.137425 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c7904-6b85-4328-972e-6843a415789f admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:28.138198 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c7904-6b85-4328-972e-6843a415789f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:28.140610 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c7904-6b85-4328-972e-6843a415789f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:28.153235 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1316/2635] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:28.157584 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42dba0-8daa-4c22-9140-0ac6533951a8 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:28.170288 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42dba0-8daa-4c22-9140-0ac6533951a8 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:28.176400 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1ef4b-d52e-4971-a24b-9103338eb590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:28.177166 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1ef4b-d52e-4971-a24b-9103338eb590 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:28.177453 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1ef4b-d52e-4971-a24b-9103338eb590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:28.177731 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1ef4b-d52e-4971-a24b-9103338eb590 admin admin] PATH_INFO: `/v3/projects/c4217a89c86e493197710c325b3cd182/users/1f17b54189db41b490b974ffb7c2699c/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:28.197357 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1ef4b-d52e-4971-a24b-9103338eb590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4217a89c86e493197710c325b3cd182, user_id=1f17b54189db41b490b974ffb7c2699c, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:28.200055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1ef4b-d52e-4971-a24b-9103338eb590 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:28.228237 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1320/2636] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:36:28 2022] PUT /identity/v3/projects/c4217a89c86e493197710c325b3cd182/users/1f17b54189db41b490b974ffb7c2699c/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:28.230330 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b41a0-d870-4b10-a8f7-f230246d0015 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:28.230645 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b41a0-d870-4b10-a8f7-f230246d0015 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:28.230883 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b41a0-d870-4b10-a8f7-f230246d0015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:28.266388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-6f2b41a0-d870-4b10-a8f7-f230246d0015 None None] MFA Rules not processed for user `1f17b54189db41b490b974ffb7c2699c`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:28.267772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6f2b41a0-d870-4b10-a8f7-f230246d0015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:28.354768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1317/2637] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:28.369357 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1ef4b-d52e-4971-a24b-9103338eb590 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:28.371346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-24f1ef4b-d52e-4971-a24b-9103338eb590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:28.451819 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1ef4b-d52e-4971-a24b-9103338eb590 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:28.457728 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d653d74-22c3-4554-bb35-e6f841c25ac9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fff294b9794a26aa1bbc231fa1133c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:28.458454 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d653d74-22c3-4554-bb35-e6f841c25ac9 service nova] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:28.458807 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d653d74-22c3-4554-bb35-e6f841c25ac9 service nova] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:28.459165 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d653d74-22c3-4554-bb35-e6f841c25ac9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:28.467469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b41a0-d870-4b10-a8f7-f230246d0015 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:28.468622 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d653d74-22c3-4554-bb35-e6f841c25ac9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:28.470274 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d653d74-22c3-4554-bb35-e6f841c25ac9 service nova] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:28.480488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1321/2638] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:28.498565 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:28.575848 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b41a0-d870-4b10-a8f7-f230246d0015 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:28.581723 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f1bbd-c0ff-4e5e-8e97-027ffbd4f2b5 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83f03710b1ca41e38c510c1709fe459b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5eece65a4b4b708b5f0b0706f38252', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:28.583067 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f1bbd-c0ff-4e5e-8e97-027ffbd4f2b5 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:28.583067 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f1bbd-c0ff-4e5e-8e97-027ffbd4f2b5 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:28.583067 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f1bbd-c0ff-4e5e-8e97-027ffbd4f2b5 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:28.583564 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f1bbd-c0ff-4e5e-8e97-027ffbd4f2b5 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:36:28.583879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f1bbd-c0ff-4e5e-8e97-027ffbd4f2b5 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:28.585915 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f1bbd-c0ff-4e5e-8e97-027ffbd4f2b5 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:28.603333 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1318/2639] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:36:28.604661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d653d74-22c3-4554-bb35-e6f841c25ac9 service nova] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:28.621294 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d653d74-22c3-4554-bb35-e6f841c25ac9 service nova] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:28.626264 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bde11-7b34-44b6-b631-5ee720123d57 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83f03710b1ca41e38c510c1709fe459b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5eece65a4b4b708b5f0b0706f38252', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:28.626893 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bde11-7b34-44b6-b631-5ee720123d57 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:28.627180 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bde11-7b34-44b6-b631-5ee720123d57 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:28.627463 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bde11-7b34-44b6-b631-5ee720123d57 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:28.628107 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bde11-7b34-44b6-b631-5ee720123d57 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:28.630912 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bde11-7b34-44b6-b631-5ee720123d57 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:28.681316 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1322/2640] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:36:28 2022] POST /identity/v3/projects => generated 354 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:28.683448 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f1bbd-c0ff-4e5e-8e97-027ffbd4f2b5 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:28.705254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f1bbd-c0ff-4e5e-8e97-027ffbd4f2b5 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:28.782371 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bde11-7b34-44b6-b631-5ee720123d57 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:28.798141 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e6f87-72a0-415d-87ec-d5fdd368c594 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83f03710b1ca41e38c510c1709fe459b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5eece65a4b4b708b5f0b0706f38252', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:28.798755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e6f87-72a0-415d-87ec-d5fdd368c594 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:28.799038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e6f87-72a0-415d-87ec-d5fdd368c594 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:28.799309 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e6f87-72a0-415d-87ec-d5fdd368c594 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:28.799968 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e6f87-72a0-415d-87ec-d5fdd368c594 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:36:28.800275 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e6f87-72a0-415d-87ec-d5fdd368c594 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:28.801951 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e6f87-72a0-415d-87ec-d5fdd368c594 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:28.815051 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1319/2641] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:36:28.855757 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e6f87-72a0-415d-87ec-d5fdd368c594 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:28.860264 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bde11-7b34-44b6-b631-5ee720123d57 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:28.864986 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f736c-c6e8-4f5e-8be6-768646a664eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:28.865768 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f736c-c6e8-4f5e-8be6-768646a664eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:28.866605 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f736c-c6e8-4f5e-8be6-768646a664eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:28.866877 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f736c-c6e8-4f5e-8be6-768646a664eb admin admin] PATH_INFO: `/v3/users/1f17b54189db41b490b974ffb7c2699c` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:28.868067 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f736c-c6e8-4f5e-8be6-768646a664eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f17b54189db41b490b974ffb7c2699c)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:28.869482 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e6f87-72a0-415d-87ec-d5fdd368c594 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:28.870070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f736c-c6e8-4f5e-8be6-768646a664eb admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:28.874518 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6da23-5434-4dcc-bcbe-b5a960e7e7e1 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83f03710b1ca41e38c510c1709fe459b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5eece65a4b4b708b5f0b0706f38252', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:28.875214 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:28.875359 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6da23-5434-4dcc-bcbe-b5a960e7e7e1 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:28.875633 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6da23-5434-4dcc-bcbe-b5a960e7e7e1 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:28.875983 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6da23-5434-4dcc-bcbe-b5a960e7e7e1 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] PATH_INFO: `/v3/projects/7f2c13ad42a143ca81adf70313a32357` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:28.877333 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6da23-5434-4dcc-bcbe-b5a960e7e7e1 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7f2c13ad42a143ca81adf70313a32357)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:28.879449 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6da23-5434-4dcc-bcbe-b5a960e7e7e1 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:28.937050 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-7f4f736c-c6e8-4f5e-8be6-768646a664eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f17b54189db41b490b974ffb7c2699c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:28.945646 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-7f4f736c-c6e8-4f5e-8be6-768646a664eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f17b54189db41b490b974ffb7c2699c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:28.954842 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-f3e6da23-5434-4dcc-bcbe-b5a960e7e7e1 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f2c13ad42a143ca81adf70313a32357', 'request_id': 'req-f3e6da23-5434-4dcc-bcbe-b5a960e7e7e1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:28.956854 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-7f4f736c-c6e8-4f5e-8be6-768646a664eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f17b54189db41b490b974ffb7c2699c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:28.958746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-7f4f736c-c6e8-4f5e-8be6-768646a664eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f17b54189db41b490b974ffb7c2699c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:28.973682 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-f3e6da23-5434-4dcc-bcbe-b5a960e7e7e1 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f2c13ad42a143ca81adf70313a32357', 'request_id': 'req-f3e6da23-5434-4dcc-bcbe-b5a960e7e7e1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:28.982220 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-f3e6da23-5434-4dcc-bcbe-b5a960e7e7e1 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f2c13ad42a143ca81adf70313a32357', 'request_id': 'req-f3e6da23-5434-4dcc-bcbe-b5a960e7e7e1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:28.996140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-7f4f736c-c6e8-4f5e-8be6-768646a664eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f17b54189db41b490b974ffb7c2699c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:29.005488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1323/2642] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:36:28 2022] DELETE /identity/v3/users/1f17b54189db41b490b974ffb7c2699c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:36:29.007509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-f3e6da23-5434-4dcc-bcbe-b5a960e7e7e1 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] The token cache is being invalidate because project 7f2c13ad42a143ca81adf70313a32357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:36:29.007839 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-f3e6da23-5434-4dcc-bcbe-b5a960e7e7e1 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:29.008731 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-f3e6da23-5434-4dcc-bcbe-b5a960e7e7e1 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:29.009117 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159e479-aa4a-4128-9d8e-ec70dd0fcc41 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:29.009530 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159e479-aa4a-4128-9d8e-ec70dd0fcc41 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:29.009938 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159e479-aa4a-4128-9d8e-ec70dd0fcc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:29.011878 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1320/2643] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:36:28 2022] DELETE /identity/v3/projects/7f2c13ad42a143ca81adf70313a32357 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:29.035040 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-4159e479-aa4a-4128-9d8e-ec70dd0fcc41 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:29.037647 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4159e479-aa4a-4128-9d8e-ec70dd0fcc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:29.123370 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1324/2644] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:29.134349 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6da23-5434-4dcc-bcbe-b5a960e7e7e1 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:29.136143 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f3e6da23-5434-4dcc-bcbe-b5a960e7e7e1 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:29.179840 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:29.217905 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6da23-5434-4dcc-bcbe-b5a960e7e7e1 tempest-VolumeQuotaClassesTest-1723059346 tempest-VolumeQuotaClassesTest-1723059346-project-admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:29.239017 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159e479-aa4a-4128-9d8e-ec70dd0fcc41 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:29.240419 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4159e479-aa4a-4128-9d8e-ec70dd0fcc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:29.252717 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159e479-aa4a-4128-9d8e-ec70dd0fcc41 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:29.257719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace98bd-99b9-4f32-953b-66804859d1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:29.258362 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace98bd-99b9-4f32-953b-66804859d1ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:29.258644 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace98bd-99b9-4f32-953b-66804859d1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:29.258921 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace98bd-99b9-4f32-953b-66804859d1ef admin admin] PATH_INFO: `/v3/users/59c7fcbfb52a47b5a0c92031409961a8` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:29.260089 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace98bd-99b9-4f32-953b-66804859d1ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=59c7fcbfb52a47b5a0c92031409961a8)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:29.262214 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace98bd-99b9-4f32-953b-66804859d1ef admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:29.293467 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99495133-f972-4687-9cf9-0b40fc83fb9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:29.294118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99495133-f972-4687-9cf9-0b40fc83fb9a service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:29.294388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99495133-f972-4687-9cf9-0b40fc83fb9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:29.294663 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99495133-f972-4687-9cf9-0b40fc83fb9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:29.305050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99495133-f972-4687-9cf9-0b40fc83fb9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:29.306673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99495133-f972-4687-9cf9-0b40fc83fb9a service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:29.316538 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-bace98bd-99b9-4f32-953b-66804859d1ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59c7fcbfb52a47b5a0c92031409961a8'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:29.318762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1321/2645] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:29.324019 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-bace98bd-99b9-4f32-953b-66804859d1ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59c7fcbfb52a47b5a0c92031409961a8'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:29.330969 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-bace98bd-99b9-4f32-953b-66804859d1ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59c7fcbfb52a47b5a0c92031409961a8'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:29.331584 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-bace98bd-99b9-4f32-953b-66804859d1ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59c7fcbfb52a47b5a0c92031409961a8'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:29.343255 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:29.344856 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-bace98bd-99b9-4f32-953b-66804859d1ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59c7fcbfb52a47b5a0c92031409961a8'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:29.352688 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1325/2646] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:36:29 2022] DELETE /identity/v3/users/59c7fcbfb52a47b5a0c92031409961a8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:36:29.357365 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f624bc-f1af-4a91-8fae-244802955a02 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:29.357722 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f624bc-f1af-4a91-8fae-244802955a02 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:29.358096 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f624bc-f1af-4a91-8fae-244802955a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:29.377782 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-31f624bc-f1af-4a91-8fae-244802955a02 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:29.379004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-31f624bc-f1af-4a91-8fae-244802955a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:29.449980 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1322/2647] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:29.460651 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace98bd-99b9-4f32-953b-66804859d1ef admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:29.462092 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-bace98bd-99b9-4f32-953b-66804859d1ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:29.521982 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace98bd-99b9-4f32-953b-66804859d1ef admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:29.526328 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd3c55-5e46-4e75-9ab6-598a6b3d99fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:29.526936 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd3c55-5e46-4e75-9ab6-598a6b3d99fd service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:29.527211 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd3c55-5e46-4e75-9ab6-598a6b3d99fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:29.527489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd3c55-5e46-4e75-9ab6-598a6b3d99fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:29.536916 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd3c55-5e46-4e75-9ab6-598a6b3d99fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:29.538988 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd3c55-5e46-4e75-9ab6-598a6b3d99fd service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:29.548628 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1326/2648] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:29.688458 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f624bc-f1af-4a91-8fae-244802955a02 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:29.689930 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-31f624bc-f1af-4a91-8fae-244802955a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:29.702037 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f624bc-f1af-4a91-8fae-244802955a02 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:29.706591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e16c96-fcb1-4729-839f-84ad8b94d9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:29.707303 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e16c96-fcb1-4729-839f-84ad8b94d9f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:29.707479 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e16c96-fcb1-4729-839f-84ad8b94d9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:29.707871 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e16c96-fcb1-4729-839f-84ad8b94d9f9 admin admin] PATH_INFO: `/v3/projects/c4217a89c86e493197710c325b3cd182` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:29.710155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e16c96-fcb1-4729-839f-84ad8b94d9f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4217a89c86e493197710c325b3cd182)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:29.712285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e16c96-fcb1-4729-839f-84ad8b94d9f9 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:29.778342 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-67e16c96-fcb1-4729-839f-84ad8b94d9f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4217a89c86e493197710c325b3cd182', 'request_id': 'req-67e16c96-fcb1-4729-839f-84ad8b94d9f9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:29.784083 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-67e16c96-fcb1-4729-839f-84ad8b94d9f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4217a89c86e493197710c325b3cd182', 'request_id': 'req-67e16c96-fcb1-4729-839f-84ad8b94d9f9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:29.790309 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-67e16c96-fcb1-4729-839f-84ad8b94d9f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4217a89c86e493197710c325b3cd182', 'request_id': 'req-67e16c96-fcb1-4729-839f-84ad8b94d9f9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:29.806108 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-67e16c96-fcb1-4729-839f-84ad8b94d9f9 admin admin] The token cache is being invalidate because project c4217a89c86e493197710c325b3cd182 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:36:29.806745 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-67e16c96-fcb1-4729-839f-84ad8b94d9f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:29.807048 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-67e16c96-fcb1-4729-839f-84ad8b94d9f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:29.808851 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1323/2649] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:36:29 2022] DELETE /identity/v3/projects/c4217a89c86e493197710c325b3cd182 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:29.813712 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d4780-799b-479f-b09d-30f8679cdf08 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:29.814098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d4780-799b-479f-b09d-30f8679cdf08 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:29.814439 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d4780-799b-479f-b09d-30f8679cdf08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:29.834822 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-494d4780-799b-479f-b09d-30f8679cdf08 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:29.836082 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-494d4780-799b-479f-b09d-30f8679cdf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:29.896831 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1327/2650] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:29.906639 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29c117-51fd-4cb0-8270-de89557ac88b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:29.906892 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29c117-51fd-4cb0-8270-de89557ac88b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:29.907181 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29c117-51fd-4cb0-8270-de89557ac88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:29.907540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d4780-799b-479f-b09d-30f8679cdf08 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:29.909079 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-494d4780-799b-479f-b09d-30f8679cdf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:29.923656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d4780-799b-479f-b09d-30f8679cdf08 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:29.929584 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a7dad-7b74-48ee-933a-5cbda93124ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:29.930346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a7dad-7b74-48ee-933a-5cbda93124ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:29.930505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-bf29c117-51fd-4cb0-8270-de89557ac88b None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:29.930740 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a7dad-7b74-48ee-933a-5cbda93124ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:29.931019 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a7dad-7b74-48ee-933a-5cbda93124ac admin admin] PATH_INFO: `/v3/projects/29d5e2b0e36041d5b6ef03ac02b09a90` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:29.931681 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bf29c117-51fd-4cb0-8270-de89557ac88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:29.932283 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a7dad-7b74-48ee-933a-5cbda93124ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=29d5e2b0e36041d5b6ef03ac02b09a90)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:29.934290 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a7dad-7b74-48ee-933a-5cbda93124ac admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:29.940613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1324/2651] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:29.945688 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29c117-51fd-4cb0-8270-de89557ac88b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:29.950072 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:29.957337 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29c117-51fd-4cb0-8270-de89557ac88b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:29.963729 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4a3c7-a70c-4e8c-b0c0-a975ef1af766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:29.964323 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4a3c7-a70c-4e8c-b0c0-a975ef1af766 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:29.964601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4a3c7-a70c-4e8c-b0c0-a975ef1af766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:29.964857 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4a3c7-a70c-4e8c-b0c0-a975ef1af766 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:29.965530 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4a3c7-a70c-4e8c-b0c0-a975ef1af766 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:36:29.966003 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4a3c7-a70c-4e8c-b0c0-a975ef1af766 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:29.967575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4a3c7-a70c-4e8c-b0c0-a975ef1af766 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:29.985187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1325/2652] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:36:29.986469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4a3c7-a70c-4e8c-b0c0-a975ef1af766 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:29.988239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-b39a7dad-7b74-48ee-933a-5cbda93124ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29d5e2b0e36041d5b6ef03ac02b09a90', 'request_id': 'req-b39a7dad-7b74-48ee-933a-5cbda93124ac'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:29.994829 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-b39a7dad-7b74-48ee-933a-5cbda93124ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29d5e2b0e36041d5b6ef03ac02b09a90', 'request_id': 'req-b39a7dad-7b74-48ee-933a-5cbda93124ac'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:29.997381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4a3c7-a70c-4e8c-b0c0-a975ef1af766 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:30.001629 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-b39a7dad-7b74-48ee-933a-5cbda93124ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29d5e2b0e36041d5b6ef03ac02b09a90', 'request_id': 'req-b39a7dad-7b74-48ee-933a-5cbda93124ac'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:30.016621 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-b39a7dad-7b74-48ee-933a-5cbda93124ac admin admin] The token cache is being invalidate because project 29d5e2b0e36041d5b6ef03ac02b09a90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:36:30.016871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-b39a7dad-7b74-48ee-933a-5cbda93124ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:30.017627 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-b39a7dad-7b74-48ee-933a-5cbda93124ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:30.019119 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1328/2653] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:36:29 2022] DELETE /identity/v3/projects/29d5e2b0e36041d5b6ef03ac02b09a90 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:30.023529 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a7dad-7b74-48ee-933a-5cbda93124ac admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:30.024850 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b39a7dad-7b74-48ee-933a-5cbda93124ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:30.050997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:30.060282 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2962c-9740-47a1-85e7-210323dadf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:30.060907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2962c-9740-47a1-85e7-210323dadf26 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:30.061204 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2962c-9740-47a1-85e7-210323dadf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:30.061481 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2962c-9740-47a1-85e7-210323dadf26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:30.062106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2962c-9740-47a1-85e7-210323dadf26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:30.064001 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2962c-9740-47a1-85e7-210323dadf26 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:30.091490 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a7dad-7b74-48ee-933a-5cbda93124ac admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:30.092726 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1326/2654] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:36:29 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:36:30.097184 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2962c-9740-47a1-85e7-210323dadf26 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:30.098758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8bf2962c-9740-47a1-85e7-210323dadf26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:30.151259 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a8a87-1dc9-45db-b06d-d8c1ea8ed511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:30.151899 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a8a87-1dc9-45db-b06d-d8c1ea8ed511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:30.152183 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a8a87-1dc9-45db-b06d-d8c1ea8ed511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:30.152466 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a8a87-1dc9-45db-b06d-d8c1ea8ed511 admin admin] PATH_INFO: `/v3/users/83f03710b1ca41e38c510c1709fe459b` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:30.153643 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a8a87-1dc9-45db-b06d-d8c1ea8ed511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83f03710b1ca41e38c510c1709fe459b)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:30.155563 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a8a87-1dc9-45db-b06d-d8c1ea8ed511 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:30.164006 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2962c-9740-47a1-85e7-210323dadf26 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:30.168593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654f681-0b56-4d6d-b570-60d40b97b272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:30.169215 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654f681-0b56-4d6d-b570-60d40b97b272 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:30.169494 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654f681-0b56-4d6d-b570-60d40b97b272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:30.169762 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654f681-0b56-4d6d-b570-60d40b97b272 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:30.170375 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654f681-0b56-4d6d-b570-60d40b97b272 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:30.172263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654f681-0b56-4d6d-b570-60d40b97b272 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:30.194416 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1327/2655] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:36:30 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:36:30.198338 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654f681-0b56-4d6d-b570-60d40b97b272 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:30.206128 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4f6a8a87-1dc9-45db-b06d-d8c1ea8ed511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83f03710b1ca41e38c510c1709fe459b'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:30.207955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654f681-0b56-4d6d-b570-60d40b97b272 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:30.213292 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77692c7-8627-4bef-bf98-91275be5dc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:30.213911 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77692c7-8627-4bef-bf98-91275be5dc1e admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:30.214192 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77692c7-8627-4bef-bf98-91275be5dc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:30.214336 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4f6a8a87-1dc9-45db-b06d-d8c1ea8ed511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83f03710b1ca41e38c510c1709fe459b'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:30.214464 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77692c7-8627-4bef-bf98-91275be5dc1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:30.215097 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77692c7-8627-4bef-bf98-91275be5dc1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:30.216685 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77692c7-8627-4bef-bf98-91275be5dc1e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:30.221652 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4f6a8a87-1dc9-45db-b06d-d8c1ea8ed511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83f03710b1ca41e38c510c1709fe459b'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:30.222290 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4f6a8a87-1dc9-45db-b06d-d8c1ea8ed511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83f03710b1ca41e38c510c1709fe459b'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:30.227021 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1328/2656] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:36:30.231064 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77692c7-8627-4bef-bf98-91275be5dc1e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:30.232673 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b77692c7-8627-4bef-bf98-91275be5dc1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:30.234356 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4f6a8a87-1dc9-45db-b06d-d8c1ea8ed511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83f03710b1ca41e38c510c1709fe459b'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:30.240572 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1329/2657] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:36:30 2022] DELETE /identity/v3/users/83f03710b1ca41e38c510c1709fe459b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:36:30.244949 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77692c7-8627-4bef-bf98-91275be5dc1e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:30.294561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:30.307349 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f87eb-272b-42d8-93a1-a5430279fc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:30.308377 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f87eb-272b-42d8-93a1-a5430279fc35 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:30.308774 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f87eb-272b-42d8-93a1-a5430279fc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:30.309692 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f87eb-272b-42d8-93a1-a5430279fc35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:30.310398 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f87eb-272b-42d8-93a1-a5430279fc35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:30.313135 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f87eb-272b-42d8-93a1-a5430279fc35 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:30.326157 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1329/2658] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:30.330909 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a8a87-1dc9-45db-b06d-d8c1ea8ed511 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:30.342276 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a8a87-1dc9-45db-b06d-d8c1ea8ed511 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:30.347719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d0190-48de-4c37-b80d-af683843993e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:30.348397 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d0190-48de-4c37-b80d-af683843993e admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:30.348690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d0190-48de-4c37-b80d-af683843993e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:30.348953 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d0190-48de-4c37-b80d-af683843993e admin admin] PATH_INFO: `/v3/projects/7043171ed5f44ce4bf649662a4514741/users/7828a294fd6b4df8bbf0fd25a9752a8a/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:30.364325 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d0190-48de-4c37-b80d-af683843993e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7043171ed5f44ce4bf649662a4514741, user_id=7828a294fd6b4df8bbf0fd25a9752a8a, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:30.367312 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d0190-48de-4c37-b80d-af683843993e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:30.380947 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1330/2659] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:36:30 2022] PUT /identity/v3/projects/7043171ed5f44ce4bf649662a4514741/users/7828a294fd6b4df8bbf0fd25a9752a8a/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:30.391454 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b627d36-580b-485e-80e1-b7809792f067 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:30.391746 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b627d36-580b-485e-80e1-b7809792f067 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:30.392021 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b627d36-580b-485e-80e1-b7809792f067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:30.424718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-6b627d36-580b-485e-80e1-b7809792f067 None None] MFA Rules not processed for user `7828a294fd6b4df8bbf0fd25a9752a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:30.426025 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6b627d36-580b-485e-80e1-b7809792f067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:30.499990 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1330/2660] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:30.504615 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d0190-48de-4c37-b80d-af683843993e admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:30.527952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b627d36-580b-485e-80e1-b7809792f067 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:30.529453 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6b627d36-580b-485e-80e1-b7809792f067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:30.537757 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:30.587379 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d0190-48de-4c37-b80d-af683843993e admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:30.592213 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c088d0-54b2-432f-b2ed-f8eaec4019de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:30.592811 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c088d0-54b2-432f-b2ed-f8eaec4019de admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:30.593130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c088d0-54b2-432f-b2ed-f8eaec4019de admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:30.593403 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c088d0-54b2-432f-b2ed-f8eaec4019de admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:30.594022 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c088d0-54b2-432f-b2ed-f8eaec4019de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:30.596203 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c088d0-54b2-432f-b2ed-f8eaec4019de admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:30.599649 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b627d36-580b-485e-80e1-b7809792f067 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:30.604860 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52808a16-4a20-48c1-a731-5813d62b311f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:30.605545 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52808a16-4a20-48c1-a731-5813d62b311f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:30.605824 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52808a16-4a20-48c1-a731-5813d62b311f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:30.606094 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52808a16-4a20-48c1-a731-5813d62b311f admin admin] PATH_INFO: `/v3/projects/dd5eece65a4b4b708b5f0b0706f38252` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:30.607221 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52808a16-4a20-48c1-a731-5813d62b311f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd5eece65a4b4b708b5f0b0706f38252)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:30.609216 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52808a16-4a20-48c1-a731-5813d62b311f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:30.627757 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1331/2661] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:36:30 2022] POST /identity/v3/projects => generated 363 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:30.628951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c088d0-54b2-432f-b2ed-f8eaec4019de admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:30.656631 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-52808a16-4a20-48c1-a731-5813d62b311f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd5eece65a4b4b708b5f0b0706f38252', 'request_id': 'req-52808a16-4a20-48c1-a731-5813d62b311f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:30.662242 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-52808a16-4a20-48c1-a731-5813d62b311f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd5eece65a4b4b708b5f0b0706f38252', 'request_id': 'req-52808a16-4a20-48c1-a731-5813d62b311f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:30.670160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-52808a16-4a20-48c1-a731-5813d62b311f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd5eece65a4b4b708b5f0b0706f38252', 'request_id': 'req-52808a16-4a20-48c1-a731-5813d62b311f'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:30.683338 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-52808a16-4a20-48c1-a731-5813d62b311f admin admin] The token cache is being invalidate because project dd5eece65a4b4b708b5f0b0706f38252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:36:30.683624 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-52808a16-4a20-48c1-a731-5813d62b311f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:30.684295 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-52808a16-4a20-48c1-a731-5813d62b311f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:30.685843 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1331/2662] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:36:30 2022] DELETE /identity/v3/projects/dd5eece65a4b4b708b5f0b0706f38252 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:36:30.691433 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ec465-ba8a-40c7-8f5f-a5c38cd71e81 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:30.691707 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ec465-ba8a-40c7-8f5f-a5c38cd71e81 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:30.691979 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ec465-ba8a-40c7-8f5f-a5c38cd71e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:30.699499 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c088d0-54b2-432f-b2ed-f8eaec4019de admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:30.711601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-858ec465-ba8a-40c7-8f5f-a5c38cd71e81 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:30.712792 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-858ec465-ba8a-40c7-8f5f-a5c38cd71e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:30.717065 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:30.759698 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfad64-edaa-40ee-8f7b-ba3c8a27aec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:30.760312 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfad64-edaa-40ee-8f7b-ba3c8a27aec6 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:30.760595 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfad64-edaa-40ee-8f7b-ba3c8a27aec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:30.760872 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfad64-edaa-40ee-8f7b-ba3c8a27aec6 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:30.761537 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbfad64-edaa-40ee-8f7b-ba3c8a27aec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:30.763682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbfad64-edaa-40ee-8f7b-ba3c8a27aec6 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:30.779965 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1332/2663] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:36:30.785824 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1332/2664] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:36:30 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:30.787651 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f974e-78d1-4eb0-8c3f-b6f9f4e64cd7 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:30.788007 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f974e-78d1-4eb0-8c3f-b6f9f4e64cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:30.788343 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f974e-78d1-4eb0-8c3f-b6f9f4e64cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:30.789587 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfad64-edaa-40ee-8f7b-ba3c8a27aec6 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:30.791223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-fcbfad64-edaa-40ee-8f7b-ba3c8a27aec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:30.802846 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfad64-edaa-40ee-8f7b-ba3c8a27aec6 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:30.807927 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-9a3f974e-78d1-4eb0-8c3f-b6f9f4e64cd7 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:30.808454 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4472c24-b2f2-40c6-9542-9f9ea8d87149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:30.808765 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4472c24-b2f2-40c6-9542-9f9ea8d87149 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:30.809142 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4472c24-b2f2-40c6-9542-9f9ea8d87149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:30.809263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-9a3f974e-78d1-4eb0-8c3f-b6f9f4e64cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:30.809387 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4472c24-b2f2-40c6-9542-9f9ea8d87149 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:30.809971 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4472c24-b2f2-40c6-9542-9f9ea8d87149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:30.811612 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4472c24-b2f2-40c6-9542-9f9ea8d87149 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:30.819722 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1333/2665] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:36:30.822851 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1333/2666] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:30.823379 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f974e-78d1-4eb0-8c3f-b6f9f4e64cd7 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:30.826505 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4472c24-b2f2-40c6-9542-9f9ea8d87149 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:30.832359 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f974e-78d1-4eb0-8c3f-b6f9f4e64cd7 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:30.836073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4472c24-b2f2-40c6-9542-9f9ea8d87149 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:30.837315 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9c240-73fd-4aa2-87f5-9f4caa696b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:30.837907 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9c240-73fd-4aa2-87f5-9f4caa696b69 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:30.838187 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9c240-73fd-4aa2-87f5-9f4caa696b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:30.838457 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9c240-73fd-4aa2-87f5-9f4caa696b69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:30.839097 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9c240-73fd-4aa2-87f5-9f4caa696b69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:36:30.839514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9c240-73fd-4aa2-87f5-9f4caa696b69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:30.841137 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9c240-73fd-4aa2-87f5-9f4caa696b69 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:30.841281 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95269a7-01e1-487d-ad62-bc9832dd1c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:30.841939 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95269a7-01e1-487d-ad62-bc9832dd1c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:30.842202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95269a7-01e1-487d-ad62-bc9832dd1c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:30.842479 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95269a7-01e1-487d-ad62-bc9832dd1c8a admin admin] PATH_INFO: `/v3/projects/da477f61138747a9a75fdf04814ea7b7/users/df47a48f9bcc489cbda5307c170f40b6/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:30.853511 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1334/2667] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:36:30.857505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9c240-73fd-4aa2-87f5-9f4caa696b69 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:30.859353 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95269a7-01e1-487d-ad62-bc9832dd1c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=da477f61138747a9a75fdf04814ea7b7, user_id=df47a48f9bcc489cbda5307c170f40b6, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:30.862226 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95269a7-01e1-487d-ad62-bc9832dd1c8a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:30.868244 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9c240-73fd-4aa2-87f5-9f4caa696b69 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:30.874009 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0e753-f2b4-4013-9035-1910cb5449aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:30.874605 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0e753-f2b4-4013-9035-1910cb5449aa admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:30.875029 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0e753-f2b4-4013-9035-1910cb5449aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:30.875312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0e753-f2b4-4013-9035-1910cb5449aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:30.875942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0e753-f2b4-4013-9035-1910cb5449aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:30.876371 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1334/2668] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:36:30 2022] PUT /identity/v3/projects/da477f61138747a9a75fdf04814ea7b7/users/df47a48f9bcc489cbda5307c170f40b6/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:36:30.877970 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0e753-f2b4-4013-9035-1910cb5449aa admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:30.880119 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95269a7-01e1-487d-ad62-bc9832dd1c8a admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:30.892611 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:30.907107 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1335/2669] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:36:30 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:30.911196 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0e753-f2b4-4013-9035-1910cb5449aa admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:30.952503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95269a7-01e1-487d-ad62-bc9832dd1c8a admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:30.975770 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0e753-f2b4-4013-9035-1910cb5449aa admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:30.982484 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b1e5d-3ca0-4b1e-ae32-3ac100c09e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:30.983223 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b1e5d-3ca0-4b1e-ae32-3ac100c09e79 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:30.983350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b1e5d-3ca0-4b1e-ae32-3ac100c09e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:30.983617 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b1e5d-3ca0-4b1e-ae32-3ac100c09e79 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:30.984238 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b1e5d-3ca0-4b1e-ae32-3ac100c09e79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:30.986193 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b1e5d-3ca0-4b1e-ae32-3ac100c09e79 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:31.008527 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1336/2670] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:36:30 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:36:31.012580 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b1e5d-3ca0-4b1e-ae32-3ac100c09e79 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:31.017962 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a534d-ae99-4ff0-99b8-68ebcb4df865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:31.018614 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a534d-ae99-4ff0-99b8-68ebcb4df865 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:31.018900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a534d-ae99-4ff0-99b8-68ebcb4df865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:31.019179 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a534d-ae99-4ff0-99b8-68ebcb4df865 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:31.019847 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a534d-ae99-4ff0-99b8-68ebcb4df865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:31.021487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a534d-ae99-4ff0-99b8-68ebcb4df865 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:31.022354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b1e5d-3ca0-4b1e-ae32-3ac100c09e79 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:31.026949 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1df0d-b79f-4668-b7b9-865d27ccb2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:31.027588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1df0d-b79f-4668-b7b9-865d27ccb2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:31.027870 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1df0d-b79f-4668-b7b9-865d27ccb2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:31.028149 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1df0d-b79f-4668-b7b9-865d27ccb2e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:31.028793 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1df0d-b79f-4668-b7b9-865d27ccb2e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:31.030409 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1df0d-b79f-4668-b7b9-865d27ccb2e9 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:31.031367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1335/2671] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:36:31.035413 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a534d-ae99-4ff0-99b8-68ebcb4df865 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:31.042637 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1337/2672] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:36:31.046294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1df0d-b79f-4668-b7b9-865d27ccb2e9 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:31.048058 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a534d-ae99-4ff0-99b8-68ebcb4df865 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:31.052697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffaf162-32c8-4c12-bc89-1c259c287500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:31.053925 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffaf162-32c8-4c12-bc89-1c259c287500 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:31.054212 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffaf162-32c8-4c12-bc89-1c259c287500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:31.054486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffaf162-32c8-4c12-bc89-1c259c287500 admin admin] PATH_INFO: `/v3/projects/da477f61138747a9a75fdf04814ea7b7/users/df47a48f9bcc489cbda5307c170f40b6/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:31.056311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1df0d-b79f-4668-b7b9-865d27ccb2e9 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:31.056436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffaf162-32c8-4c12-bc89-1c259c287500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da477f61138747a9a75fdf04814ea7b7, user_id=df47a48f9bcc489cbda5307c170f40b6, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:31.059042 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffaf162-32c8-4c12-bc89-1c259c287500 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:31.060837 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86703803-d7d5-41fe-954c-1b5b1784c6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:31.061525 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86703803-d7d5-41fe-954c-1b5b1784c6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:31.061804 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86703803-d7d5-41fe-954c-1b5b1784c6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:31.062081 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86703803-d7d5-41fe-954c-1b5b1784c6a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:31.062703 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86703803-d7d5-41fe-954c-1b5b1784c6a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:31.064265 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86703803-d7d5-41fe-954c-1b5b1784c6a9 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:31.070112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1336/2673] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:36:31 2022] PUT /identity/v3/projects/da477f61138747a9a75fdf04814ea7b7/users/df47a48f9bcc489cbda5307c170f40b6/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:36:31.079719 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1338/2674] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:36:31.080013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf424da-fabb-445a-85a5-075b99f2960f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:31.080389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf424da-fabb-445a-85a5-075b99f2960f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:31.080726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf424da-fabb-445a-85a5-075b99f2960f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:31.083369 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86703803-d7d5-41fe-954c-1b5b1784c6a9 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:31.093635 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86703803-d7d5-41fe-954c-1b5b1784c6a9 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:31.109522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-bdf424da-fabb-445a-85a5-075b99f2960f None None] MFA Rules not processed for user `df47a48f9bcc489cbda5307c170f40b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:31.110757 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-bdf424da-fabb-445a-85a5-075b99f2960f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:31.126111 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:31.152810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65010e7c-80e9-443f-a7b8-9a7da47fd91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:31.153494 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65010e7c-80e9-443f-a7b8-9a7da47fd91f admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:31.153773 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65010e7c-80e9-443f-a7b8-9a7da47fd91f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:31.154046 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65010e7c-80e9-443f-a7b8-9a7da47fd91f admin admin] PATH_INFO: `/v3/projects/b9a8e3669b02437093535dee630eb051/users/1e93dfae048142acb2dee6a4fde60111/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:31.168694 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65010e7c-80e9-443f-a7b8-9a7da47fd91f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a8e3669b02437093535dee630eb051, user_id=1e93dfae048142acb2dee6a4fde60111, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:31.171415 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65010e7c-80e9-443f-a7b8-9a7da47fd91f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:31.180241 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1337/2675] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:36:31.185254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1339/2676] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:36:31 2022] PUT /identity/v3/projects/b9a8e3669b02437093535dee630eb051/users/1e93dfae048142acb2dee6a4fde60111/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:36:31.196880 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729292bf-95ce-482c-b8d1-4f4b3b1f55b4 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:31.197196 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729292bf-95ce-482c-b8d1-4f4b3b1f55b4 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:31.197474 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729292bf-95ce-482c-b8d1-4f4b3b1f55b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:31.200942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65010e7c-80e9-443f-a7b8-9a7da47fd91f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:31.202689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-65010e7c-80e9-443f-a7b8-9a7da47fd91f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:31.225772 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-729292bf-95ce-482c-b8d1-4f4b3b1f55b4 None None] MFA Rules not processed for user `1e93dfae048142acb2dee6a4fde60111`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:31.226960 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-729292bf-95ce-482c-b8d1-4f4b3b1f55b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:31.240116 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:31.260793 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65010e7c-80e9-443f-a7b8-9a7da47fd91f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:31.264475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868ac05-c1ab-482b-9f70-bdab07a4bb8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:31.265110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868ac05-c1ab-482b-9f70-bdab07a4bb8a service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:31.265383 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868ac05-c1ab-482b-9f70-bdab07a4bb8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:31.265650 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868ac05-c1ab-482b-9f70-bdab07a4bb8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:31.294503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1338/2677] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:31.301252 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729292bf-95ce-482c-b8d1-4f4b3b1f55b4 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:31.331678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868ac05-c1ab-482b-9f70-bdab07a4bb8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:31.333162 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868ac05-c1ab-482b-9f70-bdab07a4bb8a service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:31.343323 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1340/2678] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:36:31.370462 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729292bf-95ce-482c-b8d1-4f4b3b1f55b4 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:31.376271 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4979824-39b4-46b0-92a2-757dbb9914bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:31.376810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4979824-39b4-46b0-92a2-757dbb9914bf admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:31.377117 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4979824-39b4-46b0-92a2-757dbb9914bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:31.377391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4979824-39b4-46b0-92a2-757dbb9914bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:31.378038 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4979824-39b4-46b0-92a2-757dbb9914bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:31.379890 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4979824-39b4-46b0-92a2-757dbb9914bf admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:31.408373 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1339/2679] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:36:31 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:31.412277 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868ac05-c1ab-482b-9f70-bdab07a4bb8a service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:31.423643 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868ac05-c1ab-482b-9f70-bdab07a4bb8a service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:31.425519 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4979824-39b4-46b0-92a2-757dbb9914bf admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:31.481213 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfd33a-f7b6-47a7-8a14-359288c398ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:31.481811 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfd33a-f7b6-47a7-8a14-359288c398ff admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:31.482089 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfd33a-f7b6-47a7-8a14-359288c398ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:31.482358 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfd33a-f7b6-47a7-8a14-359288c398ff admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:31.482982 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4979824-39b4-46b0-92a2-757dbb9914bf admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:31.483106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfd33a-f7b6-47a7-8a14-359288c398ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:31.484891 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfd33a-f7b6-47a7-8a14-359288c398ff admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:31.486763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9094e28-71dc-4729-953d-8dd383530faa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:31.487365 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9094e28-71dc-4729-953d-8dd383530faa service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:31.487701 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9094e28-71dc-4729-953d-8dd383530faa service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:31.487983 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9094e28-71dc-4729-953d-8dd383530faa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:31.489762 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b9094e28-71dc-4729-953d-8dd383530faa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:31.501833 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:31.508371 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1341/2680] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:36:31 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:36:31.512665 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfd33a-f7b6-47a7-8a14-359288c398ff admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:31.523347 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfd33a-f7b6-47a7-8a14-359288c398ff admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:31.528467 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8bed9-4eb2-4ed4-bb92-3c436d563e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:31.529080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8bed9-4eb2-4ed4-bb92-3c436d563e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:31.529361 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8bed9-4eb2-4ed4-bb92-3c436d563e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:31.529627 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8bed9-4eb2-4ed4-bb92-3c436d563e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:31.530266 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8bed9-4eb2-4ed4-bb92-3c436d563e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:31.531840 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8bed9-4eb2-4ed4-bb92-3c436d563e55 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:31.542484 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1342/2681] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:36:31.546451 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8bed9-4eb2-4ed4-bb92-3c436d563e55 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:31.552599 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:31.555633 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9094e28-71dc-4729-953d-8dd383530faa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:31.556044 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8bed9-4eb2-4ed4-bb92-3c436d563e55 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:31.557520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9094e28-71dc-4729-953d-8dd383530faa service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:31.560863 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af4ec3-e884-44ce-a00f-f27a7f499160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:31.561537 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af4ec3-e884-44ce-a00f-f27a7f499160 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:31.561853 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af4ec3-e884-44ce-a00f-f27a7f499160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:31.562093 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af4ec3-e884-44ce-a00f-f27a7f499160 admin admin] PATH_INFO: `/v3/projects/b2bbf225ed094ae0a77d493d0ee56037/users/13497e8eb6344b649a8c696507b2e3ac/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:31.568232 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1340/2682] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:36:31.578003 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af4ec3-e884-44ce-a00f-f27a7f499160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2bbf225ed094ae0a77d493d0ee56037, user_id=13497e8eb6344b649a8c696507b2e3ac, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:31.580644 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af4ec3-e884-44ce-a00f-f27a7f499160 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:31.595470 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1343/2683] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:36:31 2022] PUT /identity/v3/projects/b2bbf225ed094ae0a77d493d0ee56037/users/13497e8eb6344b649a8c696507b2e3ac/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:36:31.599703 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9094e28-71dc-4729-953d-8dd383530faa service cinder] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:31.611170 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9094e28-71dc-4729-953d-8dd383530faa service cinder] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:31.676500 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8d0c8-4315-4b6d-8dd3-d6ac38c5dc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:31.677154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8d0c8-4315-4b6d-8dd3-d6ac38c5dc8f admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:31.677441 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8d0c8-4315-4b6d-8dd3-d6ac38c5dc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:31.677765 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8d0c8-4315-4b6d-8dd3-d6ac38c5dc8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:31.679001 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8d0c8-4315-4b6d-8dd3-d6ac38c5dc8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:31.680721 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8d0c8-4315-4b6d-8dd3-d6ac38c5dc8f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:31.692173 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1341/2684] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:36:31.696521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af4ec3-e884-44ce-a00f-f27a7f499160 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:31.708521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af4ec3-e884-44ce-a00f-f27a7f499160 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:31.714279 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408ff10-060f-4bbe-aade-047ec889966f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:31.714862 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408ff10-060f-4bbe-aade-047ec889966f admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:31.715175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408ff10-060f-4bbe-aade-047ec889966f admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:31.715445 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408ff10-060f-4bbe-aade-047ec889966f admin admin] PATH_INFO: `/v3/projects/b2bbf225ed094ae0a77d493d0ee56037/users/13497e8eb6344b649a8c696507b2e3ac/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:31.717887 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408ff10-060f-4bbe-aade-047ec889966f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2bbf225ed094ae0a77d493d0ee56037, user_id=13497e8eb6344b649a8c696507b2e3ac, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:31.720577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408ff10-060f-4bbe-aade-047ec889966f admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:31.732989 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1344/2685] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:36:31 2022] PUT /identity/v3/projects/b2bbf225ed094ae0a77d493d0ee56037/users/13497e8eb6344b649a8c696507b2e3ac/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:31.743843 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23dee9-5248-498d-9ea6-ada5a5925758 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:31.744130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23dee9-5248-498d-9ea6-ada5a5925758 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:31.744404 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23dee9-5248-498d-9ea6-ada5a5925758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:31.772721 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-4d23dee9-5248-498d-9ea6-ada5a5925758 None None] MFA Rules not processed for user `13497e8eb6344b649a8c696507b2e3ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:31.773969 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4d23dee9-5248-498d-9ea6-ada5a5925758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:31.838793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1342/2686] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:31 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:31.849738 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408ff10-060f-4bbe-aade-047ec889966f admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:31.904274 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408ff10-060f-4bbe-aade-047ec889966f admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:31.908216 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2bb9e-af1d-4ee2-9c86-d69e0d708803 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:31.908698 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2bb9e-af1d-4ee2-9c86-d69e0d708803 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:31.908979 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2bb9e-af1d-4ee2-9c86-d69e0d708803 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:31.909275 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2bb9e-af1d-4ee2-9c86-d69e0d708803 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:31.918779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb2bb9e-af1d-4ee2-9c86-d69e0d708803 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:31.920227 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb2bb9e-af1d-4ee2-9c86-d69e0d708803 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:31.930162 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1345/2687] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:32.460808 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23dee9-5248-498d-9ea6-ada5a5925758 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:32.521520 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23dee9-5248-498d-9ea6-ada5a5925758 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:32.526633 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cb400-0b76-4e63-a319-901268471ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:32.527252 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cb400-0b76-4e63-a319-901268471ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:32.527528 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cb400-0b76-4e63-a319-901268471ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:32.527803 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cb400-0b76-4e63-a319-901268471ee2 admin admin] PATH_INFO: `/v3/users/1e93dfae048142acb2dee6a4fde60111` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:32.528905 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cb400-0b76-4e63-a319-901268471ee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e93dfae048142acb2dee6a4fde60111)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:32.530836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cb400-0b76-4e63-a319-901268471ee2 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:32.551239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:32.575975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8d9cb400-0b76-4e63-a319-901268471ee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e93dfae048142acb2dee6a4fde60111'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:32.582732 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8d9cb400-0b76-4e63-a319-901268471ee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e93dfae048142acb2dee6a4fde60111'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:32.590588 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8d9cb400-0b76-4e63-a319-901268471ee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e93dfae048142acb2dee6a4fde60111'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:32.591392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8d9cb400-0b76-4e63-a319-901268471ee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e93dfae048142acb2dee6a4fde60111'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:32.603981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-8d9cb400-0b76-4e63-a319-901268471ee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e93dfae048142acb2dee6a4fde60111'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:32.609807 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1343/2688] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:36:32 2022] DELETE /identity/v3/users/1e93dfae048142acb2dee6a4fde60111 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:32.614303 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4e3cb-2f58-4e36-9122-601a34633ef2 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:32.614532 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4e3cb-2f58-4e36-9122-601a34633ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:32.614850 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4e3cb-2f58-4e36-9122-601a34633ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:32.633666 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-bcc4e3cb-2f58-4e36-9122-601a34633ef2 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:32.634866 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bcc4e3cb-2f58-4e36-9122-601a34633ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:32.697382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1346/2689] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:32.706993 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cb400-0b76-4e63-a319-901268471ee2 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:32.708386 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-8d9cb400-0b76-4e63-a319-901268471ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:32.766073 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cb400-0b76-4e63-a319-901268471ee2 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:32.769789 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1030c-9132-4b67-a12b-3f3cb97f1a45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:32.770395 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1030c-9132-4b67-a12b-3f3cb97f1a45 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:32.770676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1030c-9132-4b67-a12b-3f3cb97f1a45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:32.771098 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1030c-9132-4b67-a12b-3f3cb97f1a45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:32.780713 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1030c-9132-4b67-a12b-3f3cb97f1a45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:32.782163 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1030c-9132-4b67-a12b-3f3cb97f1a45 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:32.792195 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1344/2690] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:33.084461 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4e3cb-2f58-4e36-9122-601a34633ef2 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:33.086396 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-bcc4e3cb-2f58-4e36-9122-601a34633ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:33.100249 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4e3cb-2f58-4e36-9122-601a34633ef2 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:33.105866 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5ccf2-6648-437a-8a03-cba0e8f49104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:33.106594 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5ccf2-6648-437a-8a03-cba0e8f49104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:33.106937 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5ccf2-6648-437a-8a03-cba0e8f49104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:33.107290 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5ccf2-6648-437a-8a03-cba0e8f49104 admin admin] PATH_INFO: `/v3/projects/b9a8e3669b02437093535dee630eb051` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:33.108764 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5ccf2-6648-437a-8a03-cba0e8f49104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9a8e3669b02437093535dee630eb051)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:33.111098 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5ccf2-6648-437a-8a03-cba0e8f49104 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:33.167666 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:33.169476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-92a5ccf2-6648-437a-8a03-cba0e8f49104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9a8e3669b02437093535dee630eb051', 'request_id': 'req-92a5ccf2-6648-437a-8a03-cba0e8f49104'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:33.176315 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-92a5ccf2-6648-437a-8a03-cba0e8f49104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9a8e3669b02437093535dee630eb051', 'request_id': 'req-92a5ccf2-6648-437a-8a03-cba0e8f49104'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:33.183341 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-92a5ccf2-6648-437a-8a03-cba0e8f49104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9a8e3669b02437093535dee630eb051', 'request_id': 'req-92a5ccf2-6648-437a-8a03-cba0e8f49104'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:33.195394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-92a5ccf2-6648-437a-8a03-cba0e8f49104 admin admin] The token cache is being invalidate because project b9a8e3669b02437093535dee630eb051 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:36:33.195683 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-92a5ccf2-6648-437a-8a03-cba0e8f49104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:33.196296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-92a5ccf2-6648-437a-8a03-cba0e8f49104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:33.197810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1347/2691] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:36:33 2022] DELETE /identity/v3/projects/b9a8e3669b02437093535dee630eb051 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:33.201736 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1030c-9132-4b67-a12b-3f3cb97f1a45 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:33.211184 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1030c-9132-4b67-a12b-3f3cb97f1a45 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:33.269509 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0163095-4a8b-41aa-afbc-cf9305380c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:33.270136 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0163095-4a8b-41aa-afbc-cf9305380c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:33.270418 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0163095-4a8b-41aa-afbc-cf9305380c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:33.270692 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0163095-4a8b-41aa-afbc-cf9305380c93 admin admin] PATH_INFO: `/v3/users/13497e8eb6344b649a8c696507b2e3ac` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:33.271840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0163095-4a8b-41aa-afbc-cf9305380c93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13497e8eb6344b649a8c696507b2e3ac)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:33.273798 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0163095-4a8b-41aa-afbc-cf9305380c93 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:33.315265 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:33.321246 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f0163095-4a8b-41aa-afbc-cf9305380c93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13497e8eb6344b649a8c696507b2e3ac'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:33.328827 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f0163095-4a8b-41aa-afbc-cf9305380c93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13497e8eb6344b649a8c696507b2e3ac'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:33.336070 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f0163095-4a8b-41aa-afbc-cf9305380c93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13497e8eb6344b649a8c696507b2e3ac'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:33.336702 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f0163095-4a8b-41aa-afbc-cf9305380c93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13497e8eb6344b649a8c696507b2e3ac'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:33.348711 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f0163095-4a8b-41aa-afbc-cf9305380c93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13497e8eb6344b649a8c696507b2e3ac'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:33.355025 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1345/2692] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:36:33 2022] DELETE /identity/v3/users/13497e8eb6344b649a8c696507b2e3ac => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:33.634816 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5ccf2-6648-437a-8a03-cba0e8f49104 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:33.636280 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-92a5ccf2-6648-437a-8a03-cba0e8f49104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:33.649885 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5ccf2-6648-437a-8a03-cba0e8f49104 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:33.710759 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f5318-1fcc-4a3b-b33e-102465aa6a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:33.711316 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f5318-1fcc-4a3b-b33e-102465aa6a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:33.711598 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f5318-1fcc-4a3b-b33e-102465aa6a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:33.711871 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f5318-1fcc-4a3b-b33e-102465aa6a3c admin admin] PATH_INFO: `/v3/projects/b2bbf225ed094ae0a77d493d0ee56037` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:33.712988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f5318-1fcc-4a3b-b33e-102465aa6a3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2bbf225ed094ae0a77d493d0ee56037)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:33.714918 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f5318-1fcc-4a3b-b33e-102465aa6a3c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:33.762164 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e57f5318-1fcc-4a3b-b33e-102465aa6a3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2bbf225ed094ae0a77d493d0ee56037', 'request_id': 'req-e57f5318-1fcc-4a3b-b33e-102465aa6a3c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:33.767689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e57f5318-1fcc-4a3b-b33e-102465aa6a3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2bbf225ed094ae0a77d493d0ee56037', 'request_id': 'req-e57f5318-1fcc-4a3b-b33e-102465aa6a3c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:33.774266 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e57f5318-1fcc-4a3b-b33e-102465aa6a3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2bbf225ed094ae0a77d493d0ee56037', 'request_id': 'req-e57f5318-1fcc-4a3b-b33e-102465aa6a3c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:33.786043 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e57f5318-1fcc-4a3b-b33e-102465aa6a3c admin admin] The token cache is being invalidate because project b2bbf225ed094ae0a77d493d0ee56037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:36:33.786356 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e57f5318-1fcc-4a3b-b33e-102465aa6a3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:33.786986 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-e57f5318-1fcc-4a3b-b33e-102465aa6a3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:33.789050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1348/2693] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:36:33 2022] DELETE /identity/v3/projects/b2bbf225ed094ae0a77d493d0ee56037 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:33.795011 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723db6f9-ea79-4609-b848-83257b3d949a None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:33.795509 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723db6f9-ea79-4609-b848-83257b3d949a None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:33.795610 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723db6f9-ea79-4609-b848-83257b3d949a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:33.815060 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-723db6f9-ea79-4609-b848-83257b3d949a None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:33.816272 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-723db6f9-ea79-4609-b848-83257b3d949a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:33.874488 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1346/2694] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:33.883145 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bde7f-566a-4320-8349-1a215b8df7a6 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:33.883428 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bde7f-566a-4320-8349-1a215b8df7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:33.883701 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bde7f-566a-4320-8349-1a215b8df7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:33.902946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-212bde7f-566a-4320-8349-1a215b8df7a6 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:33.904144 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-212bde7f-566a-4320-8349-1a215b8df7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:33.912125 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1349/2695] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:33.916840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723db6f9-ea79-4609-b848-83257b3d949a None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:33.926487 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723db6f9-ea79-4609-b848-83257b3d949a None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:33.931650 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4d705-d329-4f00-8518-da884fe0f38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:33.932238 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4d705-d329-4f00-8518-da884fe0f38c admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:33.932516 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4d705-d329-4f00-8518-da884fe0f38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:33.932783 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4d705-d329-4f00-8518-da884fe0f38c admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:33.933482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4d705-d329-4f00-8518-da884fe0f38c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:36:33.933784 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4d705-d329-4f00-8518-da884fe0f38c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:33.935355 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4d705-d329-4f00-8518-da884fe0f38c admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:33.946572 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1347/2696] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 02:36:33.950802 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bde7f-566a-4320-8349-1a215b8df7a6 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:33.959871 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bde7f-566a-4320-8349-1a215b8df7a6 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:33.964553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1b8fc-5f69-4432-8bc6-ea11f5f2029d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:33.965110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1b8fc-5f69-4432-8bc6-ea11f5f2029d admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:33.965392 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1b8fc-5f69-4432-8bc6-ea11f5f2029d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:33.965680 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1b8fc-5f69-4432-8bc6-ea11f5f2029d admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:33.966325 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1b8fc-5f69-4432-8bc6-ea11f5f2029d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:33.968224 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1b8fc-5f69-4432-8bc6-ea11f5f2029d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:33.997066 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1350/2697] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:36:33 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:34.001180 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4d705-d329-4f00-8518-da884fe0f38c admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:34.011368 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4d705-d329-4f00-8518-da884fe0f38c admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:34.067130 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8439f-3494-4e0d-8b31-36d68aeaeefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:34.067726 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8439f-3494-4e0d-8b31-36d68aeaeefb admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:34.068004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8439f-3494-4e0d-8b31-36d68aeaeefb admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:34.068274 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8439f-3494-4e0d-8b31-36d68aeaeefb admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:34.068915 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8439f-3494-4e0d-8b31-36d68aeaeefb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:34.071355 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8439f-3494-4e0d-8b31-36d68aeaeefb admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:34.092761 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1348/2698] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:36:34 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:34.097349 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1b8fc-5f69-4432-8bc6-ea11f5f2029d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:34.107571 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1b8fc-5f69-4432-8bc6-ea11f5f2029d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:34.112110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13526c8-2d1c-4aa3-b5c2-4c7ef9c8441e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:34.112698 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13526c8-2d1c-4aa3-b5c2-4c7ef9c8441e admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:34.112973 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13526c8-2d1c-4aa3-b5c2-4c7ef9c8441e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:34.113350 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13526c8-2d1c-4aa3-b5c2-4c7ef9c8441e admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:34.113977 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13526c8-2d1c-4aa3-b5c2-4c7ef9c8441e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:34.115823 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13526c8-2d1c-4aa3-b5c2-4c7ef9c8441e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:34.125705 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1351/2699] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:34.129605 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8439f-3494-4e0d-8b31-36d68aeaeefb admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:34.139979 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8439f-3494-4e0d-8b31-36d68aeaeefb admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:34.144580 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa25a3-89a1-4e62-a789-4cae924395c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:34.145199 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa25a3-89a1-4e62-a789-4cae924395c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:34.145482 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa25a3-89a1-4e62-a789-4cae924395c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:34.145756 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa25a3-89a1-4e62-a789-4cae924395c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:34.146404 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa25a3-89a1-4e62-a789-4cae924395c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:34.148584 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa25a3-89a1-4e62-a789-4cae924395c2 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:34.159428 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1349/2700] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:34.163827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13526c8-2d1c-4aa3-b5c2-4c7ef9c8441e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:34.174470 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13526c8-2d1c-4aa3-b5c2-4c7ef9c8441e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:34.179209 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61c75c-99e9-4530-b6f0-9c89699521f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:34.179864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61c75c-99e9-4530-b6f0-9c89699521f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:34.180145 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61c75c-99e9-4530-b6f0-9c89699521f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:34.180422 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61c75c-99e9-4530-b6f0-9c89699521f7 admin admin] PATH_INFO: `/v3/projects/2ed7872d26a24ab588c66526b316faa9/users/20746650c39e4f5a83a04cf7b1a25898/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:34.197535 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61c75c-99e9-4530-b6f0-9c89699521f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed7872d26a24ab588c66526b316faa9, user_id=20746650c39e4f5a83a04cf7b1a25898, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:34.200338 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61c75c-99e9-4530-b6f0-9c89699521f7 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:34.214835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1352/2701] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:36:34 2022] PUT /identity/v3/projects/2ed7872d26a24ab588c66526b316faa9/users/20746650c39e4f5a83a04cf7b1a25898/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:34.229205 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8025c61-635e-48ac-998f-73823fc52286 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:34.229205 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8025c61-635e-48ac-998f-73823fc52286 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:34.229205 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8025c61-635e-48ac-998f-73823fc52286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:34.256705 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c8025c61-635e-48ac-998f-73823fc52286 None None] MFA Rules not processed for user `20746650c39e4f5a83a04cf7b1a25898`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:34.258113 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c8025c61-635e-48ac-998f-73823fc52286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:34.270250 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:34.328797 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1350/2702] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:34.341159 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61c75c-99e9-4530-b6f0-9c89699521f7 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:34.342942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-db61c75c-99e9-4530-b6f0-9c89699521f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:34.348637 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:34.403659 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61c75c-99e9-4530-b6f0-9c89699521f7 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:34.407376 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa0f8f-71a2-4651-aabd-0612d55618d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:34.408023 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa0f8f-71a2-4651-aabd-0612d55618d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:34.408311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa0f8f-71a2-4651-aabd-0612d55618d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:34.408588 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa0f8f-71a2-4651-aabd-0612d55618d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:34.418310 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa0f8f-71a2-4651-aabd-0612d55618d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:34.419744 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa0f8f-71a2-4651-aabd-0612d55618d8 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:34.428912 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1353/2703] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:37.759034 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8025c61-635e-48ac-998f-73823fc52286 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:37.760594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c8025c61-635e-48ac-998f-73823fc52286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:37.824496 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8025c61-635e-48ac-998f-73823fc52286 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:37.828958 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa1d4c-81c1-4bc0-baa3-0fffeab3f72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:37.829604 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa1d4c-81c1-4bc0-baa3-0fffeab3f72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:37.829918 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa1d4c-81c1-4bc0-baa3-0fffeab3f72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:37.830401 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa1d4c-81c1-4bc0-baa3-0fffeab3f72e admin admin] PATH_INFO: `/v3/users/7828a294fd6b4df8bbf0fd25a9752a8a` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:37.831455 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa1d4c-81c1-4bc0-baa3-0fffeab3f72e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7828a294fd6b4df8bbf0fd25a9752a8a)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:37.833395 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa1d4c-81c1-4bc0-baa3-0fffeab3f72e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:37.879848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-3afa1d4c-81c1-4bc0-baa3-0fffeab3f72e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7828a294fd6b4df8bbf0fd25a9752a8a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:37.886892 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-3afa1d4c-81c1-4bc0-baa3-0fffeab3f72e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7828a294fd6b4df8bbf0fd25a9752a8a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:37.893981 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-3afa1d4c-81c1-4bc0-baa3-0fffeab3f72e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7828a294fd6b4df8bbf0fd25a9752a8a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:37.894652 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-3afa1d4c-81c1-4bc0-baa3-0fffeab3f72e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7828a294fd6b4df8bbf0fd25a9752a8a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:37.906456 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-3afa1d4c-81c1-4bc0-baa3-0fffeab3f72e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7828a294fd6b4df8bbf0fd25a9752a8a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:37.912879 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1351/2704] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:36:37 2022] DELETE /identity/v3/users/7828a294fd6b4df8bbf0fd25a9752a8a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:37.918037 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efa71f-518f-43d1-834b-bd4b6bf6c1b7 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:37.918503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efa71f-518f-43d1-834b-bd4b6bf6c1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:37.918621 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efa71f-518f-43d1-834b-bd4b6bf6c1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:37.938876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-24efa71f-518f-43d1-834b-bd4b6bf6c1b7 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:37.940215 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-24efa71f-518f-43d1-834b-bd4b6bf6c1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:37.999644 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1354/2705] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:36:38.009295 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa1d4c-81c1-4bc0-baa3-0fffeab3f72e admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:38.010714 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-3afa1d4c-81c1-4bc0-baa3-0fffeab3f72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:38.046837 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:38.070563 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa1d4c-81c1-4bc0-baa3-0fffeab3f72e admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:38.074167 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aac817-5e8e-45e6-bf90-0e5fdf8dd716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:38.074766 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aac817-5e8e-45e6-bf90-0e5fdf8dd716 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:38.075041 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aac817-5e8e-45e6-bf90-0e5fdf8dd716 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:38.075313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aac817-5e8e-45e6-bf90-0e5fdf8dd716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:38.084018 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aac817-5e8e-45e6-bf90-0e5fdf8dd716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:38.086035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aac817-5e8e-45e6-bf90-0e5fdf8dd716 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:38.095298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1352/2706] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:38.360601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efa71f-518f-43d1-834b-bd4b6bf6c1b7 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:38.362227 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-24efa71f-518f-43d1-834b-bd4b6bf6c1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:38.375149 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efa71f-518f-43d1-834b-bd4b6bf6c1b7 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:38.379876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b84ae-277e-497c-9227-fb61c00e1e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:38.380615 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b84ae-277e-497c-9227-fb61c00e1e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:38.380894 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b84ae-277e-497c-9227-fb61c00e1e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:38.381213 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b84ae-277e-497c-9227-fb61c00e1e6a admin admin] PATH_INFO: `/v3/projects/7043171ed5f44ce4bf649662a4514741` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:38.383321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b84ae-277e-497c-9227-fb61c00e1e6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7043171ed5f44ce4bf649662a4514741)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:38.384935 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b84ae-277e-497c-9227-fb61c00e1e6a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:38.431152 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fe0b84ae-277e-497c-9227-fb61c00e1e6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7043171ed5f44ce4bf649662a4514741', 'request_id': 'req-fe0b84ae-277e-497c-9227-fb61c00e1e6a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:38.436598 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fe0b84ae-277e-497c-9227-fb61c00e1e6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7043171ed5f44ce4bf649662a4514741', 'request_id': 'req-fe0b84ae-277e-497c-9227-fb61c00e1e6a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:38.442863 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fe0b84ae-277e-497c-9227-fb61c00e1e6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7043171ed5f44ce4bf649662a4514741', 'request_id': 'req-fe0b84ae-277e-497c-9227-fb61c00e1e6a'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:38.455196 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fe0b84ae-277e-497c-9227-fb61c00e1e6a admin admin] The token cache is being invalidate because project 7043171ed5f44ce4bf649662a4514741 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:36:38.455485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fe0b84ae-277e-497c-9227-fb61c00e1e6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:38.456134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-fe0b84ae-277e-497c-9227-fb61c00e1e6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:38.457628 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1355/2707] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:36:38 2022] DELETE /identity/v3/projects/7043171ed5f44ce4bf649662a4514741 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:38.462239 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aac817-5e8e-45e6-bf90-0e5fdf8dd716 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:38.471975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aac817-5e8e-45e6-bf90-0e5fdf8dd716 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:38.525801 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741b784-990c-4d19-95a0-3590dd0ed5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:38.526426 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741b784-990c-4d19-95a0-3590dd0ed5b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:38.526843 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741b784-990c-4d19-95a0-3590dd0ed5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:38.527150 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741b784-990c-4d19-95a0-3590dd0ed5b2 admin admin] PATH_INFO: `/v3/users/df47a48f9bcc489cbda5307c170f40b6` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:38.528254 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741b784-990c-4d19-95a0-3590dd0ed5b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df47a48f9bcc489cbda5307c170f40b6)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:38.530276 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741b784-990c-4d19-95a0-3590dd0ed5b2 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:38.575869 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4741b784-990c-4d19-95a0-3590dd0ed5b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df47a48f9bcc489cbda5307c170f40b6'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:38.582790 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4741b784-990c-4d19-95a0-3590dd0ed5b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df47a48f9bcc489cbda5307c170f40b6'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:38.590189 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4741b784-990c-4d19-95a0-3590dd0ed5b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df47a48f9bcc489cbda5307c170f40b6'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:38.590839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4741b784-990c-4d19-95a0-3590dd0ed5b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df47a48f9bcc489cbda5307c170f40b6'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:38.604274 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4741b784-990c-4d19-95a0-3590dd0ed5b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df47a48f9bcc489cbda5307c170f40b6'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:38.610219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1353/2708] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:36:38 2022] DELETE /identity/v3/users/df47a48f9bcc489cbda5307c170f40b6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:38.906783 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b84ae-277e-497c-9227-fb61c00e1e6a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:38.908683 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-fe0b84ae-277e-497c-9227-fb61c00e1e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:38.923869 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b84ae-277e-497c-9227-fb61c00e1e6a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:38.953841 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:38.991432 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52ed01-c00e-415c-95a2-8a07e65c9565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:38.992603 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52ed01-c00e-415c-95a2-8a07e65c9565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:38.992884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52ed01-c00e-415c-95a2-8a07e65c9565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:38.993190 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52ed01-c00e-415c-95a2-8a07e65c9565 admin admin] PATH_INFO: `/v3/projects/da477f61138747a9a75fdf04814ea7b7` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:38.994314 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52ed01-c00e-415c-95a2-8a07e65c9565 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da477f61138747a9a75fdf04814ea7b7)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:38.996217 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52ed01-c00e-415c-95a2-8a07e65c9565 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:39.041825 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ff52ed01-c00e-415c-95a2-8a07e65c9565 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da477f61138747a9a75fdf04814ea7b7', 'request_id': 'req-ff52ed01-c00e-415c-95a2-8a07e65c9565'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:39.047354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ff52ed01-c00e-415c-95a2-8a07e65c9565 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da477f61138747a9a75fdf04814ea7b7', 'request_id': 'req-ff52ed01-c00e-415c-95a2-8a07e65c9565'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:39.053751 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ff52ed01-c00e-415c-95a2-8a07e65c9565 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da477f61138747a9a75fdf04814ea7b7', 'request_id': 'req-ff52ed01-c00e-415c-95a2-8a07e65c9565'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:39.067663 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ff52ed01-c00e-415c-95a2-8a07e65c9565 admin admin] The token cache is being invalidate because project da477f61138747a9a75fdf04814ea7b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:36:39.067946 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ff52ed01-c00e-415c-95a2-8a07e65c9565 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:39.068666 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-ff52ed01-c00e-415c-95a2-8a07e65c9565 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:39.072270 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1356/2709] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:36:38 2022] DELETE /identity/v3/projects/da477f61138747a9a75fdf04814ea7b7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:39.077626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c541f-fb1c-4b8d-9eee-aaa86d8efaf1 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:39.078112 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c541f-fb1c-4b8d-9eee-aaa86d8efaf1 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:39.078315 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c541f-fb1c-4b8d-9eee-aaa86d8efaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:39.097996 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-ef5c541f-fb1c-4b8d-9eee-aaa86d8efaf1 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:39.099220 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ef5c541f-fb1c-4b8d-9eee-aaa86d8efaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:39.147932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:39.159896 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1354/2710] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:39.168242 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3c84e-e9d1-4659-b017-2cb2bdae1dbe None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:39.168532 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3c84e-e9d1-4659-b017-2cb2bdae1dbe None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:39.168998 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3c84e-e9d1-4659-b017-2cb2bdae1dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:39.188334 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-44a3c84e-e9d1-4659-b017-2cb2bdae1dbe None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:39.189577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-44a3c84e-e9d1-4659-b017-2cb2bdae1dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:39.199123 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1357/2711] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:39.203392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c541f-fb1c-4b8d-9eee-aaa86d8efaf1 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:39.213785 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c541f-fb1c-4b8d-9eee-aaa86d8efaf1 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:39.218576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc48ffe-8794-4244-be1e-f5623ecb4080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:39.219248 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc48ffe-8794-4244-be1e-f5623ecb4080 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:39.219602 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc48ffe-8794-4244-be1e-f5623ecb4080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:39.219908 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc48ffe-8794-4244-be1e-f5623ecb4080 admin admin] PATH_INFO: `/v3/domains` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:39.220821 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc48ffe-8794-4244-be1e-f5623ecb4080 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80286) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:36:39.221153 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc48ffe-8794-4244-be1e-f5623ecb4080 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:39.222748 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc48ffe-8794-4244-be1e-f5623ecb4080 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:39.238015 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1355/2712] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:36:39.239051 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3c84e-e9d1-4659-b017-2cb2bdae1dbe None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:39.248480 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3c84e-e9d1-4659-b017-2cb2bdae1dbe None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:39.253156 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec854d02-6010-4c31-936a-c6cbeecc77ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:39.253748 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec854d02-6010-4c31-936a-c6cbeecc77ad admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:39.254027 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec854d02-6010-4c31-936a-c6cbeecc77ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:39.254295 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec854d02-6010-4c31-936a-c6cbeecc77ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:39.254908 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec854d02-6010-4c31-936a-c6cbeecc77ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:39.256801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec854d02-6010-4c31-936a-c6cbeecc77ad admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:39.305166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1358/2713] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:36:39 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:39.306863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc48ffe-8794-4244-be1e-f5623ecb4080 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:39.317004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc48ffe-8794-4244-be1e-f5623ecb4080 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:39.376888 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480fb2d-f73e-45d0-854c-c736e32a4131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:39.377562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480fb2d-f73e-45d0-854c-c736e32a4131 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:39.377835 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480fb2d-f73e-45d0-854c-c736e32a4131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:39.378106 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480fb2d-f73e-45d0-854c-c736e32a4131 admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:39.378761 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480fb2d-f73e-45d0-854c-c736e32a4131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:39.380720 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5480fb2d-f73e-45d0-854c-c736e32a4131 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:39.408914 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1356/2714] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:36:39 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:39.410329 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec854d02-6010-4c31-936a-c6cbeecc77ad admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:39.421498 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec854d02-6010-4c31-936a-c6cbeecc77ad admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:39.426735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f66b9-d8c7-420f-b64c-c81bd8d18754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:39.427373 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f66b9-d8c7-420f-b64c-c81bd8d18754 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:39.427654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f66b9-d8c7-420f-b64c-c81bd8d18754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:39.427928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f66b9-d8c7-420f-b64c-c81bd8d18754 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:39.428607 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f66b9-d8c7-420f-b64c-c81bd8d18754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:39.430316 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f66b9-d8c7-420f-b64c-c81bd8d18754 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:39.441956 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1359/2715] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:39.446593 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480fb2d-f73e-45d0-854c-c736e32a4131 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:39.457190 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480fb2d-f73e-45d0-854c-c736e32a4131 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:39.462633 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c0bdc-a777-4319-835e-ee57dfb0c1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:39.463294 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c0bdc-a777-4319-835e-ee57dfb0c1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:39.463644 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c0bdc-a777-4319-835e-ee57dfb0c1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:39.463846 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c0bdc-a777-4319-835e-ee57dfb0c1c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:39.464509 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c0bdc-a777-4319-835e-ee57dfb0c1c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:39.466175 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c0bdc-a777-4319-835e-ee57dfb0c1c6 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:39.478450 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1357/2716] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:39.482828 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f66b9-d8c7-420f-b64c-c81bd8d18754 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:39.494113 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f66b9-d8c7-420f-b64c-c81bd8d18754 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:39.498940 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368c7a0-7dc3-4c04-a488-d039b8281766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:39.499642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368c7a0-7dc3-4c04-a488-d039b8281766 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:39.499921 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368c7a0-7dc3-4c04-a488-d039b8281766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:39.500196 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368c7a0-7dc3-4c04-a488-d039b8281766 admin admin] PATH_INFO: `/v3/projects/951339f4ffe54c3ea6fda5f79ba5dbf9/users/10189f7c039f45c4b60111fc1552da5c/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:39.517000 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368c7a0-7dc3-4c04-a488-d039b8281766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=951339f4ffe54c3ea6fda5f79ba5dbf9, user_id=10189f7c039f45c4b60111fc1552da5c, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:39.519689 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368c7a0-7dc3-4c04-a488-d039b8281766 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:39.533357 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1360/2717] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:36:39 2022] PUT /identity/v3/projects/951339f4ffe54c3ea6fda5f79ba5dbf9/users/10189f7c039f45c4b60111fc1552da5c/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:39.543644 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369dbf0-1cff-4bbb-a071-2c4e3a7630bc None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:39.543932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369dbf0-1cff-4bbb-a071-2c4e3a7630bc None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:39.544215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369dbf0-1cff-4bbb-a071-2c4e3a7630bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:39.572705 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c369dbf0-1cff-4bbb-a071-2c4e3a7630bc None None] MFA Rules not processed for user `10189f7c039f45c4b60111fc1552da5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:39.573968 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c369dbf0-1cff-4bbb-a071-2c4e3a7630bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:39.639490 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1358/2718] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:39.647455 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368c7a0-7dc3-4c04-a488-d039b8281766 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:39.700311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:39.705796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368c7a0-7dc3-4c04-a488-d039b8281766 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:39.712327 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91a5b3-2686-438b-8a46-60af59515fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:39.713328 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91a5b3-2686-438b-8a46-60af59515fda admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:39.713735 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91a5b3-2686-438b-8a46-60af59515fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:39.714245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91a5b3-2686-438b-8a46-60af59515fda admin admin] PATH_INFO: `/v3/projects` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:39.715013 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91a5b3-2686-438b-8a46-60af59515fda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:39.717455 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91a5b3-2686-438b-8a46-60af59515fda admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:39.750476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1361/2719] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:36:39 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:39.754632 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369dbf0-1cff-4bbb-a071-2c4e3a7630bc None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:39.766018 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369dbf0-1cff-4bbb-a071-2c4e3a7630bc None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:39.829523 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:39.840655 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a58648-8f30-4467-ad02-9c6f9c38800e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:39.841332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a58648-8f30-4467-ad02-9c6f9c38800e admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:39.841613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a58648-8f30-4467-ad02-9c6f9c38800e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:39.841886 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a58648-8f30-4467-ad02-9c6f9c38800e admin admin] PATH_INFO: `/v3/users` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:39.842532 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a58648-8f30-4467-ad02-9c6f9c38800e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:39.844432 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a58648-8f30-4467-ad02-9c6f9c38800e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:39.867494 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1359/2720] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:36:39 2022] POST /identity/v3/users => generated 300 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:36:39.871476 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91a5b3-2686-438b-8a46-60af59515fda admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:39.884514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91a5b3-2686-438b-8a46-60af59515fda admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:39.889577 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ec711-17b9-4f15-959e-a1f8f10a97e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:39.890235 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ec711-17b9-4f15-959e-a1f8f10a97e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:39.890512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ec711-17b9-4f15-959e-a1f8f10a97e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:39.890807 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ec711-17b9-4f15-959e-a1f8f10a97e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:39.891478 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ec711-17b9-4f15-959e-a1f8f10a97e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:39.893137 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ec711-17b9-4f15-959e-a1f8f10a97e2 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:39.904250 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1362/2721] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:36:39.908466 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a58648-8f30-4467-ad02-9c6f9c38800e admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:39.918951 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a58648-8f30-4467-ad02-9c6f9c38800e admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:39.923595 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1f75f-7d5f-4289-b434-6a5553de38b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:39.924250 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1f75f-7d5f-4289-b434-6a5553de38b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:39.924530 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1f75f-7d5f-4289-b434-6a5553de38b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:39.924807 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1f75f-7d5f-4289-b434-6a5553de38b4 admin admin] PATH_INFO: `/v3/projects/9a4f64e0ad9c47d08450c8583a5ebb9d/users/67d35c96bfe549118186ee2fdf4dd830/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:39.940174 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1f75f-7d5f-4289-b434-6a5553de38b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a4f64e0ad9c47d08450c8583a5ebb9d, user_id=67d35c96bfe549118186ee2fdf4dd830, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:39.942857 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e1f75f-7d5f-4289-b434-6a5553de38b4 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:39.959678 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1360/2722] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:36:39 2022] PUT /identity/v3/projects/9a4f64e0ad9c47d08450c8583a5ebb9d/users/67d35c96bfe549118186ee2fdf4dd830/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:36:39.963955 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ec711-17b9-4f15-959e-a1f8f10a97e2 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:39.980006 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ec711-17b9-4f15-959e-a1f8f10a97e2 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:40.037120 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c851e3a-d086-4a3e-a118-10cfb9a653e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:40.037726 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c851e3a-d086-4a3e-a118-10cfb9a653e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:40.038002 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c851e3a-d086-4a3e-a118-10cfb9a653e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:40.038268 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c851e3a-d086-4a3e-a118-10cfb9a653e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:40.039437 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c851e3a-d086-4a3e-a118-10cfb9a653e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:40.041003 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c851e3a-d086-4a3e-a118-10cfb9a653e2 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:40.051111 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1363/2723] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:40.055762 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1f75f-7d5f-4289-b434-6a5553de38b4 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:40.066277 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e1f75f-7d5f-4289-b434-6a5553de38b4 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:40.070822 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80cf8e9-43ed-4fcb-9da4-9fe18ca8424e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:40.071468 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cf8e9-43ed-4fcb-9da4-9fe18ca8424e admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:40.071759 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cf8e9-43ed-4fcb-9da4-9fe18ca8424e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:40.072022 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80cf8e9-43ed-4fcb-9da4-9fe18ca8424e admin admin] PATH_INFO: `/v3/projects/9a4f64e0ad9c47d08450c8583a5ebb9d/users/67d35c96bfe549118186ee2fdf4dd830/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:40.074048 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80cf8e9-43ed-4fcb-9da4-9fe18ca8424e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a4f64e0ad9c47d08450c8583a5ebb9d, user_id=67d35c96bfe549118186ee2fdf4dd830, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:40.076658 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80cf8e9-43ed-4fcb-9da4-9fe18ca8424e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:40.086764 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1361/2724] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:36:40 2022] PUT /identity/v3/projects/9a4f64e0ad9c47d08450c8583a5ebb9d/users/67d35c96bfe549118186ee2fdf4dd830/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:36:40.098199 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b0f20-30e2-4258-8468-860836cdfd37 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:40.098489 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b0f20-30e2-4258-8468-860836cdfd37 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:40.098788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b0f20-30e2-4258-8468-860836cdfd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:40.127845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e47b0f20-30e2-4258-8468-860836cdfd37 None None] MFA Rules not processed for user `67d35c96bfe549118186ee2fdf4dd830`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:40.129063 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e47b0f20-30e2-4258-8468-860836cdfd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:40.196659 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1364/2725] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:40.208091 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80cf8e9-43ed-4fcb-9da4-9fe18ca8424e admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:40.210004 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f80cf8e9-43ed-4fcb-9da4-9fe18ca8424e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:40.268175 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80cf8e9-43ed-4fcb-9da4-9fe18ca8424e admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:40.271897 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183b031-af1f-4714-bc4f-90a538c6785a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:40.272502 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183b031-af1f-4714-bc4f-90a538c6785a service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:40.273322 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183b031-af1f-4714-bc4f-90a538c6785a service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:40.273611 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183b031-af1f-4714-bc4f-90a538c6785a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:40.282634 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183b031-af1f-4714-bc4f-90a538c6785a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:40.284063 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183b031-af1f-4714-bc4f-90a538c6785a service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:40.294625 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1362/2726] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:40.367937 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b0f20-30e2-4258-8468-860836cdfd37 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:40.423471 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:40.439490 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b0f20-30e2-4258-8468-860836cdfd37 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:40.444513 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204aeed-bfbf-43bc-bfe5-f073540e1e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:40.445814 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204aeed-bfbf-43bc-bfe5-f073540e1e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:40.446096 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204aeed-bfbf-43bc-bfe5-f073540e1e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:40.446367 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204aeed-bfbf-43bc-bfe5-f073540e1e91 admin admin] PATH_INFO: `/v3/users/10189f7c039f45c4b60111fc1552da5c` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:40.447509 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204aeed-bfbf-43bc-bfe5-f073540e1e91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10189f7c039f45c4b60111fc1552da5c)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:40.449496 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204aeed-bfbf-43bc-bfe5-f073540e1e91 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:40.498475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2204aeed-bfbf-43bc-bfe5-f073540e1e91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10189f7c039f45c4b60111fc1552da5c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:40.507172 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2204aeed-bfbf-43bc-bfe5-f073540e1e91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10189f7c039f45c4b60111fc1552da5c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:40.508329 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2204aeed-bfbf-43bc-bfe5-f073540e1e91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10189f7c039f45c4b60111fc1552da5c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:40.520688 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2204aeed-bfbf-43bc-bfe5-f073540e1e91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10189f7c039f45c4b60111fc1552da5c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:40.535041 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2204aeed-bfbf-43bc-bfe5-f073540e1e91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10189f7c039f45c4b60111fc1552da5c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:40.541850 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1365/2727] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:36:40 2022] DELETE /identity/v3/users/10189f7c039f45c4b60111fc1552da5c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:40.546321 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34125f16-f4f8-411d-bb2a-36c814ab2be6 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:40.546678 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34125f16-f4f8-411d-bb2a-36c814ab2be6 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:40.547021 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34125f16-f4f8-411d-bb2a-36c814ab2be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:40.566542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-34125f16-f4f8-411d-bb2a-36c814ab2be6 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:40.567851 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-34125f16-f4f8-411d-bb2a-36c814ab2be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:40.630417 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1363/2728] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:40.639876 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204aeed-bfbf-43bc-bfe5-f073540e1e91 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:40.641397 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-2204aeed-bfbf-43bc-bfe5-f073540e1e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:40.702163 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204aeed-bfbf-43bc-bfe5-f073540e1e91 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:40.706162 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af1593-2a1e-4c84-8bdb-8a43aef21e77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:40.706765 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af1593-2a1e-4c84-8bdb-8a43aef21e77 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:40.707050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af1593-2a1e-4c84-8bdb-8a43aef21e77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:40.707321 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af1593-2a1e-4c84-8bdb-8a43aef21e77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:40.716230 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af1593-2a1e-4c84-8bdb-8a43aef21e77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:40.717739 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af1593-2a1e-4c84-8bdb-8a43aef21e77 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:40.730065 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1366/2729] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:41.010085 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34125f16-f4f8-411d-bb2a-36c814ab2be6 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:41.011516 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-34125f16-f4f8-411d-bb2a-36c814ab2be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:41.024813 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34125f16-f4f8-411d-bb2a-36c814ab2be6 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:41.030247 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da6f5a-7809-4486-a1d0-22793304808b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:41.031037 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da6f5a-7809-4486-a1d0-22793304808b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:41.031792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da6f5a-7809-4486-a1d0-22793304808b admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:41.031792 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da6f5a-7809-4486-a1d0-22793304808b admin admin] PATH_INFO: `/v3/projects/951339f4ffe54c3ea6fda5f79ba5dbf9` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:41.032865 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da6f5a-7809-4486-a1d0-22793304808b admin admin] RBAC: Authorizing `identity:delete_project(project_id=951339f4ffe54c3ea6fda5f79ba5dbf9)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:41.035164 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da6f5a-7809-4486-a1d0-22793304808b admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:41.077851 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:41.084912 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-02da6f5a-7809-4486-a1d0-22793304808b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '951339f4ffe54c3ea6fda5f79ba5dbf9', 'request_id': 'req-02da6f5a-7809-4486-a1d0-22793304808b'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:41.091657 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-02da6f5a-7809-4486-a1d0-22793304808b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '951339f4ffe54c3ea6fda5f79ba5dbf9', 'request_id': 'req-02da6f5a-7809-4486-a1d0-22793304808b'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:41.098122 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-02da6f5a-7809-4486-a1d0-22793304808b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '951339f4ffe54c3ea6fda5f79ba5dbf9', 'request_id': 'req-02da6f5a-7809-4486-a1d0-22793304808b'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:41.112698 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-02da6f5a-7809-4486-a1d0-22793304808b admin admin] The token cache is being invalidate because project 951339f4ffe54c3ea6fda5f79ba5dbf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:36:41.112997 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-02da6f5a-7809-4486-a1d0-22793304808b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:41.113697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-02da6f5a-7809-4486-a1d0-22793304808b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:41.115296 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1364/2730] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:36:41 2022] DELETE /identity/v3/projects/951339f4ffe54c3ea6fda5f79ba5dbf9 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:41.119337 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af1593-2a1e-4c84-8bdb-8a43aef21e77 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:41.129381 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af1593-2a1e-4c84-8bdb-8a43aef21e77 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:41.188694 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8fd07-99ab-4da1-b223-cd1c715fbfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:41.189361 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8fd07-99ab-4da1-b223-cd1c715fbfef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:41.189691 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8fd07-99ab-4da1-b223-cd1c715fbfef admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:41.189969 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8fd07-99ab-4da1-b223-cd1c715fbfef admin admin] PATH_INFO: `/v3/users/67d35c96bfe549118186ee2fdf4dd830` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:41.191190 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8fd07-99ab-4da1-b223-cd1c715fbfef admin admin] RBAC: Authorizing `identity:delete_user(user_id=67d35c96bfe549118186ee2fdf4dd830)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:41.193294 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8fd07-99ab-4da1-b223-cd1c715fbfef admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:41.208562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:41.243296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3ee8fd07-99ab-4da1-b223-cd1c715fbfef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67d35c96bfe549118186ee2fdf4dd830'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:41.250072 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3ee8fd07-99ab-4da1-b223-cd1c715fbfef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67d35c96bfe549118186ee2fdf4dd830'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:41.250702 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3ee8fd07-99ab-4da1-b223-cd1c715fbfef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67d35c96bfe549118186ee2fdf4dd830'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:41.262678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3ee8fd07-99ab-4da1-b223-cd1c715fbfef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67d35c96bfe549118186ee2fdf4dd830'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:41.269659 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-3ee8fd07-99ab-4da1-b223-cd1c715fbfef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67d35c96bfe549118186ee2fdf4dd830'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:41.276178 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1367/2731] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:36:41 2022] DELETE /identity/v3/users/67d35c96bfe549118186ee2fdf4dd830 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:41.548079 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da6f5a-7809-4486-a1d0-22793304808b admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:41.549610 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-02da6f5a-7809-4486-a1d0-22793304808b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:41.564162 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da6f5a-7809-4486-a1d0-22793304808b admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:41.622076 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8084a-8538-4c78-be12-eaa951413f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:41.622715 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8084a-8538-4c78-be12-eaa951413f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:41.622994 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8084a-8538-4c78-be12-eaa951413f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:41.623264 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8084a-8538-4c78-be12-eaa951413f04 admin admin] PATH_INFO: `/v3/projects/9a4f64e0ad9c47d08450c8583a5ebb9d` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:41.624423 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8084a-8538-4c78-be12-eaa951413f04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a4f64e0ad9c47d08450c8583a5ebb9d)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:41.626459 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8084a-8538-4c78-be12-eaa951413f04 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:41.672867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-33b8084a-8538-4c78-be12-eaa951413f04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a4f64e0ad9c47d08450c8583a5ebb9d', 'request_id': 'req-33b8084a-8538-4c78-be12-eaa951413f04'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:41.678171 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-33b8084a-8538-4c78-be12-eaa951413f04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a4f64e0ad9c47d08450c8583a5ebb9d', 'request_id': 'req-33b8084a-8538-4c78-be12-eaa951413f04'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:41.684235 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-33b8084a-8538-4c78-be12-eaa951413f04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a4f64e0ad9c47d08450c8583a5ebb9d', 'request_id': 'req-33b8084a-8538-4c78-be12-eaa951413f04'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:41.698587 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-33b8084a-8538-4c78-be12-eaa951413f04 admin admin] The token cache is being invalidate because project 9a4f64e0ad9c47d08450c8583a5ebb9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:36:41.699077 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-33b8084a-8538-4c78-be12-eaa951413f04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:41.699793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-33b8084a-8538-4c78-be12-eaa951413f04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:41.701461 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1365/2732] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:36:41 2022] DELETE /identity/v3/projects/9a4f64e0ad9c47d08450c8583a5ebb9d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:41.706430 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d39397-19c7-4a69-b396-36367cec03c5 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:41.706725 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d39397-19c7-4a69-b396-36367cec03c5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:41.707002 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d39397-19c7-4a69-b396-36367cec03c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:41.728962 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e6d39397-19c7-4a69-b396-36367cec03c5 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:41.730271 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e6d39397-19c7-4a69-b396-36367cec03c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:41.788286 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1368/2733] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:41.796011 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb9e36-4b5c-4e62-a48d-f4576de74636 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:41.796373 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb9e36-4b5c-4e62-a48d-f4576de74636 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:41.796725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb9e36-4b5c-4e62-a48d-f4576de74636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:41.816385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-44eb9e36-4b5c-4e62-a48d-f4576de74636 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:41.817740 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-44eb9e36-4b5c-4e62-a48d-f4576de74636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:41.826298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1366/2734] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:41.830431 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d39397-19c7-4a69-b396-36367cec03c5 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:41.840034 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d39397-19c7-4a69-b396-36367cec03c5 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:41.844524 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66104cbd-950e-45b1-8521-44e9973fe104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:41.845144 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66104cbd-950e-45b1-8521-44e9973fe104 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:41.845679 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66104cbd-950e-45b1-8521-44e9973fe104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:41.845947 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66104cbd-950e-45b1-8521-44e9973fe104 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:41.846585 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66104cbd-950e-45b1-8521-44e9973fe104 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:36:41.846884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66104cbd-950e-45b1-8521-44e9973fe104 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:41.848503 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66104cbd-950e-45b1-8521-44e9973fe104 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:41.860122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1369/2735] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:36:41.864430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb9e36-4b5c-4e62-a48d-f4576de74636 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:41.874128 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb9e36-4b5c-4e62-a48d-f4576de74636 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:41.878776 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301cded-414b-41be-afe9-b0fa547d6ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:41.879361 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301cded-414b-41be-afe9-b0fa547d6ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:41.879640 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301cded-414b-41be-afe9-b0fa547d6ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:41.879914 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301cded-414b-41be-afe9-b0fa547d6ae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:41.880551 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301cded-414b-41be-afe9-b0fa547d6ae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:41.882469 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301cded-414b-41be-afe9-b0fa547d6ae6 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:41.910559 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1367/2736] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:36:41 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:36:41.914443 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66104cbd-950e-45b1-8521-44e9973fe104 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:41.924354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66104cbd-950e-45b1-8521-44e9973fe104 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:41.981879 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192bc80-e4f7-40cc-9023-94275037ef28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:41.982498 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192bc80-e4f7-40cc-9023-94275037ef28 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:41.982775 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192bc80-e4f7-40cc-9023-94275037ef28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:41.983045 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192bc80-e4f7-40cc-9023-94275037ef28 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:41.983678 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192bc80-e4f7-40cc-9023-94275037ef28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:41.985617 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192bc80-e4f7-40cc-9023-94275037ef28 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:42.006626 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1370/2737] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:36:41 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:36:42.011476 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301cded-414b-41be-afe9-b0fa547d6ae6 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:42.021670 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301cded-414b-41be-afe9-b0fa547d6ae6 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:42.026412 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b9551-a64a-4833-b6c3-75cf67f1db33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:42.027003 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b9551-a64a-4833-b6c3-75cf67f1db33 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:42.027280 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b9551-a64a-4833-b6c3-75cf67f1db33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:42.027548 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b9551-a64a-4833-b6c3-75cf67f1db33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:42.028208 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b9551-a64a-4833-b6c3-75cf67f1db33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:42.029826 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b9551-a64a-4833-b6c3-75cf67f1db33 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:42.039633 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1368/2738] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:42.043394 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192bc80-e4f7-40cc-9023-94275037ef28 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:42.053402 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192bc80-e4f7-40cc-9023-94275037ef28 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:42.058675 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44a5e3-5160-44fb-b608-8e0fcc2168a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:42.059266 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44a5e3-5160-44fb-b608-8e0fcc2168a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:42.059547 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44a5e3-5160-44fb-b608-8e0fcc2168a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:42.059816 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44a5e3-5160-44fb-b608-8e0fcc2168a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:42.060455 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44a5e3-5160-44fb-b608-8e0fcc2168a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:42.062071 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44a5e3-5160-44fb-b608-8e0fcc2168a0 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:42.064104 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:42.074284 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1371/2739] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:42.078172 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b9551-a64a-4833-b6c3-75cf67f1db33 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:42.087843 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b9551-a64a-4833-b6c3-75cf67f1db33 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:42.092334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231b60b-9832-4077-ba7f-d926125d16dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:42.092967 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231b60b-9832-4077-ba7f-d926125d16dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:42.093302 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231b60b-9832-4077-ba7f-d926125d16dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:42.093575 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231b60b-9832-4077-ba7f-d926125d16dd admin admin] PATH_INFO: `/v3/projects/5bb4d03c036b4fd69096a845cd7af861/users/86c40259c92943d0a6ea00ef2bef8425/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:42.108478 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231b60b-9832-4077-ba7f-d926125d16dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bb4d03c036b4fd69096a845cd7af861, user_id=86c40259c92943d0a6ea00ef2bef8425, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:42.111131 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231b60b-9832-4077-ba7f-d926125d16dd admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:42.114194 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:42.128991 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1369/2740] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:36:42 2022] PUT /identity/v3/projects/5bb4d03c036b4fd69096a845cd7af861/users/86c40259c92943d0a6ea00ef2bef8425/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:36:42.139219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbae14b-acb8-4a26-b8bb-9c111c80f73c None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:42.139682 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbae14b-acb8-4a26-b8bb-9c111c80f73c None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:42.139808 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbae14b-acb8-4a26-b8bb-9c111c80f73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:42.167137 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-cdbae14b-acb8-4a26-b8bb-9c111c80f73c None None] MFA Rules not processed for user `86c40259c92943d0a6ea00ef2bef8425`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:42.168366 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-cdbae14b-acb8-4a26-b8bb-9c111c80f73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:42.232210 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1372/2741] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:42.244091 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231b60b-9832-4077-ba7f-d926125d16dd admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:42.247056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2231b60b-9832-4077-ba7f-d926125d16dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:42.307689 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231b60b-9832-4077-ba7f-d926125d16dd admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:42.311868 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afa6bc-d594-430e-94b5-c22c40c1e30b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:42.312481 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afa6bc-d594-430e-94b5-c22c40c1e30b service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:42.312760 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afa6bc-d594-430e-94b5-c22c40c1e30b service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:42.313052 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afa6bc-d594-430e-94b5-c22c40c1e30b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:42.321442 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afa6bc-d594-430e-94b5-c22c40c1e30b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:42.323043 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afa6bc-d594-430e-94b5-c22c40c1e30b service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:42.333664 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1370/2742] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:42.355888 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbae14b-acb8-4a26-b8bb-9c111c80f73c None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:42.417866 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbae14b-acb8-4a26-b8bb-9c111c80f73c None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:42.422565 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96226db3-f86e-416c-9114-bf3627456520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:42.423191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96226db3-f86e-416c-9114-bf3627456520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:42.423470 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96226db3-f86e-416c-9114-bf3627456520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:42.423743 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96226db3-f86e-416c-9114-bf3627456520 admin admin] PATH_INFO: `/v3/users/86c40259c92943d0a6ea00ef2bef8425` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:42.424935 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96226db3-f86e-416c-9114-bf3627456520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86c40259c92943d0a6ea00ef2bef8425)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:42.427024 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96226db3-f86e-416c-9114-bf3627456520 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:42.473777 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-96226db3-f86e-416c-9114-bf3627456520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86c40259c92943d0a6ea00ef2bef8425'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:42.481367 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-96226db3-f86e-416c-9114-bf3627456520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86c40259c92943d0a6ea00ef2bef8425'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:42.482023 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-96226db3-f86e-416c-9114-bf3627456520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86c40259c92943d0a6ea00ef2bef8425'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:42.494498 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-96226db3-f86e-416c-9114-bf3627456520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86c40259c92943d0a6ea00ef2bef8425'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:42.501372 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-96226db3-f86e-416c-9114-bf3627456520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86c40259c92943d0a6ea00ef2bef8425'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:42.507195 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1373/2743] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:36:42 2022] DELETE /identity/v3/users/86c40259c92943d0a6ea00ef2bef8425 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:42.511651 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7787b6-b5ac-4f0b-a432-68a3f561911b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:42.511925 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7787b6-b5ac-4f0b-a432-68a3f561911b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:42.512198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7787b6-b5ac-4f0b-a432-68a3f561911b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:42.531675 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-2a7787b6-b5ac-4f0b-a432-68a3f561911b None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:42.532887 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2a7787b6-b5ac-4f0b-a432-68a3f561911b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:42.593749 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1371/2744] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:42.604306 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96226db3-f86e-416c-9114-bf3627456520 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:42.605734 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-96226db3-f86e-416c-9114-bf3627456520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:42.615506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:42.665124 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96226db3-f86e-416c-9114-bf3627456520 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:42.668731 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f0e2f-5563-4473-b316-16910f900637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:42.669359 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f0e2f-5563-4473-b316-16910f900637 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:42.669642 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f0e2f-5563-4473-b316-16910f900637 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:42.669914 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f0e2f-5563-4473-b316-16910f900637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:42.678655 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f0e2f-5563-4473-b316-16910f900637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:42.680695 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f0e2f-5563-4473-b316-16910f900637 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:42.692825 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1374/2745] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:42.955439 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7787b6-b5ac-4f0b-a432-68a3f561911b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:42.956966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2a7787b6-b5ac-4f0b-a432-68a3f561911b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:42.976278 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7787b6-b5ac-4f0b-a432-68a3f561911b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:42.983097 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81b1f4-c65e-4657-84f0-064b2730815e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:42.983708 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81b1f4-c65e-4657-84f0-064b2730815e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:42.983990 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81b1f4-c65e-4657-84f0-064b2730815e admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:42.984262 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81b1f4-c65e-4657-84f0-064b2730815e admin admin] PATH_INFO: `/v3/projects/5bb4d03c036b4fd69096a845cd7af861` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:42.985430 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81b1f4-c65e-4657-84f0-064b2730815e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bb4d03c036b4fd69096a845cd7af861)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:42.987341 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81b1f4-c65e-4657-84f0-064b2730815e admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:43.034578 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4e81b1f4-c65e-4657-84f0-064b2730815e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bb4d03c036b4fd69096a845cd7af861', 'request_id': 'req-4e81b1f4-c65e-4657-84f0-064b2730815e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:43.040580 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4e81b1f4-c65e-4657-84f0-064b2730815e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bb4d03c036b4fd69096a845cd7af861', 'request_id': 'req-4e81b1f4-c65e-4657-84f0-064b2730815e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:43.046679 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4e81b1f4-c65e-4657-84f0-064b2730815e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bb4d03c036b4fd69096a845cd7af861', 'request_id': 'req-4e81b1f4-c65e-4657-84f0-064b2730815e'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:43.059064 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4e81b1f4-c65e-4657-84f0-064b2730815e admin admin] The token cache is being invalidate because project 5bb4d03c036b4fd69096a845cd7af861 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:36:43.059357 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4e81b1f4-c65e-4657-84f0-064b2730815e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:43.059984 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-4e81b1f4-c65e-4657-84f0-064b2730815e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:43.061503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1372/2746] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:36:42 2022] DELETE /identity/v3/projects/5bb4d03c036b4fd69096a845cd7af861 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:43.066353 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26a3f7-2243-4944-b7bf-e3b38221efab None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:43.066641 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26a3f7-2243-4944-b7bf-e3b38221efab None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:43.066917 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26a3f7-2243-4944-b7bf-e3b38221efab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:43.085784 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5f26a3f7-2243-4944-b7bf-e3b38221efab None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:43.087006 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5f26a3f7-2243-4944-b7bf-e3b38221efab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:43.145967 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1375/2747] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:43.154884 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbdaef-74a4-499d-b1a1-b8460d536b52 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:43.155289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbdaef-74a4-499d-b1a1-b8460d536b52 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:43.155439 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbdaef-74a4-499d-b1a1-b8460d536b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:43.175087 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-59fbdaef-74a4-499d-b1a1-b8460d536b52 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:43.176290 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-59fbdaef-74a4-499d-b1a1-b8460d536b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:43.184599 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1373/2748] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:43.188573 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26a3f7-2243-4944-b7bf-e3b38221efab None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:43.198264 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26a3f7-2243-4944-b7bf-e3b38221efab None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:43.202769 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4c299-46b8-4dc8-8809-6ae8ed54f2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:43.203366 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4c299-46b8-4dc8-8809-6ae8ed54f2bf admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:43.203650 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4c299-46b8-4dc8-8809-6ae8ed54f2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:43.203923 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b4c299-46b8-4dc8-8809-6ae8ed54f2bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:43.204571 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4c299-46b8-4dc8-8809-6ae8ed54f2bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:36:43.204878 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4c299-46b8-4dc8-8809-6ae8ed54f2bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:43.206510 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b4c299-46b8-4dc8-8809-6ae8ed54f2bf admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:43.218473 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1376/2749] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:36:43.222660 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbdaef-74a4-499d-b1a1-b8460d536b52 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:43.232532 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbdaef-74a4-499d-b1a1-b8460d536b52 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:43.237126 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a40b9f-c230-4829-b380-b8d4ed313756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:43.237715 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a40b9f-c230-4829-b380-b8d4ed313756 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:43.237995 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a40b9f-c230-4829-b380-b8d4ed313756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:43.238265 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a40b9f-c230-4829-b380-b8d4ed313756 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:43.238883 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a40b9f-c230-4829-b380-b8d4ed313756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:43.240762 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a40b9f-c230-4829-b380-b8d4ed313756 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:43.255326 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:43.269354 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1374/2750] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:36:43 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:43.273970 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4c299-46b8-4dc8-8809-6ae8ed54f2bf admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:43.283749 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b4c299-46b8-4dc8-8809-6ae8ed54f2bf admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:43.341539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31fd8f-7925-49b7-afbe-024c1c1d0b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:43.342069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31fd8f-7925-49b7-afbe-024c1c1d0b3e admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:43.342399 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31fd8f-7925-49b7-afbe-024c1c1d0b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:43.342677 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31fd8f-7925-49b7-afbe-024c1c1d0b3e admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:43.343306 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31fd8f-7925-49b7-afbe-024c1c1d0b3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:43.345511 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31fd8f-7925-49b7-afbe-024c1c1d0b3e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:43.368506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1377/2751] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:36:43 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:43.372154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a40b9f-c230-4829-b380-b8d4ed313756 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:43.384268 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a40b9f-c230-4829-b380-b8d4ed313756 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:43.389074 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39f9c1-4f99-408d-9941-99c1865303e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:43.389690 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39f9c1-4f99-408d-9941-99c1865303e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:43.389966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39f9c1-4f99-408d-9941-99c1865303e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:43.390234 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39f9c1-4f99-408d-9941-99c1865303e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:43.390936 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39f9c1-4f99-408d-9941-99c1865303e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:43.392509 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39f9c1-4f99-408d-9941-99c1865303e9 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:43.402793 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1375/2752] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:36:43.407376 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31fd8f-7925-49b7-afbe-024c1c1d0b3e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:43.418482 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31fd8f-7925-49b7-afbe-024c1c1d0b3e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:43.425423 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8d663-d50c-4a2a-9cb4-331586a51749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:43.426040 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8d663-d50c-4a2a-9cb4-331586a51749 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:43.426325 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8d663-d50c-4a2a-9cb4-331586a51749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:43.426600 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8d663-d50c-4a2a-9cb4-331586a51749 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:43.427385 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8d663-d50c-4a2a-9cb4-331586a51749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:43.429003 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8d663-d50c-4a2a-9cb4-331586a51749 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:43.444820 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1378/2753] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 02:36:43.446937 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39f9c1-4f99-408d-9941-99c1865303e9 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:43.456962 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39f9c1-4f99-408d-9941-99c1865303e9 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:43.461749 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc968f6e-664a-4074-9758-3ebd6274ae99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:43.462401 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc968f6e-664a-4074-9758-3ebd6274ae99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:43.462682 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc968f6e-664a-4074-9758-3ebd6274ae99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:43.463019 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc968f6e-664a-4074-9758-3ebd6274ae99 admin admin] PATH_INFO: `/v3/projects/3971dd1cbad64be5933c2c99946fdc80/users/a5d556a710964202a08cd86c61e841fc/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:43.480193 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc968f6e-664a-4074-9758-3ebd6274ae99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3971dd1cbad64be5933c2c99946fdc80, user_id=a5d556a710964202a08cd86c61e841fc, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:43.483020 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc968f6e-664a-4074-9758-3ebd6274ae99 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:43.508780 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1376/2754] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:36:43 2022] PUT /identity/v3/projects/3971dd1cbad64be5933c2c99946fdc80/users/a5d556a710964202a08cd86c61e841fc/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:43.519598 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1af4dd-0259-4d45-86b1-18748d3d8566 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:43.519926 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1af4dd-0259-4d45-86b1-18748d3d8566 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:43.520210 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1af4dd-0259-4d45-86b1-18748d3d8566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:43.547753 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ca1af4dd-0259-4d45-86b1-18748d3d8566 None None] MFA Rules not processed for user `a5d556a710964202a08cd86c61e841fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:43.549061 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ca1af4dd-0259-4d45-86b1-18748d3d8566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:43.553127 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:43.618754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1379/2755] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:43.629457 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc968f6e-664a-4074-9758-3ebd6274ae99 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:43.631342 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-dc968f6e-664a-4074-9758-3ebd6274ae99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:43.687824 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc968f6e-664a-4074-9758-3ebd6274ae99 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:43.692673 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f7694-3a80-4378-972e-f4015728e032 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:43.693360 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f7694-3a80-4378-972e-f4015728e032 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:43.694160 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f7694-3a80-4378-972e-f4015728e032 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:43.694160 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f7694-3a80-4378-972e-f4015728e032 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:43.702878 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f7694-3a80-4378-972e-f4015728e032 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:43.704356 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f7694-3a80-4378-972e-f4015728e032 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:43.714069 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1377/2756] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 02:36:44.503688 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1af4dd-0259-4d45-86b1-18748d3d8566 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:44.505114 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ca1af4dd-0259-4d45-86b1-18748d3d8566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:44.574354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1af4dd-0259-4d45-86b1-18748d3d8566 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:44.579297 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a18205-e9a4-43a2-a50b-bc842aecd4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:44.579926 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a18205-e9a4-43a2-a50b-bc842aecd4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:44.580201 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a18205-e9a4-43a2-a50b-bc842aecd4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:44.580471 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a18205-e9a4-43a2-a50b-bc842aecd4d4 admin admin] PATH_INFO: `/v3/users/20746650c39e4f5a83a04cf7b1a25898` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:44.581880 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a18205-e9a4-43a2-a50b-bc842aecd4d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20746650c39e4f5a83a04cf7b1a25898)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:44.583809 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a18205-e9a4-43a2-a50b-bc842aecd4d4 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:44.628189 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-64a18205-e9a4-43a2-a50b-bc842aecd4d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20746650c39e4f5a83a04cf7b1a25898'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:44.635318 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-64a18205-e9a4-43a2-a50b-bc842aecd4d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20746650c39e4f5a83a04cf7b1a25898'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:44.635933 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-64a18205-e9a4-43a2-a50b-bc842aecd4d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20746650c39e4f5a83a04cf7b1a25898'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:44.647699 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-64a18205-e9a4-43a2-a50b-bc842aecd4d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20746650c39e4f5a83a04cf7b1a25898'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:44.655059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-64a18205-e9a4-43a2-a50b-bc842aecd4d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20746650c39e4f5a83a04cf7b1a25898'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:44.660754 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1380/2757] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:36:44 2022] DELETE /identity/v3/users/20746650c39e4f5a83a04cf7b1a25898 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:44.665240 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9a0d8-31d2-4d2f-a961-2e79dae8fac1 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:44.665709 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9a0d8-31d2-4d2f-a961-2e79dae8fac1 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:44.665815 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9a0d8-31d2-4d2f-a961-2e79dae8fac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:44.683834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-6bd9a0d8-31d2-4d2f-a961-2e79dae8fac1 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:44.685036 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6bd9a0d8-31d2-4d2f-a961-2e79dae8fac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:44.744154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1378/2758] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:44.753996 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a18205-e9a4-43a2-a50b-bc842aecd4d4 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:44.755471 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-64a18205-e9a4-43a2-a50b-bc842aecd4d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:44.783549 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:44.814702 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a18205-e9a4-43a2-a50b-bc842aecd4d4 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:44.818309 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cc7e9-017a-4632-a2d0-fa960afd384d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:44.818902 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cc7e9-017a-4632-a2d0-fa960afd384d service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:44.819178 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cc7e9-017a-4632-a2d0-fa960afd384d service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:44.819446 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cc7e9-017a-4632-a2d0-fa960afd384d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:44.828725 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3cc7e9-017a-4632-a2d0-fa960afd384d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:44.830177 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3cc7e9-017a-4632-a2d0-fa960afd384d service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:44.839479 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1381/2759] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:45.117105 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9a0d8-31d2-4d2f-a961-2e79dae8fac1 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:45.119350 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6bd9a0d8-31d2-4d2f-a961-2e79dae8fac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:45.133046 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9a0d8-31d2-4d2f-a961-2e79dae8fac1 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:45.138988 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50027736-ef0f-4668-9912-756fde0fa83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:45.139744 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50027736-ef0f-4668-9912-756fde0fa83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:45.140005 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50027736-ef0f-4668-9912-756fde0fa83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:45.140351 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50027736-ef0f-4668-9912-756fde0fa83c admin admin] PATH_INFO: `/v3/projects/2ed7872d26a24ab588c66526b316faa9` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:45.141890 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50027736-ef0f-4668-9912-756fde0fa83c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ed7872d26a24ab588c66526b316faa9)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:45.143858 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50027736-ef0f-4668-9912-756fde0fa83c admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:45.194601 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-50027736-ef0f-4668-9912-756fde0fa83c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ed7872d26a24ab588c66526b316faa9', 'request_id': 'req-50027736-ef0f-4668-9912-756fde0fa83c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:45.199975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:INSERT=2,keystone:SELECT=92,keystone:DELETE=6 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:45.201486 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-50027736-ef0f-4668-9912-756fde0fa83c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ed7872d26a24ab588c66526b316faa9', 'request_id': 'req-50027736-ef0f-4668-9912-756fde0fa83c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:45.209854 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-50027736-ef0f-4668-9912-756fde0fa83c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ed7872d26a24ab588c66526b316faa9', 'request_id': 'req-50027736-ef0f-4668-9912-756fde0fa83c'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:45.224576 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-50027736-ef0f-4668-9912-756fde0fa83c admin admin] The token cache is being invalidate because project 2ed7872d26a24ab588c66526b316faa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:36:45.224849 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-50027736-ef0f-4668-9912-756fde0fa83c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:45.225685 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-50027736-ef0f-4668-9912-756fde0fa83c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:45.228118 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1379/2760] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:36:45 2022] DELETE /identity/v3/projects/2ed7872d26a24ab588c66526b316faa9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:49.044427 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cc7e9-017a-4632-a2d0-fa960afd384d service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:49.045871 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0c3cc7e9-017a-4632-a2d0-fa960afd384d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:49.059134 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cc7e9-017a-4632-a2d0-fa960afd384d service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:49.113942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89296aa6-aefa-4abf-9c98-1a6f44682a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:49.114557 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89296aa6-aefa-4abf-9c98-1a6f44682a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:49.114856 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89296aa6-aefa-4abf-9c98-1a6f44682a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:49.115122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89296aa6-aefa-4abf-9c98-1a6f44682a96 admin admin] PATH_INFO: `/v3/users/a5d556a710964202a08cd86c61e841fc` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:49.116236 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89296aa6-aefa-4abf-9c98-1a6f44682a96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5d556a710964202a08cd86c61e841fc)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:49.118771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89296aa6-aefa-4abf-9c98-1a6f44682a96 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:49.165214 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-89296aa6-aefa-4abf-9c98-1a6f44682a96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5d556a710964202a08cd86c61e841fc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:49.172217 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-89296aa6-aefa-4abf-9c98-1a6f44682a96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5d556a710964202a08cd86c61e841fc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:49.172880 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-89296aa6-aefa-4abf-9c98-1a6f44682a96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5d556a710964202a08cd86c61e841fc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:49.185201 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-89296aa6-aefa-4abf-9c98-1a6f44682a96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5d556a710964202a08cd86c61e841fc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:49.191977 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-89296aa6-aefa-4abf-9c98-1a6f44682a96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5d556a710964202a08cd86c61e841fc'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:49.197882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1382/2761] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:36:49 2022] DELETE /identity/v3/users/a5d556a710964202a08cd86c61e841fc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:49.202343 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35fd3a-c112-4297-a318-67a25c04f63f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:49.202819 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35fd3a-c112-4297-a318-67a25c04f63f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:49.202939 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35fd3a-c112-4297-a318-67a25c04f63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:49.222347 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-4c35fd3a-c112-4297-a318-67a25c04f63f None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:49.223540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4c35fd3a-c112-4297-a318-67a25c04f63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:49.283333 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1380/2762] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:49.293729 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89296aa6-aefa-4abf-9c98-1a6f44682a96 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:49.295156 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-89296aa6-aefa-4abf-9c98-1a6f44682a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:49.347296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:49.353931 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89296aa6-aefa-4abf-9c98-1a6f44682a96 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:49.359110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ded69c-0111-46ce-a96b-426b95f58247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:49.359718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ded69c-0111-46ce-a96b-426b95f58247 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:49.360011 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ded69c-0111-46ce-a96b-426b95f58247 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:49.360261 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ded69c-0111-46ce-a96b-426b95f58247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:49.369174 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ded69c-0111-46ce-a96b-426b95f58247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:49.370593 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ded69c-0111-46ce-a96b-426b95f58247 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:49.379811 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1383/2763] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:49.642942 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35fd3a-c112-4297-a318-67a25c04f63f None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:49.644934 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4c35fd3a-c112-4297-a318-67a25c04f63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:49.662630 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35fd3a-c112-4297-a318-67a25c04f63f None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:49.667967 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f5f5d-27f2-4f19-a8e5-865928435359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:49.668516 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f5f5d-27f2-4f19-a8e5-865928435359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:49.668840 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f5f5d-27f2-4f19-a8e5-865928435359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:49.669209 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f5f5d-27f2-4f19-a8e5-865928435359 admin admin] PATH_INFO: `/v3/projects/3971dd1cbad64be5933c2c99946fdc80` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:49.670240 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f5f5d-27f2-4f19-a8e5-865928435359 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3971dd1cbad64be5933c2c99946fdc80)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:49.672137 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f5f5d-27f2-4f19-a8e5-865928435359 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:49.718851 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-740f5f5d-27f2-4f19-a8e5-865928435359 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3971dd1cbad64be5933c2c99946fdc80', 'request_id': 'req-740f5f5d-27f2-4f19-a8e5-865928435359'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:49.725055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-740f5f5d-27f2-4f19-a8e5-865928435359 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3971dd1cbad64be5933c2c99946fdc80', 'request_id': 'req-740f5f5d-27f2-4f19-a8e5-865928435359'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:49.731540 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-740f5f5d-27f2-4f19-a8e5-865928435359 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3971dd1cbad64be5933c2c99946fdc80', 'request_id': 'req-740f5f5d-27f2-4f19-a8e5-865928435359'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:49.743303 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-740f5f5d-27f2-4f19-a8e5-865928435359 admin admin] The token cache is being invalidate because project 3971dd1cbad64be5933c2c99946fdc80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:36:49.743594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-740f5f5d-27f2-4f19-a8e5-865928435359 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:49.744216 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-740f5f5d-27f2-4f19-a8e5-865928435359 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:49.745734 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1381/2764] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:36:49 2022] DELETE /identity/v3/projects/3971dd1cbad64be5933c2c99946fdc80 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:49.750528 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369b376-38ec-44d8-8268-4300a99be656 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:49.750842 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369b376-38ec-44d8-8268-4300a99be656 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:49.751112 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369b376-38ec-44d8-8268-4300a99be656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:49.770971 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c369b376-38ec-44d8-8268-4300a99be656 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:49.772162 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c369b376-38ec-44d8-8268-4300a99be656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:49.828761 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1384/2765] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:49.836999 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0f21e-4dd3-4690-b19d-847573d790d5 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:49.837322 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0f21e-4dd3-4690-b19d-847573d790d5 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:49.837602 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0f21e-4dd3-4690-b19d-847573d790d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:49.857208 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-37e0f21e-4dd3-4690-b19d-847573d790d5 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:49.858427 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-37e0f21e-4dd3-4690-b19d-847573d790d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:49.866334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1382/2766] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:49.870424 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369b376-38ec-44d8-8268-4300a99be656 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:49.879891 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369b376-38ec-44d8-8268-4300a99be656 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:49.884940 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5a4a7-bfec-4870-8c1b-728b09ef8a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:49.885550 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a4a7-bfec-4870-8c1b-728b09ef8a16 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:49.885826 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a4a7-bfec-4870-8c1b-728b09ef8a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:49.886094 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a4a7-bfec-4870-8c1b-728b09ef8a16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:49.886730 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5a4a7-bfec-4870-8c1b-728b09ef8a16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:36:49.887031 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5a4a7-bfec-4870-8c1b-728b09ef8a16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:49.888638 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5a4a7-bfec-4870-8c1b-728b09ef8a16 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:49.900622 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1385/2767] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:36:49.904676 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0f21e-4dd3-4690-b19d-847573d790d5 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:49.913922 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0f21e-4dd3-4690-b19d-847573d790d5 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:49.918836 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85ad38-3314-4117-b7a1-c1a47628590f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:49.919444 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85ad38-3314-4117-b7a1-c1a47628590f admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:49.919719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85ad38-3314-4117-b7a1-c1a47628590f admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:49.919986 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85ad38-3314-4117-b7a1-c1a47628590f admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:49.920603 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85ad38-3314-4117-b7a1-c1a47628590f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:49.922553 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85ad38-3314-4117-b7a1-c1a47628590f admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:49.950992 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1383/2768] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:36:49 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:49.955149 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5a4a7-bfec-4870-8c1b-728b09ef8a16 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:49.965553 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5a4a7-bfec-4870-8c1b-728b09ef8a16 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:50.025088 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb2f85-4eda-4a6d-88f2-aa69676f7e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:50.025688 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb2f85-4eda-4a6d-88f2-aa69676f7e5e admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:50.025967 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb2f85-4eda-4a6d-88f2-aa69676f7e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:50.026241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb2f85-4eda-4a6d-88f2-aa69676f7e5e admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:50.026863 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb2f85-4eda-4a6d-88f2-aa69676f7e5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:50.028760 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb2f85-4eda-4a6d-88f2-aa69676f7e5e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:50.048803 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1386/2769] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:36:49 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:50.052903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85ad38-3314-4117-b7a1-c1a47628590f admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:50.063441 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85ad38-3314-4117-b7a1-c1a47628590f admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:50.067923 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c817d6-2de5-4ef4-98fa-1c38b91b36b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:50.068510 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c817d6-2de5-4ef4-98fa-1c38b91b36b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:50.068784 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c817d6-2de5-4ef4-98fa-1c38b91b36b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:50.069078 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c817d6-2de5-4ef4-98fa-1c38b91b36b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:50.069716 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c817d6-2de5-4ef4-98fa-1c38b91b36b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:50.071867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c817d6-2de5-4ef4-98fa-1c38b91b36b8 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:50.081590 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1384/2770] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:50.085081 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb2f85-4eda-4a6d-88f2-aa69676f7e5e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:50.094608 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb2f85-4eda-4a6d-88f2-aa69676f7e5e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:50.099360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1d4ec-337a-4e4a-8294-5f63ddca372c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:50.099938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1d4ec-337a-4e4a-8294-5f63ddca372c admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:50.100214 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1d4ec-337a-4e4a-8294-5f63ddca372c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:50.100482 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1d4ec-337a-4e4a-8294-5f63ddca372c admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:50.101163 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c1d4ec-337a-4e4a-8294-5f63ddca372c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:50.102734 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c1d4ec-337a-4e4a-8294-5f63ddca372c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:50.112276 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1387/2771] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:50.116074 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c817d6-2de5-4ef4-98fa-1c38b91b36b8 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:50.126366 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c817d6-2de5-4ef4-98fa-1c38b91b36b8 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:50.130923 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32394c16-4409-4ce1-8232-a475add358b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:50.131561 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32394c16-4409-4ce1-8232-a475add358b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:50.131841 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32394c16-4409-4ce1-8232-a475add358b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:50.132115 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32394c16-4409-4ce1-8232-a475add358b6 admin admin] PATH_INFO: `/v3/projects/d5918f07de0d4b249afc09641a0e904c/users/cbd279d0c0004527898a89d277e742a9/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:50.147037 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32394c16-4409-4ce1-8232-a475add358b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5918f07de0d4b249afc09641a0e904c, user_id=cbd279d0c0004527898a89d277e742a9, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:50.153497 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32394c16-4409-4ce1-8232-a475add358b6 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:50.167822 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1385/2772] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:36:50 2022] PUT /identity/v3/projects/d5918f07de0d4b249afc09641a0e904c/users/cbd279d0c0004527898a89d277e742a9/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:50.178912 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d3780-8133-465f-b626-3ce42dd66c20 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:50.179720 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d3780-8133-465f-b626-3ce42dd66c20 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:50.179978 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d3780-8133-465f-b626-3ce42dd66c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:50.207139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ed1d3780-8133-465f-b626-3ce42dd66c20 None None] MFA Rules not processed for user `cbd279d0c0004527898a89d277e742a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:50.208347 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ed1d3780-8133-465f-b626-3ce42dd66c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:50.252572 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:50.275675 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1388/2773] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:50.286687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32394c16-4409-4ce1-8232-a475add358b6 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:50.288462 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-32394c16-4409-4ce1-8232-a475add358b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:50.294999 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:50.348583 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32394c16-4409-4ce1-8232-a475add358b6 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:50.352758 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ab22e-ee1d-4a8f-a3eb-bc8ed764aa4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:50.353414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ab22e-ee1d-4a8f-a3eb-bc8ed764aa4d service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:50.353706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ab22e-ee1d-4a8f-a3eb-bc8ed764aa4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:50.353966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ab22e-ee1d-4a8f-a3eb-bc8ed764aa4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:50.362371 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ab22e-ee1d-4a8f-a3eb-bc8ed764aa4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:50.363796 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ab22e-ee1d-4a8f-a3eb-bc8ed764aa4d service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:50.373201 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1386/2774] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:52.953618 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d3780-8133-465f-b626-3ce42dd66c20 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:53.019783 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d3780-8133-465f-b626-3ce42dd66c20 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:53.024337 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9441dd7-5757-4a1a-a403-740cd8fe49da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:53.024968 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9441dd7-5757-4a1a-a403-740cd8fe49da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:53.025278 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9441dd7-5757-4a1a-a403-740cd8fe49da admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:53.025552 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9441dd7-5757-4a1a-a403-740cd8fe49da admin admin] PATH_INFO: `/v3/users/cbd279d0c0004527898a89d277e742a9` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:53.026671 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9441dd7-5757-4a1a-a403-740cd8fe49da admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbd279d0c0004527898a89d277e742a9)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:53.028601 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9441dd7-5757-4a1a-a403-740cd8fe49da admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:53.075698 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c9441dd7-5757-4a1a-a403-740cd8fe49da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbd279d0c0004527898a89d277e742a9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:53.083692 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c9441dd7-5757-4a1a-a403-740cd8fe49da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbd279d0c0004527898a89d277e742a9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:53.084610 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c9441dd7-5757-4a1a-a403-740cd8fe49da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbd279d0c0004527898a89d277e742a9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:53.098018 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c9441dd7-5757-4a1a-a403-740cd8fe49da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbd279d0c0004527898a89d277e742a9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:53.105086 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-c9441dd7-5757-4a1a-a403-740cd8fe49da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbd279d0c0004527898a89d277e742a9'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:53.111131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1389/2775] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:36:52 2022] DELETE /identity/v3/users/cbd279d0c0004527898a89d277e742a9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:53.115784 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aedf57-6648-4c84-adb8-a6168c7b4cbc None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:53.116319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aedf57-6648-4c84-adb8-a6168c7b4cbc None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:53.116319 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aedf57-6648-4c84-adb8-a6168c7b4cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:53.136632 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-b2aedf57-6648-4c84-adb8-a6168c7b4cbc None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:53.137883 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b2aedf57-6648-4c84-adb8-a6168c7b4cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:53.199440 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1387/2776] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:53.213135 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9441dd7-5757-4a1a-a403-740cd8fe49da admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:53.214805 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c9441dd7-5757-4a1a-a403-740cd8fe49da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:53.280562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9441dd7-5757-4a1a-a403-740cd8fe49da admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:53.284401 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0425c34-9de3-4685-b822-7e11e116dbbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:53.285011 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0425c34-9de3-4685-b822-7e11e116dbbe service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:53.285310 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0425c34-9de3-4685-b822-7e11e116dbbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:53.285578 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0425c34-9de3-4685-b822-7e11e116dbbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:53.295709 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0425c34-9de3-4685-b822-7e11e116dbbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:53.297189 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0425c34-9de3-4685-b822-7e11e116dbbe service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:53.308282 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1390/2777] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:53.612415 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aedf57-6648-4c84-adb8-a6168c7b4cbc None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:53.615086 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b2aedf57-6648-4c84-adb8-a6168c7b4cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:53.635208 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aedf57-6648-4c84-adb8-a6168c7b4cbc None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:53.640794 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efb145-1807-412b-961b-9ff7b8cc9459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:53.641610 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efb145-1807-412b-961b-9ff7b8cc9459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:53.641896 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efb145-1807-412b-961b-9ff7b8cc9459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:53.642170 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efb145-1807-412b-961b-9ff7b8cc9459 admin admin] PATH_INFO: `/v3/projects/d5918f07de0d4b249afc09641a0e904c` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:53.643454 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efb145-1807-412b-961b-9ff7b8cc9459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5918f07de0d4b249afc09641a0e904c)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:53.646424 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efb145-1807-412b-961b-9ff7b8cc9459 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:53.709869 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-95efb145-1807-412b-961b-9ff7b8cc9459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5918f07de0d4b249afc09641a0e904c', 'request_id': 'req-95efb145-1807-412b-961b-9ff7b8cc9459'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:53.719156 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-95efb145-1807-412b-961b-9ff7b8cc9459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5918f07de0d4b249afc09641a0e904c', 'request_id': 'req-95efb145-1807-412b-961b-9ff7b8cc9459'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:53.727568 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-95efb145-1807-412b-961b-9ff7b8cc9459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5918f07de0d4b249afc09641a0e904c', 'request_id': 'req-95efb145-1807-412b-961b-9ff7b8cc9459'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:53.743998 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-95efb145-1807-412b-961b-9ff7b8cc9459 admin admin] The token cache is being invalidate because project d5918f07de0d4b249afc09641a0e904c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:36:53.744414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-95efb145-1807-412b-961b-9ff7b8cc9459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:53.745139 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-95efb145-1807-412b-961b-9ff7b8cc9459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:53.746770 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1388/2778] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:36:53 2022] DELETE /identity/v3/projects/d5918f07de0d4b249afc09641a0e904c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:53.752638 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af5391-07f8-498e-9a0b-cb9b59ba11e9 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:53.753272 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af5391-07f8-498e-9a0b-cb9b59ba11e9 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:53.753556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af5391-07f8-498e-9a0b-cb9b59ba11e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:53.767627 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:53.776160 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-c0af5391-07f8-498e-9a0b-cb9b59ba11e9 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:53.778652 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-c0af5391-07f8-498e-9a0b-cb9b59ba11e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:53.842514 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1391/2779] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:53.851109 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3485547-8d38-4f15-a00d-6849eec055b9 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:53.851289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3485547-8d38-4f15-a00d-6849eec055b9 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:53.851569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3485547-8d38-4f15-a00d-6849eec055b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:53.872236 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-d3485547-8d38-4f15-a00d-6849eec055b9 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:53.873494 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d3485547-8d38-4f15-a00d-6849eec055b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:53.881334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1389/2780] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:53.885654 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af5391-07f8-498e-9a0b-cb9b59ba11e9 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:53.895583 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af5391-07f8-498e-9a0b-cb9b59ba11e9 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:53.900572 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da7d94-c253-4092-8393-d35092efc671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:53.901194 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da7d94-c253-4092-8393-d35092efc671 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:53.901473 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da7d94-c253-4092-8393-d35092efc671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:53.901742 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da7d94-c253-4092-8393-d35092efc671 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:53.902382 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da7d94-c253-4092-8393-d35092efc671 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:36:53.902683 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da7d94-c253-4092-8393-d35092efc671 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:53.904303 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da7d94-c253-4092-8393-d35092efc671 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:53.916447 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1392/2781] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:36:53.920436 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3485547-8d38-4f15-a00d-6849eec055b9 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:53.929965 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3485547-8d38-4f15-a00d-6849eec055b9 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:53.935035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1613729-d62d-4be2-bdb8-3b1bd061cf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:53.935780 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1613729-d62d-4be2-bdb8-3b1bd061cf05 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:53.936068 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1613729-d62d-4be2-bdb8-3b1bd061cf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:53.936345 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1613729-d62d-4be2-bdb8-3b1bd061cf05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:53.936987 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1613729-d62d-4be2-bdb8-3b1bd061cf05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:53.939195 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1613729-d62d-4be2-bdb8-3b1bd061cf05 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:53.968383 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1390/2782] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:36:53 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:53.972850 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da7d94-c253-4092-8393-d35092efc671 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:53.984036 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da7d94-c253-4092-8393-d35092efc671 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:54.042137 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0136bb-e0a1-4bbb-b088-e4efa4da8a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:54.042705 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0136bb-e0a1-4bbb-b088-e4efa4da8a6a admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:54.043081 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0136bb-e0a1-4bbb-b088-e4efa4da8a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:54.043357 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0136bb-e0a1-4bbb-b088-e4efa4da8a6a admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:54.043980 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0136bb-e0a1-4bbb-b088-e4efa4da8a6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:54.045941 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0136bb-e0a1-4bbb-b088-e4efa4da8a6a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:54.069235 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1393/2783] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:36:53 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:36:54.073805 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1613729-d62d-4be2-bdb8-3b1bd061cf05 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:54.079530 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:54.087677 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1613729-d62d-4be2-bdb8-3b1bd061cf05 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:54.094080 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f818a9d-db32-4b0d-96d9-c42f9ed2c24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:54.095210 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f818a9d-db32-4b0d-96d9-c42f9ed2c24c admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:54.095609 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f818a9d-db32-4b0d-96d9-c42f9ed2c24c admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:54.095885 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f818a9d-db32-4b0d-96d9-c42f9ed2c24c admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:54.096526 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f818a9d-db32-4b0d-96d9-c42f9ed2c24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:54.098445 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f818a9d-db32-4b0d-96d9-c42f9ed2c24c admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:54.109329 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1391/2784] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:54.113913 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0136bb-e0a1-4bbb-b088-e4efa4da8a6a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:54.125218 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0136bb-e0a1-4bbb-b088-e4efa4da8a6a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:54.130427 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf66dc-d23c-4652-aee8-9db00510d9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:54.131094 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf66dc-d23c-4652-aee8-9db00510d9ed admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:54.131539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf66dc-d23c-4652-aee8-9db00510d9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:54.131818 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf66dc-d23c-4652-aee8-9db00510d9ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:54.132467 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf66dc-d23c-4652-aee8-9db00510d9ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:54.134609 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf66dc-d23c-4652-aee8-9db00510d9ed admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:54.156266 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1394/2785] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:36:54.157415 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f818a9d-db32-4b0d-96d9-c42f9ed2c24c admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:54.167589 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f818a9d-db32-4b0d-96d9-c42f9ed2c24c admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:54.172286 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cf0b4-0ec2-4b88-976f-a0df67cb5b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:54.172937 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cf0b4-0ec2-4b88-976f-a0df67cb5b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:54.173287 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cf0b4-0ec2-4b88-976f-a0df67cb5b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:54.173545 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cf0b4-0ec2-4b88-976f-a0df67cb5b1c admin admin] PATH_INFO: `/v3/projects/a0618358105f48afa61fd30607e1a13d/users/93e49240f7884ff28b132d6ac6bd3083/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:54.187834 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3cf0b4-0ec2-4b88-976f-a0df67cb5b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0618358105f48afa61fd30607e1a13d, user_id=93e49240f7884ff28b132d6ac6bd3083, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:54.190564 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3cf0b4-0ec2-4b88-976f-a0df67cb5b1c admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:54.203497 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1392/2786] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:36:54 2022] PUT /identity/v3/projects/a0618358105f48afa61fd30607e1a13d/users/93e49240f7884ff28b132d6ac6bd3083/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:36:54.214641 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1d4d9-4984-4b69-9909-686d27ce1964 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:54.214928 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1d4d9-4984-4b69-9909-686d27ce1964 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:54.215202 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1d4d9-4984-4b69-9909-686d27ce1964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:54.244314 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-24d1d4d9-4984-4b69-9909-686d27ce1964 None None] MFA Rules not processed for user `93e49240f7884ff28b132d6ac6bd3083`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:54.245523 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-24d1d4d9-4984-4b69-9909-686d27ce1964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:54.307999 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1395/2787] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:54.319274 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cf0b4-0ec2-4b88-976f-a0df67cb5b1c admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:54.321530 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-2a3cf0b4-0ec2-4b88-976f-a0df67cb5b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:54.379689 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cf0b4-0ec2-4b88-976f-a0df67cb5b1c admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:54.383873 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff6f99-9cab-402c-abf9-5a836a55a364 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:54.384469 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff6f99-9cab-402c-abf9-5a836a55a364 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:54.384782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff6f99-9cab-402c-abf9-5a836a55a364 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:54.385081 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff6f99-9cab-402c-abf9-5a836a55a364 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:54.393231 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff6f99-9cab-402c-abf9-5a836a55a364 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:54.394665 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff6f99-9cab-402c-abf9-5a836a55a364 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:54.403903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1393/2788] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:54.428452 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1d4d9-4984-4b69-9909-686d27ce1964 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:54.433215 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:54.493131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1d4d9-4984-4b69-9909-686d27ce1964 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:54.497738 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62401f47-44ff-429d-ac7e-b8983c0dd082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:54.498302 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62401f47-44ff-429d-ac7e-b8983c0dd082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:54.498583 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62401f47-44ff-429d-ac7e-b8983c0dd082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:54.498854 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62401f47-44ff-429d-ac7e-b8983c0dd082 admin admin] PATH_INFO: `/v3/users/93e49240f7884ff28b132d6ac6bd3083` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:54.499972 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62401f47-44ff-429d-ac7e-b8983c0dd082 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93e49240f7884ff28b132d6ac6bd3083)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:54.501933 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62401f47-44ff-429d-ac7e-b8983c0dd082 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:54.546490 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-62401f47-44ff-429d-ac7e-b8983c0dd082 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93e49240f7884ff28b132d6ac6bd3083'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:54.552985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-62401f47-44ff-429d-ac7e-b8983c0dd082 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93e49240f7884ff28b132d6ac6bd3083'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:54.553651 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-62401f47-44ff-429d-ac7e-b8983c0dd082 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93e49240f7884ff28b132d6ac6bd3083'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:54.566345 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-62401f47-44ff-429d-ac7e-b8983c0dd082 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93e49240f7884ff28b132d6ac6bd3083'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:54.573687 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-62401f47-44ff-429d-ac7e-b8983c0dd082 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93e49240f7884ff28b132d6ac6bd3083'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:54.579427 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1396/2789] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:36:54 2022] DELETE /identity/v3/users/93e49240f7884ff28b132d6ac6bd3083 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:36:54.583861 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720839c6-5c86-4029-8e50-51cf4702d10b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:54.584148 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720839c6-5c86-4029-8e50-51cf4702d10b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:54.584422 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720839c6-5c86-4029-8e50-51cf4702d10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:54.603040 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-720839c6-5c86-4029-8e50-51cf4702d10b None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:36:54.604223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-720839c6-5c86-4029-8e50-51cf4702d10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:54.659790 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1394/2790] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:36:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:36:54.669275 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62401f47-44ff-429d-ac7e-b8983c0dd082 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:54.670706 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-62401f47-44ff-429d-ac7e-b8983c0dd082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:54.730843 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62401f47-44ff-429d-ac7e-b8983c0dd082 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:54.735519 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426b8db-bb7a-4dcc-b305-2986090acc0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:54.736139 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426b8db-bb7a-4dcc-b305-2986090acc0d service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:54.736418 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426b8db-bb7a-4dcc-b305-2986090acc0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:54.736690 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426b8db-bb7a-4dcc-b305-2986090acc0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:54.750774 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426b8db-bb7a-4dcc-b305-2986090acc0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:54.752225 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426b8db-bb7a-4dcc-b305-2986090acc0d service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:54.762783 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1397/2791] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:55.062018 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720839c6-5c86-4029-8e50-51cf4702d10b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:55.071697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720839c6-5c86-4029-8e50-51cf4702d10b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:55.075314 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2d07e-3a85-4311-9497-f9f5a02dc539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:55.075914 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2d07e-3a85-4311-9497-f9f5a02dc539 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:55.076199 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2d07e-3a85-4311-9497-f9f5a02dc539 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:55.076480 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2d07e-3a85-4311-9497-f9f5a02dc539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:55.078230 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f5c2d07e-3a85-4311-9497-f9f5a02dc539 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:55.090684 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2d07e-3a85-4311-9497-f9f5a02dc539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:55.092137 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2d07e-3a85-4311-9497-f9f5a02dc539 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:55.102802 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1395/2792] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:36:55.156942 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426b8db-bb7a-4dcc-b305-2986090acc0d service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:55.159581 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e426b8db-bb7a-4dcc-b305-2986090acc0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:55.173719 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426b8db-bb7a-4dcc-b305-2986090acc0d service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:55.178555 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7dcc72-be2d-4462-9868-ae9714957117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:55.179266 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7dcc72-be2d-4462-9868-ae9714957117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:55.179641 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7dcc72-be2d-4462-9868-ae9714957117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:55.180527 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7dcc72-be2d-4462-9868-ae9714957117 admin admin] PATH_INFO: `/v3/projects/a0618358105f48afa61fd30607e1a13d` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:55.181763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7dcc72-be2d-4462-9868-ae9714957117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0618358105f48afa61fd30607e1a13d)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:55.183937 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7dcc72-be2d-4462-9868-ae9714957117 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:55.208178 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:55.236672 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-da7dcc72-be2d-4462-9868-ae9714957117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0618358105f48afa61fd30607e1a13d', 'request_id': 'req-da7dcc72-be2d-4462-9868-ae9714957117'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:55.243172 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-da7dcc72-be2d-4462-9868-ae9714957117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0618358105f48afa61fd30607e1a13d', 'request_id': 'req-da7dcc72-be2d-4462-9868-ae9714957117'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:55.250012 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-da7dcc72-be2d-4462-9868-ae9714957117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0618358105f48afa61fd30607e1a13d', 'request_id': 'req-da7dcc72-be2d-4462-9868-ae9714957117'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:55.264185 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-da7dcc72-be2d-4462-9868-ae9714957117 admin admin] The token cache is being invalidate because project a0618358105f48afa61fd30607e1a13d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80285) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:36:55.264479 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-da7dcc72-be2d-4462-9868-ae9714957117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:55.265513 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-da7dcc72-be2d-4462-9868-ae9714957117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:36:55.267291 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1398/2793] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:36:55 2022] DELETE /identity/v3/projects/a0618358105f48afa61fd30607e1a13d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:36:58.410507 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2d07e-3a85-4311-9497-f9f5a02dc539 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:36:58.411922 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f5c2d07e-3a85-4311-9497-f9f5a02dc539 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:58.472524 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:36:58.487712 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2d07e-3a85-4311-9497-f9f5a02dc539 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:36:58.550186 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e310b-5304-44f3-b92a-dcdf761384e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fe21d9a65a34abeae7329df924d7998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:36:58.550800 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e310b-5304-44f3-b92a-dcdf761384e4 service placement] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:36:58.551078 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e310b-5304-44f3-b92a-dcdf761384e4 service placement] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:36:58.551347 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e310b-5304-44f3-b92a-dcdf761384e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:36:58.553154 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-1c5e310b-5304-44f3-b92a-dcdf761384e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:36:58.564887 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e310b-5304-44f3-b92a-dcdf761384e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:36:58.566503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e310b-5304-44f3-b92a-dcdf761384e4 service placement] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:36:58.576980 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1396/2794] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:36:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:37:01.322752 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7dcc72-be2d-4462-9868-ae9714957117 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:37:01.324217 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-da7dcc72-be2d-4462-9868-ae9714957117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:37:01.392446 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7dcc72-be2d-4462-9868-ae9714957117 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:37:01.397062 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0c55d-a76b-45e0-ba20-18d659dd60ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:37:01.397914 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0c55d-a76b-45e0-ba20-18d659dd60ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:37:01.398039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0c55d-a76b-45e0-ba20-18d659dd60ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:37:01.398247 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0c55d-a76b-45e0-ba20-18d659dd60ad admin admin] PATH_INFO: `/v3/users/2dfc21e67d594c82a166cb487204237c` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:37:01.400073 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0c55d-a76b-45e0-ba20-18d659dd60ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dfc21e67d594c82a166cb487204237c)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:37:01.402038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0c55d-a76b-45e0-ba20-18d659dd60ad admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:37:01.455228 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-0fd0c55d-a76b-45e0-ba20-18d659dd60ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dfc21e67d594c82a166cb487204237c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:37:01.463084 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-0fd0c55d-a76b-45e0-ba20-18d659dd60ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dfc21e67d594c82a166cb487204237c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:37:01.463725 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-0fd0c55d-a76b-45e0-ba20-18d659dd60ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dfc21e67d594c82a166cb487204237c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:37:01.475686 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-0fd0c55d-a76b-45e0-ba20-18d659dd60ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dfc21e67d594c82a166cb487204237c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:37:01.483114 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-0fd0c55d-a76b-45e0-ba20-18d659dd60ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dfc21e67d594c82a166cb487204237c'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:37:01.489059 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1399/2795] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:37:01 2022] DELETE /identity/v3/users/2dfc21e67d594c82a166cb487204237c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:37:01.675119 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e310b-5304-44f3-b92a-dcdf761384e4 service placement] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:37:01.686078 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e310b-5304-44f3-b92a-dcdf761384e4 service placement] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:37:01.743631 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888b0a2-1eac-48fd-911a-2dd01cdff4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:37:01.744186 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888b0a2-1eac-48fd-911a-2dd01cdff4f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:37:01.744466 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888b0a2-1eac-48fd-911a-2dd01cdff4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:37:01.744739 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888b0a2-1eac-48fd-911a-2dd01cdff4f9 admin admin] PATH_INFO: `/v3/projects/990cadd5d2e0463ba54a76199f465736` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:37:01.745892 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888b0a2-1eac-48fd-911a-2dd01cdff4f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=990cadd5d2e0463ba54a76199f465736)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:37:01.747794 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888b0a2-1eac-48fd-911a-2dd01cdff4f9 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:37:01.792307 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-7888b0a2-1eac-48fd-911a-2dd01cdff4f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '990cadd5d2e0463ba54a76199f465736', 'request_id': 'req-7888b0a2-1eac-48fd-911a-2dd01cdff4f9'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:37:01.797801 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-7888b0a2-1eac-48fd-911a-2dd01cdff4f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '990cadd5d2e0463ba54a76199f465736', 'request_id': 'req-7888b0a2-1eac-48fd-911a-2dd01cdff4f9'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:37:01.803738 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-7888b0a2-1eac-48fd-911a-2dd01cdff4f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '990cadd5d2e0463ba54a76199f465736', 'request_id': 'req-7888b0a2-1eac-48fd-911a-2dd01cdff4f9'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:37:01.815624 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-7888b0a2-1eac-48fd-911a-2dd01cdff4f9 admin admin] The token cache is being invalidate because project 990cadd5d2e0463ba54a76199f465736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:37:01.815928 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-7888b0a2-1eac-48fd-911a-2dd01cdff4f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:37:01.816535 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-7888b0a2-1eac-48fd-911a-2dd01cdff4f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:37:01.818076 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1397/2796] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:37:01 2022] DELETE /identity/v3/projects/990cadd5d2e0463ba54a76199f465736 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:37:01.822665 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0c55d-a76b-45e0-ba20-18d659dd60ad admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:37:01.824081 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-0fd0c55d-a76b-45e0-ba20-18d659dd60ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:37:01.837722 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0c55d-a76b-45e0-ba20-18d659dd60ad admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:37:01.862094 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:37:01.902458 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbfe7a-46a8-4ac2-81f9-058854657147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:37:01.903106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbfe7a-46a8-4ac2-81f9-058854657147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:37:01.903388 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbfe7a-46a8-4ac2-81f9-058854657147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:37:01.903664 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbfe7a-46a8-4ac2-81f9-058854657147 admin admin] PATH_INFO: `/v3/users/5a797d556f314170bab7a6b2c25d81e0` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:37:01.904828 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebbfe7a-46a8-4ac2-81f9-058854657147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a797d556f314170bab7a6b2c25d81e0)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:37:01.909312 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebbfe7a-46a8-4ac2-81f9-058854657147 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:37:01.968864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2ebbfe7a-46a8-4ac2-81f9-058854657147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a797d556f314170bab7a6b2c25d81e0'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:37:01.985310 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2ebbfe7a-46a8-4ac2-81f9-058854657147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a797d556f314170bab7a6b2c25d81e0'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:37:01.985683 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2ebbfe7a-46a8-4ac2-81f9-058854657147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a797d556f314170bab7a6b2c25d81e0'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:37:02.004368 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2ebbfe7a-46a8-4ac2-81f9-058854657147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a797d556f314170bab7a6b2c25d81e0'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:37:02.012268 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2ebbfe7a-46a8-4ac2-81f9-058854657147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a797d556f314170bab7a6b2c25d81e0'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:37:02.018985 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1400/2797] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:37:01 2022] DELETE /identity/v3/users/5a797d556f314170bab7a6b2c25d81e0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:37:02.220347 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888b0a2-1eac-48fd-911a-2dd01cdff4f9 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:37:02.222067 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-7888b0a2-1eac-48fd-911a-2dd01cdff4f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:37:02.246329 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888b0a2-1eac-48fd-911a-2dd01cdff4f9 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:37:02.268439 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:37:02.315730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66f576-1cee-4775-aaad-2ff1b53f8bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:37:02.316402 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66f576-1cee-4775-aaad-2ff1b53f8bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:37:02.316858 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66f576-1cee-4775-aaad-2ff1b53f8bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:37:02.317055 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66f576-1cee-4775-aaad-2ff1b53f8bf1 admin admin] PATH_INFO: `/v3/projects/78e85f7422b84255b372fb8daf142843` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:37:02.318361 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66f576-1cee-4775-aaad-2ff1b53f8bf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78e85f7422b84255b372fb8daf142843)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:37:02.321215 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66f576-1cee-4775-aaad-2ff1b53f8bf1 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:37:02.365977 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-0f66f576-1cee-4775-aaad-2ff1b53f8bf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78e85f7422b84255b372fb8daf142843', 'request_id': 'req-0f66f576-1cee-4775-aaad-2ff1b53f8bf1'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:37:02.372245 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-0f66f576-1cee-4775-aaad-2ff1b53f8bf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78e85f7422b84255b372fb8daf142843', 'request_id': 'req-0f66f576-1cee-4775-aaad-2ff1b53f8bf1'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:37:02.378423 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-0f66f576-1cee-4775-aaad-2ff1b53f8bf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78e85f7422b84255b372fb8daf142843', 'request_id': 'req-0f66f576-1cee-4775-aaad-2ff1b53f8bf1'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:37:02.390610 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-0f66f576-1cee-4775-aaad-2ff1b53f8bf1 admin admin] The token cache is being invalidate because project 78e85f7422b84255b372fb8daf142843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:37:02.390900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-0f66f576-1cee-4775-aaad-2ff1b53f8bf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:37:02.391512 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-0f66f576-1cee-4775-aaad-2ff1b53f8bf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:37:02.392968 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1398/2798] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:37:02 2022] DELETE /identity/v3/projects/78e85f7422b84255b372fb8daf142843 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:37:12.015280 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=41,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:37:12.387528 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:37:21.666330 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b431e-3d7a-4465-9cd1-47fbe0b1ea6a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:37:21.666852 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b431e-3d7a-4465-9cd1-47fbe0b1ea6a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:37:21.666852 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b431e-3d7a-4465-9cd1-47fbe0b1ea6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:37:21.690888 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-831b431e-3d7a-4465-9cd1-47fbe0b1ea6a None None] MFA Rules not processed for user `07041df2276d4dd58fb0e49417a26e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:37:21.692113 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-831b431e-3d7a-4465-9cd1-47fbe0b1ea6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:37:21.753886 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1401/2799] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 9 02:37:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:37:21.827946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66f576-1cee-4775-aaad-2ff1b53f8bf1 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:37:21.829527 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-0f66f576-1cee-4775-aaad-2ff1b53f8bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:37:21.903979 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66f576-1cee-4775-aaad-2ff1b53f8bf1 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:37:21.909188 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa21fcc-32d1-4ead-9b8e-9f9826cd3044 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9151f210d29542dcb41ea3bc03390350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:37:21.909736 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa21fcc-32d1-4ead-9b8e-9f9826cd3044 service swift] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:37:21.910017 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa21fcc-32d1-4ead-9b8e-9f9826cd3044 service swift] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:37:21.910290 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa21fcc-32d1-4ead-9b8e-9f9826cd3044 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:37:21.919318 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa21fcc-32d1-4ead-9b8e-9f9826cd3044 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:37:21.921003 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa21fcc-32d1-4ead-9b8e-9f9826cd3044 service swift] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:37:21.929555 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1399/2800] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 9 02:37:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 02:37:31.745163 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=25 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:37:31.926303 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=32 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:37:34.525766 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831282a-f158-4cc5-a1ca-92900d72bc27 None None] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:37:34.526304 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831282a-f158-4cc5-a1ca-92900d72bc27 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:37:34.526652 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831282a-f158-4cc5-a1ca-92900d72bc27 None None] PATH_INFO: `/` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:37:34.528067 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1402/2801] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 9 02:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 02:37:34.532937 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61facf0-2b46-4f9e-b9ab-b685bf612bd3 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:37:34.533895 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61facf0-2b46-4f9e-b9ab-b685bf612bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:37:34.534182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61facf0-2b46-4f9e-b9ab-b685bf612bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:37:34.554275 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-f61facf0-2b46-4f9e-b9ab-b685bf612bd3 None None] MFA Rules not processed for user `78fff294b9794a26aa1bbc231fa1133c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:37:34.556278 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f61facf0-2b46-4f9e-b9ab-b685bf612bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:37:34.623795 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1400/2802] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 9 02:37:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:37:34.635058 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831282a-f158-4cc5-a1ca-92900d72bc27 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:37:34.636778 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-b831282a-f158-4cc5-a1ca-92900d72bc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:37:34.696156 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831282a-f158-4cc5-a1ca-92900d72bc27 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:37:34.699703 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0af58-2e47-4862-bd9e-7134cb1d3d95 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63645a88f5924a57b5b828aacd856902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:37:34.700330 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0af58-2e47-4862-bd9e-7134cb1d3d95 service glance] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:37:34.700612 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0af58-2e47-4862-bd9e-7134cb1d3d95 service glance] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:37:34.700884 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0af58-2e47-4862-bd9e-7134cb1d3d95 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:37:34.710816 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0af58-2e47-4862-bd9e-7134cb1d3d95 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:37:34.712289 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0af58-2e47-4862-bd9e-7134cb1d3d95 service glance] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:37:34.723167 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1403/2803] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:37:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:37:36.924082 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d7c14-88c3-4d1e-b8da-ad1206ffcdd7 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:37:36.924608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d7c14-88c3-4d1e-b8da-ad1206ffcdd7 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:37:36.924796 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d7c14-88c3-4d1e-b8da-ad1206ffcdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:37:36.945339 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-cf5d7c14-88c3-4d1e-b8da-ad1206ffcdd7 None None] MFA Rules not processed for user `07041df2276d4dd58fb0e49417a26e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:37:36.946591 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-cf5d7c14-88c3-4d1e-b8da-ad1206ffcdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:37:36.954944 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1401/2804] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 9 02:37:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:37:36.967013 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0af58-2e47-4862-bd9e-7134cb1d3d95 service glance] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:37:36.980005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0af58-2e47-4862-bd9e-7134cb1d3d95 service glance] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:37:36.985621 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24211148-fbfc-4adc-a874-4ccdf85bc713 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9151f210d29542dcb41ea3bc03390350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:37:36.986227 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24211148-fbfc-4adc-a874-4ccdf85bc713 service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:37:36.986506 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24211148-fbfc-4adc-a874-4ccdf85bc713 service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:37:36.986776 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24211148-fbfc-4adc-a874-4ccdf85bc713 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:37:36.995882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24211148-fbfc-4adc-a874-4ccdf85bc713 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:37:36.997877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24211148-fbfc-4adc-a874-4ccdf85bc713 service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:37:37.009712 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1404/2805] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 9 02:37:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 02:37:46.938799 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=34 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:37:47.006207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=32 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:37:51.571519 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3af426-3885-4a64-a4ba-d66052ed8499 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:37:51.572013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3af426-3885-4a64-a4ba-d66052ed8499 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:37:51.572118 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3af426-3885-4a64-a4ba-d66052ed8499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:37:51.591034 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-aa3af426-3885-4a64-a4ba-d66052ed8499 None None] MFA Rules not processed for user `07041df2276d4dd58fb0e49417a26e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:37:51.592213 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-aa3af426-3885-4a64-a4ba-d66052ed8499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:37:51.599426 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1402/2806] 10.222.0.16 () {58 vars in 967 bytes} [Tue Aug 9 02:37:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:37:51.611834 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24211148-fbfc-4adc-a874-4ccdf85bc713 service swift] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:37:51.622605 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24211148-fbfc-4adc-a874-4ccdf85bc713 service swift] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:37:51.627796 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892089f-12a9-4fe9-9948-ba3b6a2c5c43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9151f210d29542dcb41ea3bc03390350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:37:51.628410 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892089f-12a9-4fe9-9948-ba3b6a2c5c43 service swift] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:37:51.628688 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892089f-12a9-4fe9-9948-ba3b6a2c5c43 service swift] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:37:51.628959 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892089f-12a9-4fe9-9948-ba3b6a2c5c43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:37:51.637007 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892089f-12a9-4fe9-9948-ba3b6a2c5c43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:37:51.638597 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892089f-12a9-4fe9-9948-ba3b6a2c5c43 service swift] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:37:51.646578 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1405/2807] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 9 02:37:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 02:38:01.585428 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:38:01.643259 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=6 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:38:27.742613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696eddf4-635f-48fa-830f-fd82e627786b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:38:27.743184 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696eddf4-635f-48fa-830f-fd82e627786b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:38:27.743184 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696eddf4-635f-48fa-830f-fd82e627786b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:38:27.774166 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-696eddf4-635f-48fa-830f-fd82e627786b None None] MFA Rules not processed for user `0aa33ae8162c4e0f80965298def294c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:38:27.775377 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-696eddf4-635f-48fa-830f-fd82e627786b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:38:27.844153 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1403/2808] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:38:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:38:28.145399 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892089f-12a9-4fe9-9948-ba3b6a2c5c43 service swift] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:38:28.146902 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4892089f-12a9-4fe9-9948-ba3b6a2c5c43 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:38:28.222229 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892089f-12a9-4fe9-9948-ba3b6a2c5c43 service swift] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:38:28.225771 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfcdfe1-9a25-4a1c-be13-bbb019bb45f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:38:28.226360 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcdfe1-9a25-4a1c-be13-bbb019bb45f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:38:28.226639 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcdfe1-9a25-4a1c-be13-bbb019bb45f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:38:28.226909 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfcdfe1-9a25-4a1c-be13-bbb019bb45f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:38:28.229229 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-3bfcdfe1-9a25-4a1c-be13-bbb019bb45f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:38:28.238371 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfcdfe1-9a25-4a1c-be13-bbb019bb45f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:38:28.239810 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfcdfe1-9a25-4a1c-be13-bbb019bb45f7 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:38:28.247564 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1406/2809] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:38:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:38:29.010198 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696eddf4-635f-48fa-830f-fd82e627786b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:38:29.011613 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-696eddf4-635f-48fa-830f-fd82e627786b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:38:29.109465 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696eddf4-635f-48fa-830f-fd82e627786b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:38:29.114750 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef241f41-dcc2-4bf9-860a-f1bfe71ab932 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fe21d9a65a34abeae7329df924d7998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:38:29.115359 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef241f41-dcc2-4bf9-860a-f1bfe71ab932 service placement] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:38:29.115645 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef241f41-dcc2-4bf9-860a-f1bfe71ab932 service placement] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:38:29.115917 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef241f41-dcc2-4bf9-860a-f1bfe71ab932 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:38:29.117668 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ef241f41-dcc2-4bf9-860a-f1bfe71ab932 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:38:29.129601 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef241f41-dcc2-4bf9-860a-f1bfe71ab932 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:38:29.131166 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef241f41-dcc2-4bf9-860a-f1bfe71ab932 service placement] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:38:29.141630 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1404/2810] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:38:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:38:38.244572 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=35 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:38:39.137552 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=81 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:39:30.199270 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0daecf-84a1-4226-accc-b093cf9cd0e0 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:39:30.199824 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0daecf-84a1-4226-accc-b093cf9cd0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:39:30.200017 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0daecf-84a1-4226-accc-b093cf9cd0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:39:30.232058 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-5f0daecf-84a1-4226-accc-b093cf9cd0e0 None None] MFA Rules not processed for user `07041df2276d4dd58fb0e49417a26e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:39:30.233333 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-5f0daecf-84a1-4226-accc-b093cf9cd0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:39:30.248174 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1407/2811] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 9 02:39:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:39:30.297853 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef241f41-dcc2-4bf9-860a-f1bfe71ab932 service placement] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:39:30.308918 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef241f41-dcc2-4bf9-860a-f1bfe71ab932 service placement] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:39:30.314241 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990add61-c88e-497b-ad90-aac39cc49e92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9151f210d29542dcb41ea3bc03390350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:39:30.314841 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990add61-c88e-497b-ad90-aac39cc49e92 service swift] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:39:30.315120 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990add61-c88e-497b-ad90-aac39cc49e92 service swift] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:39:30.315388 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990add61-c88e-497b-ad90-aac39cc49e92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:39:30.324689 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990add61-c88e-497b-ad90-aac39cc49e92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:39:30.326294 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990add61-c88e-497b-ad90-aac39cc49e92 service swift] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:39:30.334737 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1405/2812] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 9 02:39:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 02:39:40.242358 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=10 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:39:40.331606 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=6 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:39:45.669315 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9530ee9-da43-4481-bd80-a366649864b6 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:39:45.669808 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9530ee9-da43-4481-bd80-a366649864b6 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:39:45.669920 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9530ee9-da43-4481-bd80-a366649864b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:39:45.688375 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-f9530ee9-da43-4481-bd80-a366649864b6 None None] MFA Rules not processed for user `07041df2276d4dd58fb0e49417a26e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:39:45.689600 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f9530ee9-da43-4481-bd80-a366649864b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:39:45.696536 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1408/2813] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 9 02:39:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:39:45.709622 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990add61-c88e-497b-ad90-aac39cc49e92 service swift] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:39:45.720617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990add61-c88e-497b-ad90-aac39cc49e92 service swift] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:39:45.725892 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c3818-f4ac-4425-990a-68c45cb72400 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9151f210d29542dcb41ea3bc03390350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:39:45.726490 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c3818-f4ac-4425-990a-68c45cb72400 service swift] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:39:45.726774 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c3818-f4ac-4425-990a-68c45cb72400 service swift] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:39:45.727049 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c3818-f4ac-4425-990a-68c45cb72400 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:39:45.734802 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c3818-f4ac-4425-990a-68c45cb72400 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:39:45.736389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c3818-f4ac-4425-990a-68c45cb72400 service swift] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:39:45.745359 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1406/2814] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 9 02:39:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 02:39:55.683806 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:39:55.742099 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=6 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:40:01.842697 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b958a87-7e73-4bc0-87e3-8168812701aa None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:40:01.843191 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b958a87-7e73-4bc0-87e3-8168812701aa None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:40:01.843310 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b958a87-7e73-4bc0-87e3-8168812701aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:40:01.862753 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-8b958a87-7e73-4bc0-87e3-8168812701aa None None] MFA Rules not processed for user `07041df2276d4dd58fb0e49417a26e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:40:01.863972 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-8b958a87-7e73-4bc0-87e3-8168812701aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:40:01.871075 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1409/2815] 10.222.0.16 () {58 vars in 967 bytes} [Tue Aug 9 02:40:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:40:01.883283 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c3818-f4ac-4425-990a-68c45cb72400 service swift] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:40:01.893996 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c3818-f4ac-4425-990a-68c45cb72400 service swift] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:40:01.899161 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f2d87-f373-483f-9920-ba6fac7f3806 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9151f210d29542dcb41ea3bc03390350', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:40:01.899782 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f2d87-f373-483f-9920-ba6fac7f3806 service swift] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:40:01.900064 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f2d87-f373-483f-9920-ba6fac7f3806 service swift] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:40:01.900334 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f2d87-f373-483f-9920-ba6fac7f3806 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:40:01.908912 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f2d87-f373-483f-9920-ba6fac7f3806 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:40:01.910493 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f2d87-f373-483f-9920-ba6fac7f3806 service swift] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:40:01.918868 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1407/2816] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 9 02:40:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 02:40:11.858053 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:40:11.915101 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=6 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:40:33.737761 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b958a87-7e73-4bc0-87e3-8168812701aa None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:40:33.757494 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b958a87-7e73-4bc0-87e3-8168812701aa None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:40:33.761438 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c6211-88b8-4fab-912e-3a3c0c9f385a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:40:33.762039 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c6211-88b8-4fab-912e-3a3c0c9f385a service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:40:33.762320 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c6211-88b8-4fab-912e-3a3c0c9f385a service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:40:33.762592 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c6211-88b8-4fab-912e-3a3c0c9f385a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:40:33.764344 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ef7c6211-88b8-4fab-912e-3a3c0c9f385a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:40:33.789587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c6211-88b8-4fab-912e-3a3c0c9f385a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:40:33.791023 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c6211-88b8-4fab-912e-3a3c0c9f385a service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:40:33.812413 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1410/2817] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:40:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:40:34.995507 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f2d87-f373-483f-9920-ba6fac7f3806 service swift] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:40:35.005391 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f2d87-f373-483f-9920-ba6fac7f3806 service swift] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:40:35.009307 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10783c-6d95-4710-98db-b90441738b51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:40:35.009903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10783c-6d95-4710-98db-b90441738b51 service neutron] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:40:35.010185 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10783c-6d95-4710-98db-b90441738b51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:40:35.010459 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10783c-6d95-4710-98db-b90441738b51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:40:35.012859 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6c10783c-6d95-4710-98db-b90441738b51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:40:35.026219 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10783c-6d95-4710-98db-b90441738b51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:40:35.027697 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10783c-6d95-4710-98db-b90441738b51 service neutron] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:40:35.038653 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1408/2818] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:40:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:40:43.463728 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c6211-88b8-4fab-912e-3a3c0c9f385a service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:40:43.466826 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ef7c6211-88b8-4fab-912e-3a3c0c9f385a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:40:43.568063 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c6211-88b8-4fab-912e-3a3c0c9f385a service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:40:43.572621 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2dda1-92e9-4ba6-82d4-aa4210ed132e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:40:43.573282 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2dda1-92e9-4ba6-82d4-aa4210ed132e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:40:43.573560 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2dda1-92e9-4ba6-82d4-aa4210ed132e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:40:43.573831 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2dda1-92e9-4ba6-82d4-aa4210ed132e admin admin] PATH_INFO: `/v3/users/0aa33ae8162c4e0f80965298def294c5` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:40:43.574945 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2dda1-92e9-4ba6-82d4-aa4210ed132e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aa33ae8162c4e0f80965298def294c5)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:40:43.576860 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2dda1-92e9-4ba6-82d4-aa4210ed132e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:40:43.622118 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bfd2dda1-92e9-4ba6-82d4-aa4210ed132e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aa33ae8162c4e0f80965298def294c5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:40:43.629295 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bfd2dda1-92e9-4ba6-82d4-aa4210ed132e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aa33ae8162c4e0f80965298def294c5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:40:43.629933 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bfd2dda1-92e9-4ba6-82d4-aa4210ed132e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aa33ae8162c4e0f80965298def294c5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:40:43.641815 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bfd2dda1-92e9-4ba6-82d4-aa4210ed132e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aa33ae8162c4e0f80965298def294c5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:40:43.648512 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-bfd2dda1-92e9-4ba6-82d4-aa4210ed132e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aa33ae8162c4e0f80965298def294c5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:40:43.654957 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1411/2819] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:40:43 2022] DELETE /identity/v3/users/0aa33ae8162c4e0f80965298def294c5 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:40:43.829014 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10783c-6d95-4710-98db-b90441738b51 service neutron] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:40:43.842413 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10783c-6d95-4710-98db-b90441738b51 service neutron] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:40:43.899985 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344c936-ca95-4eea-8948-11e2337f664a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:40:43.900617 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344c936-ca95-4eea-8948-11e2337f664a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:40:43.900898 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344c936-ca95-4eea-8948-11e2337f664a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:40:43.901209 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344c936-ca95-4eea-8948-11e2337f664a admin admin] PATH_INFO: `/v3/projects/40fcdb5a3c584d8fb5abdf91779508c4` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:40:43.902949 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344c936-ca95-4eea-8948-11e2337f664a admin admin] RBAC: Authorizing `identity:delete_project(project_id=40fcdb5a3c584d8fb5abdf91779508c4)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:40:43.904844 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344c936-ca95-4eea-8948-11e2337f664a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:40:43.949595 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-0344c936-ca95-4eea-8948-11e2337f664a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40fcdb5a3c584d8fb5abdf91779508c4', 'request_id': 'req-0344c936-ca95-4eea-8948-11e2337f664a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:40:43.954906 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-0344c936-ca95-4eea-8948-11e2337f664a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40fcdb5a3c584d8fb5abdf91779508c4', 'request_id': 'req-0344c936-ca95-4eea-8948-11e2337f664a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:40:43.960831 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-0344c936-ca95-4eea-8948-11e2337f664a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40fcdb5a3c584d8fb5abdf91779508c4', 'request_id': 'req-0344c936-ca95-4eea-8948-11e2337f664a'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:40:43.974526 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-0344c936-ca95-4eea-8948-11e2337f664a admin admin] The token cache is being invalidate because project 40fcdb5a3c584d8fb5abdf91779508c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:40:43.974819 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-0344c936-ca95-4eea-8948-11e2337f664a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:40:43.975461 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-0344c936-ca95-4eea-8948-11e2337f664a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:40:43.977205 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1409/2820] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:40:43 2022] DELETE /identity/v3/projects/40fcdb5a3c584d8fb5abdf91779508c4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:40:43.981895 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d295a6-e812-4a92-85be-68d7c29483a3 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:40:43.982207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d295a6-e812-4a92-85be-68d7c29483a3 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:40:43.982486 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d295a6-e812-4a92-85be-68d7c29483a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:40:43.994297 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:40:44.041684 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-89d295a6-e812-4a92-85be-68d7c29483a3 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:40:44.042890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-89d295a6-e812-4a92-85be-68d7c29483a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:40:44.105789 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1412/2821] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:40:44.113773 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075be005-0768-456e-b634-639cde3b0574 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:40:44.114161 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075be005-0768-456e-b634-639cde3b0574 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:40:44.114509 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075be005-0768-456e-b634-639cde3b0574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:40:44.134586 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-075be005-0768-456e-b634-639cde3b0574 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:40:44.135832 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-075be005-0768-456e-b634-639cde3b0574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:40:44.144297 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1410/2822] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:40:44.148663 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d295a6-e812-4a92-85be-68d7c29483a3 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:40:44.160080 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d295a6-e812-4a92-85be-68d7c29483a3 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:40:44.165662 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d4939-d19f-409e-9022-df9343f5b65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:40:44.166260 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d4939-d19f-409e-9022-df9343f5b65a admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:40:44.166560 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d4939-d19f-409e-9022-df9343f5b65a admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:40:44.166837 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d4939-d19f-409e-9022-df9343f5b65a admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:40:44.167483 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d4939-d19f-409e-9022-df9343f5b65a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:40:44.167788 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d4939-d19f-409e-9022-df9343f5b65a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:40:44.169421 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d4939-d19f-409e-9022-df9343f5b65a admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:40:44.180909 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1413/2823] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:40:44.185852 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075be005-0768-456e-b634-639cde3b0574 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:40:44.194927 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075be005-0768-456e-b634-639cde3b0574 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:40:44.200172 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e6b2f-f652-474a-8c40-60e7fc98edb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:40:44.200699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e6b2f-f652-474a-8c40-60e7fc98edb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:40:44.200956 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e6b2f-f652-474a-8c40-60e7fc98edb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:40:44.201258 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e6b2f-f652-474a-8c40-60e7fc98edb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:40:44.201870 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e6b2f-f652-474a-8c40-60e7fc98edb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:40:44.203753 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e6b2f-f652-474a-8c40-60e7fc98edb0 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:40:44.240389 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1411/2824] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:40:44 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:40:44.243864 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d4939-d19f-409e-9022-df9343f5b65a admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:40:44.254477 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d4939-d19f-409e-9022-df9343f5b65a admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:40:44.313317 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da7955-4537-49c0-8e09-185f2551250c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:40:44.313925 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da7955-4537-49c0-8e09-185f2551250c admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:40:44.314207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da7955-4537-49c0-8e09-185f2551250c admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:40:44.314483 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da7955-4537-49c0-8e09-185f2551250c admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:40:44.315122 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da7955-4537-49c0-8e09-185f2551250c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:40:44.317067 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da7955-4537-49c0-8e09-185f2551250c admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:40:44.338012 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1414/2825] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:40:44 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:40:44.342100 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e6b2f-f652-474a-8c40-60e7fc98edb0 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:40:44.352615 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e6b2f-f652-474a-8c40-60e7fc98edb0 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:40:44.357193 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b1640-444b-438e-ad8f-f82f47882a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:40:44.357788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b1640-444b-438e-ad8f-f82f47882a47 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:40:44.358065 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b1640-444b-438e-ad8f-f82f47882a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:40:44.358332 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b1640-444b-438e-ad8f-f82f47882a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:40:44.359608 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b1640-444b-438e-ad8f-f82f47882a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:40:44.361250 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b1640-444b-438e-ad8f-f82f47882a47 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:40:44.371594 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1412/2826] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:40:44.375407 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da7955-4537-49c0-8e09-185f2551250c admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:40:44.385504 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da7955-4537-49c0-8e09-185f2551250c admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:40:44.390898 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be133ee3-9da5-474b-a301-053ef76bb2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:40:44.391490 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be133ee3-9da5-474b-a301-053ef76bb2ad admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:40:44.391772 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be133ee3-9da5-474b-a301-053ef76bb2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:40:44.392046 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be133ee3-9da5-474b-a301-053ef76bb2ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:40:44.392687 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be133ee3-9da5-474b-a301-053ef76bb2ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:40:44.394316 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be133ee3-9da5-474b-a301-053ef76bb2ad admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:40:44.406521 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1415/2827] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:40:44.410672 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b1640-444b-438e-ad8f-f82f47882a47 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:40:44.420596 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b1640-444b-438e-ad8f-f82f47882a47 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:40:44.425322 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cab95-60ee-489d-801d-aa1683324c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:40:44.425976 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cab95-60ee-489d-801d-aa1683324c91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:40:44.426266 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cab95-60ee-489d-801d-aa1683324c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:40:44.426541 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71cab95-60ee-489d-801d-aa1683324c91 admin admin] PATH_INFO: `/v3/projects/6d17d7721f7e4ca58f9b11e23a057a59/users/5b6c2151455543629e195ef3fe297b0e/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:40:44.441360 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71cab95-60ee-489d-801d-aa1683324c91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d17d7721f7e4ca58f9b11e23a057a59, user_id=5b6c2151455543629e195ef3fe297b0e, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:40:44.444003 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71cab95-60ee-489d-801d-aa1683324c91 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:40:44.457706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1413/2828] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:40:44 2022] PUT /identity/v3/projects/6d17d7721f7e4ca58f9b11e23a057a59/users/5b6c2151455543629e195ef3fe297b0e/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:40:44.467758 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab4cd7-ff53-434f-9b48-9368d58b6c53 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:40:44.468215 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab4cd7-ff53-434f-9b48-9368d58b6c53 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:40:44.468313 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab4cd7-ff53-434f-9b48-9368d58b6c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:40:44.496454 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e4ab4cd7-ff53-434f-9b48-9368d58b6c53 None None] MFA Rules not processed for user `5b6c2151455543629e195ef3fe297b0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:40:44.497717 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e4ab4cd7-ff53-434f-9b48-9368d58b6c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:40:44.529728 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:40:44.563095 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1416/2829] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:40:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:40:44.567586 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cab95-60ee-489d-801d-aa1683324c91 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:40:44.573143 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:40:44.631163 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71cab95-60ee-489d-801d-aa1683324c91 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:40:44.635819 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a94b1-c221-4053-b9ca-c97a01cb8cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:40:44.636418 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a94b1-c221-4053-b9ca-c97a01cb8cdd admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:40:44.636729 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a94b1-c221-4053-b9ca-c97a01cb8cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:40:44.637006 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a94b1-c221-4053-b9ca-c97a01cb8cdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:40:44.637645 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a94b1-c221-4053-b9ca-c97a01cb8cdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:40:44.639530 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a94b1-c221-4053-b9ca-c97a01cb8cdd admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:40:44.664979 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1414/2830] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:40:44 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:40:44.669671 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab4cd7-ff53-434f-9b48-9368d58b6c53 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:40:44.680354 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab4cd7-ff53-434f-9b48-9368d58b6c53 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:40:44.736617 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f0aa2-3a80-49f2-8b28-e98c4670a173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:40:44.737166 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f0aa2-3a80-49f2-8b28-e98c4670a173 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:40:44.737453 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f0aa2-3a80-49f2-8b28-e98c4670a173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:40:44.737732 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f0aa2-3a80-49f2-8b28-e98c4670a173 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:40:44.738367 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f0aa2-3a80-49f2-8b28-e98c4670a173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:40:44.740285 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f0aa2-3a80-49f2-8b28-e98c4670a173 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:40:44.761835 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1417/2831] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:40:44 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:40:44.765819 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a94b1-c221-4053-b9ca-c97a01cb8cdd admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:40:44.776584 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a94b1-c221-4053-b9ca-c97a01cb8cdd admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:40:44.781276 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77edd1b-5a8e-4d0c-9aab-5c2b4780ac37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:40:44.781873 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77edd1b-5a8e-4d0c-9aab-5c2b4780ac37 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:40:44.782157 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77edd1b-5a8e-4d0c-9aab-5c2b4780ac37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:40:44.782433 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77edd1b-5a8e-4d0c-9aab-5c2b4780ac37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:40:44.783072 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77edd1b-5a8e-4d0c-9aab-5c2b4780ac37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:40:44.784673 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77edd1b-5a8e-4d0c-9aab-5c2b4780ac37 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:40:44.796592 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1415/2832] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:40:44.800725 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f0aa2-3a80-49f2-8b28-e98c4670a173 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:40:44.811005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f0aa2-3a80-49f2-8b28-e98c4670a173 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:40:44.815582 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e35ff-402d-4458-8363-579488949181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:40:44.816211 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e35ff-402d-4458-8363-579488949181 admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:40:44.816491 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e35ff-402d-4458-8363-579488949181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:40:44.816763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e35ff-402d-4458-8363-579488949181 admin admin] PATH_INFO: `/v3/projects/ca4ab578b7a342e8bb7fe8fe1f111f8b/users/923570b9d62f4dcf9a0c7b29da1caeb5/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:40:44.831380 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e35ff-402d-4458-8363-579488949181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4ab578b7a342e8bb7fe8fe1f111f8b, user_id=923570b9d62f4dcf9a0c7b29da1caeb5, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:40:44.834066 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e35ff-402d-4458-8363-579488949181 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:40:44.846479 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1418/2833] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:40:44 2022] PUT /identity/v3/projects/ca4ab578b7a342e8bb7fe8fe1f111f8b/users/923570b9d62f4dcf9a0c7b29da1caeb5/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:40:44.850796 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77edd1b-5a8e-4d0c-9aab-5c2b4780ac37 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:40:44.862903 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77edd1b-5a8e-4d0c-9aab-5c2b4780ac37 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:40:44.917707 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec070b-9a6d-457a-a4d3-fee327279417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:40:44.918882 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec070b-9a6d-457a-a4d3-fee327279417 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:40:44.919158 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec070b-9a6d-457a-a4d3-fee327279417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:40:44.919427 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec070b-9a6d-457a-a4d3-fee327279417 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:40:44.920052 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec070b-9a6d-457a-a4d3-fee327279417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:40:44.921660 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec070b-9a6d-457a-a4d3-fee327279417 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:40:44.931009 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1416/2834] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:40:44.935247 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e35ff-402d-4458-8363-579488949181 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:40:44.945431 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e35ff-402d-4458-8363-579488949181 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:40:44.950027 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b4278-4621-4f90-851f-e38bb592e30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:40:44.950691 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b4278-4621-4f90-851f-e38bb592e30d admin admin] REQUEST_METHOD: `PUT` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:40:44.950971 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b4278-4621-4f90-851f-e38bb592e30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:40:44.951243 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b4278-4621-4f90-851f-e38bb592e30d admin admin] PATH_INFO: `/v3/projects/ca4ab578b7a342e8bb7fe8fe1f111f8b/users/923570b9d62f4dcf9a0c7b29da1caeb5/roles/e2095c5a29d74c33b9dcb16f8e5343bf` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:40:44.953182 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b4278-4621-4f90-851f-e38bb592e30d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4ab578b7a342e8bb7fe8fe1f111f8b, user_id=923570b9d62f4dcf9a0c7b29da1caeb5, role_id=e2095c5a29d74c33b9dcb16f8e5343bf)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:40:44.955813 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b4278-4621-4f90-851f-e38bb592e30d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:40:44.966391 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1419/2835] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:40:44 2022] PUT /identity/v3/projects/ca4ab578b7a342e8bb7fe8fe1f111f8b/users/923570b9d62f4dcf9a0c7b29da1caeb5/roles/e2095c5a29d74c33b9dcb16f8e5343bf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:40:44.978237 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964051a9-ede4-4860-b805-066941118c31 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:40:44.978530 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964051a9-ede4-4860-b805-066941118c31 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:40:44.978810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964051a9-ede4-4860-b805-066941118c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:40:45.006497 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-964051a9-ede4-4860-b805-066941118c31 None None] MFA Rules not processed for user `923570b9d62f4dcf9a0c7b29da1caeb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:40:45.007651 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-964051a9-ede4-4860-b805-066941118c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:40:45.070623 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:40:45.074763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1417/2836] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:40:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:40:45.086848 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b4278-4621-4f90-851f-e38bb592e30d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:40:45.088665 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-1c6b4278-4621-4f90-851f-e38bb592e30d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:40:45.168736 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b4278-4621-4f90-851f-e38bb592e30d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:40:45.172505 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0423592-0814-4fb9-b832-dab26f96ae09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:40:45.173231 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0423592-0814-4fb9-b832-dab26f96ae09 service cinder] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:40:45.173534 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0423592-0814-4fb9-b832-dab26f96ae09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:40:45.173910 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0423592-0814-4fb9-b832-dab26f96ae09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:40:45.182843 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0423592-0814-4fb9-b832-dab26f96ae09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:40:45.184308 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0423592-0814-4fb9-b832-dab26f96ae09 service cinder] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:40:45.193568 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1420/2837] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:40:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:40:45.268017 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964051a9-ede4-4860-b805-066941118c31 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:40:45.278303 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964051a9-ede4-4860-b805-066941118c31 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:40:45.281884 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490c7a6-1702-47bd-86d7-b7f0f8fdcb3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:40:45.282481 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490c7a6-1702-47bd-86d7-b7f0f8fdcb3a service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:40:45.282760 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490c7a6-1702-47bd-86d7-b7f0f8fdcb3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:40:45.283030 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490c7a6-1702-47bd-86d7-b7f0f8fdcb3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:40:45.337862 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490c7a6-1702-47bd-86d7-b7f0f8fdcb3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:40:45.339298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490c7a6-1702-47bd-86d7-b7f0f8fdcb3a service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:40:45.348953 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1418/2838] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:40:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:40:55.189458 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=91,keystone:INSERT=5 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:40:55.344625 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=28 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:14.277893 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0423592-0814-4fb9-b832-dab26f96ae09 service cinder] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:14.338470 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0423592-0814-4fb9-b832-dab26f96ae09 service cinder] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:14.343074 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6bb49-2428-4f0a-ac72-153125ddfaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:14.343700 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6bb49-2428-4f0a-ac72-153125ddfaae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:14.343979 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6bb49-2428-4f0a-ac72-153125ddfaae admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:14.344247 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6bb49-2428-4f0a-ac72-153125ddfaae admin admin] PATH_INFO: `/v3/users/5b6c2151455543629e195ef3fe297b0e` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:14.345403 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f6bb49-2428-4f0a-ac72-153125ddfaae admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b6c2151455543629e195ef3fe297b0e)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:14.347428 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f6bb49-2428-4f0a-ac72-153125ddfaae admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:14.392933 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-83f6bb49-2428-4f0a-ac72-153125ddfaae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b6c2151455543629e195ef3fe297b0e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:14.400168 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-83f6bb49-2428-4f0a-ac72-153125ddfaae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b6c2151455543629e195ef3fe297b0e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:14.400786 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-83f6bb49-2428-4f0a-ac72-153125ddfaae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b6c2151455543629e195ef3fe297b0e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:14.414241 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-83f6bb49-2428-4f0a-ac72-153125ddfaae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b6c2151455543629e195ef3fe297b0e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:14.421096 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-83f6bb49-2428-4f0a-ac72-153125ddfaae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b6c2151455543629e195ef3fe297b0e'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:14.427038 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1421/2839] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:41:14 2022] DELETE /identity/v3/users/5b6c2151455543629e195ef3fe297b0e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:41:14.431531 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620ab2f-7a80-4a31-a926-b2d81b4c9faf None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:14.431995 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620ab2f-7a80-4a31-a926-b2d81b4c9faf None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:14.432096 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620ab2f-7a80-4a31-a926-b2d81b4c9faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:14.451086 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-4620ab2f-7a80-4a31-a926-b2d81b4c9faf None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:41:14.452891 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4620ab2f-7a80-4a31-a926-b2d81b4c9faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:41:14.510039 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1419/2840] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:41:14.519938 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6bb49-2428-4f0a-ac72-153125ddfaae admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:14.521368 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-83f6bb49-2428-4f0a-ac72-153125ddfaae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:41:14.588836 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6bb49-2428-4f0a-ac72-153125ddfaae admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:14.592435 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8f56c-9100-41bc-883e-cde3c1095f1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:14.593052 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8f56c-9100-41bc-883e-cde3c1095f1d service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:14.593328 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8f56c-9100-41bc-883e-cde3c1095f1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:14.593598 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8f56c-9100-41bc-883e-cde3c1095f1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:14.602687 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8f56c-9100-41bc-883e-cde3c1095f1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:14.604133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8f56c-9100-41bc-883e-cde3c1095f1d service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:14.613891 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1422/2841] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:41:14.872212 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620ab2f-7a80-4a31-a926-b2d81b4c9faf None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:14.873661 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-4620ab2f-7a80-4a31-a926-b2d81b4c9faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:41:14.886035 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620ab2f-7a80-4a31-a926-b2d81b4c9faf None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:14.890763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c8531-3d39-491d-bd21-d335fdd04efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:14.891396 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c8531-3d39-491d-bd21-d335fdd04efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:14.891683 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c8531-3d39-491d-bd21-d335fdd04efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:14.891946 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c8531-3d39-491d-bd21-d335fdd04efd admin admin] PATH_INFO: `/v3/projects/6d17d7721f7e4ca58f9b11e23a057a59` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:14.893088 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c8531-3d39-491d-bd21-d335fdd04efd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d17d7721f7e4ca58f9b11e23a057a59)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:14.895000 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c8531-3d39-491d-bd21-d335fdd04efd admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:14.941848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-044c8531-3d39-491d-bd21-d335fdd04efd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d17d7721f7e4ca58f9b11e23a057a59', 'request_id': 'req-044c8531-3d39-491d-bd21-d335fdd04efd'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:14.947313 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-044c8531-3d39-491d-bd21-d335fdd04efd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d17d7721f7e4ca58f9b11e23a057a59', 'request_id': 'req-044c8531-3d39-491d-bd21-d335fdd04efd'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:14.953468 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-044c8531-3d39-491d-bd21-d335fdd04efd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d17d7721f7e4ca58f9b11e23a057a59', 'request_id': 'req-044c8531-3d39-491d-bd21-d335fdd04efd'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:14.965467 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-044c8531-3d39-491d-bd21-d335fdd04efd admin admin] The token cache is being invalidate because project 6d17d7721f7e4ca58f9b11e23a057a59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:41:14.965759 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-044c8531-3d39-491d-bd21-d335fdd04efd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:14.966394 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-044c8531-3d39-491d-bd21-d335fdd04efd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:14.968527 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1420/2842] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:41:14 2022] DELETE /identity/v3/projects/6d17d7721f7e4ca58f9b11e23a057a59 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:41:14.972641 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8f56c-9100-41bc-883e-cde3c1095f1d service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:14.983267 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8f56c-9100-41bc-883e-cde3c1095f1d service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:14.991428 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:15.040299 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acbedc7-7b57-458e-8ed2-48ac6ef81a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:15.040927 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbedc7-7b57-458e-8ed2-48ac6ef81a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:15.041237 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbedc7-7b57-458e-8ed2-48ac6ef81a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:15.041511 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbedc7-7b57-458e-8ed2-48ac6ef81a8b admin admin] PATH_INFO: `/v3/users/923570b9d62f4dcf9a0c7b29da1caeb5` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:15.042618 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acbedc7-7b57-458e-8ed2-48ac6ef81a8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=923570b9d62f4dcf9a0c7b29da1caeb5)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:15.044556 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acbedc7-7b57-458e-8ed2-48ac6ef81a8b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:15.092672 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2acbedc7-7b57-458e-8ed2-48ac6ef81a8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '923570b9d62f4dcf9a0c7b29da1caeb5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:15.101808 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2acbedc7-7b57-458e-8ed2-48ac6ef81a8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '923570b9d62f4dcf9a0c7b29da1caeb5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:15.102633 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2acbedc7-7b57-458e-8ed2-48ac6ef81a8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '923570b9d62f4dcf9a0c7b29da1caeb5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:15.115204 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2acbedc7-7b57-458e-8ed2-48ac6ef81a8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '923570b9d62f4dcf9a0c7b29da1caeb5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:15.121976 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-2acbedc7-7b57-458e-8ed2-48ac6ef81a8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '923570b9d62f4dcf9a0c7b29da1caeb5'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:15.127821 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1423/2843] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:41:14 2022] DELETE /identity/v3/users/923570b9d62f4dcf9a0c7b29da1caeb5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:41:15.390542 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c8531-3d39-491d-bd21-d335fdd04efd admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:15.392109 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-044c8531-3d39-491d-bd21-d335fdd04efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:41:15.406738 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c8531-3d39-491d-bd21-d335fdd04efd admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:15.461788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb142b47-4aed-4ca4-b00a-fdce4d844c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:15.462414 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb142b47-4aed-4ca4-b00a-fdce4d844c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:15.462685 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb142b47-4aed-4ca4-b00a-fdce4d844c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:15.462957 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb142b47-4aed-4ca4-b00a-fdce4d844c93 admin admin] PATH_INFO: `/v3/projects/ca4ab578b7a342e8bb7fe8fe1f111f8b` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:15.464063 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb142b47-4aed-4ca4-b00a-fdce4d844c93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca4ab578b7a342e8bb7fe8fe1f111f8b)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:15.466017 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb142b47-4aed-4ca4-b00a-fdce4d844c93 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:15.495499 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:15.513359 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-cb142b47-4aed-4ca4-b00a-fdce4d844c93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca4ab578b7a342e8bb7fe8fe1f111f8b', 'request_id': 'req-cb142b47-4aed-4ca4-b00a-fdce4d844c93'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:15.519327 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-cb142b47-4aed-4ca4-b00a-fdce4d844c93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca4ab578b7a342e8bb7fe8fe1f111f8b', 'request_id': 'req-cb142b47-4aed-4ca4-b00a-fdce4d844c93'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:15.525316 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-cb142b47-4aed-4ca4-b00a-fdce4d844c93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca4ab578b7a342e8bb7fe8fe1f111f8b', 'request_id': 'req-cb142b47-4aed-4ca4-b00a-fdce4d844c93'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:15.537934 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-cb142b47-4aed-4ca4-b00a-fdce4d844c93 admin admin] The token cache is being invalidate because project ca4ab578b7a342e8bb7fe8fe1f111f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:41:15.538223 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-cb142b47-4aed-4ca4-b00a-fdce4d844c93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:15.538864 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-cb142b47-4aed-4ca4-b00a-fdce4d844c93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:15.540326 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1421/2844] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:41:15 2022] DELETE /identity/v3/projects/ca4ab578b7a342e8bb7fe8fe1f111f8b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:41:15.545437 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccebb7-3c48-4710-85d2-d438cba97db8 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:15.545891 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccebb7-3c48-4710-85d2-d438cba97db8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:15.546012 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccebb7-3c48-4710-85d2-d438cba97db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:15.565429 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-6dccebb7-3c48-4710-85d2-d438cba97db8 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:41:15.566627 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6dccebb7-3c48-4710-85d2-d438cba97db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:41:15.623824 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1424/2845] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:41:15.631681 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7924929-b157-4051-840f-9af9a2d67c62 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:15.631999 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7924929-b157-4051-840f-9af9a2d67c62 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:15.632310 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7924929-b157-4051-840f-9af9a2d67c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:15.652491 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-b7924929-b157-4051-840f-9af9a2d67c62 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:41:15.653733 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-b7924929-b157-4051-840f-9af9a2d67c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:41:15.661807 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1422/2846] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:41:15.665923 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccebb7-3c48-4710-85d2-d438cba97db8 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:15.675485 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccebb7-3c48-4710-85d2-d438cba97db8 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:15.680023 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10433e48-731c-43b4-ad85-b4efc2832604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:15.680602 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10433e48-731c-43b4-ad85-b4efc2832604 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:15.680877 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10433e48-731c-43b4-ad85-b4efc2832604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:15.681184 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10433e48-731c-43b4-ad85-b4efc2832604 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:15.681826 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10433e48-731c-43b4-ad85-b4efc2832604 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:41:15.682128 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10433e48-731c-43b4-ad85-b4efc2832604 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:15.683702 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10433e48-731c-43b4-ad85-b4efc2832604 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:15.695368 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1425/2847] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:41:15.699489 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7924929-b157-4051-840f-9af9a2d67c62 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:15.709137 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7924929-b157-4051-840f-9af9a2d67c62 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:15.713727 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175fb94-0709-48c3-b762-ff88d8421bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:15.714308 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175fb94-0709-48c3-b762-ff88d8421bf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:15.714584 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175fb94-0709-48c3-b762-ff88d8421bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:15.714854 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175fb94-0709-48c3-b762-ff88d8421bf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:15.715465 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175fb94-0709-48c3-b762-ff88d8421bf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:15.717392 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175fb94-0709-48c3-b762-ff88d8421bf6 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:15.743901 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1423/2848] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:41:15 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:41:15.748949 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10433e48-731c-43b4-ad85-b4efc2832604 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:15.759349 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10433e48-731c-43b4-ad85-b4efc2832604 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:15.771849 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:15.818781 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7092b-0bb2-43cf-beae-432009c00c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:15.819384 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7092b-0bb2-43cf-beae-432009c00c73 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:15.819668 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7092b-0bb2-43cf-beae-432009c00c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:15.819941 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7092b-0bb2-43cf-beae-432009c00c73 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:15.820575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7092b-0bb2-43cf-beae-432009c00c73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:15.822534 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7092b-0bb2-43cf-beae-432009c00c73 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:15.843356 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1426/2849] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:41:15 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:41:15.847569 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175fb94-0709-48c3-b762-ff88d8421bf6 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:15.858144 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175fb94-0709-48c3-b762-ff88d8421bf6 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:15.862815 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94592303-b8da-441c-8f2d-337f56e132e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:15.863411 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94592303-b8da-441c-8f2d-337f56e132e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:15.863692 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94592303-b8da-441c-8f2d-337f56e132e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:15.863966 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94592303-b8da-441c-8f2d-337f56e132e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:15.864640 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94592303-b8da-441c-8f2d-337f56e132e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:15.866275 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94592303-b8da-441c-8f2d-337f56e132e2 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:15.876543 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1424/2850] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:41:15.880475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7092b-0bb2-43cf-beae-432009c00c73 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:15.891012 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7092b-0bb2-43cf-beae-432009c00c73 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:15.895528 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335dc343-7fd2-4bea-8dae-d4f2cd327238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:15.896106 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dc343-7fd2-4bea-8dae-d4f2cd327238 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:15.896383 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dc343-7fd2-4bea-8dae-d4f2cd327238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:15.896651 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dc343-7fd2-4bea-8dae-d4f2cd327238 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:15.897315 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335dc343-7fd2-4bea-8dae-d4f2cd327238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:15.898895 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335dc343-7fd2-4bea-8dae-d4f2cd327238 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:15.909336 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1427/2851] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:41:15.913303 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94592303-b8da-441c-8f2d-337f56e132e2 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:15.923350 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94592303-b8da-441c-8f2d-337f56e132e2 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:15.927995 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4da2b-bbcb-4a33-ac6c-bad4e1ca6c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:15.928640 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4da2b-bbcb-4a33-ac6c-bad4e1ca6c56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:15.928925 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4da2b-bbcb-4a33-ac6c-bad4e1ca6c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:15.929236 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4da2b-bbcb-4a33-ac6c-bad4e1ca6c56 admin admin] PATH_INFO: `/v3/projects/c09024a17fce407899f052579325b889/users/cc04496c76e24400b33418f27120ac65/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:15.945172 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4da2b-bbcb-4a33-ac6c-bad4e1ca6c56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c09024a17fce407899f052579325b889, user_id=cc04496c76e24400b33418f27120ac65, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:15.947882 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4da2b-bbcb-4a33-ac6c-bad4e1ca6c56 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:15.961129 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1425/2852] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:41:15 2022] PUT /identity/v3/projects/c09024a17fce407899f052579325b889/users/cc04496c76e24400b33418f27120ac65/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:41:16.024536 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b78b6f-3b87-4e4a-bc58-2157fee1326a None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:16.024737 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b78b6f-3b87-4e4a-bc58-2157fee1326a None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:16.024974 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b78b6f-3b87-4e4a-bc58-2157fee1326a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:16.052492 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-e6b78b6f-3b87-4e4a-bc58-2157fee1326a None None] MFA Rules not processed for user `cc04496c76e24400b33418f27120ac65`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:41:16.053733 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e6b78b6f-3b87-4e4a-bc58-2157fee1326a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:41:16.117186 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1428/2853] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:41:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:41:16.128522 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4da2b-bbcb-4a33-ac6c-bad4e1ca6c56 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:16.130209 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-f4d4da2b-bbcb-4a33-ac6c-bad4e1ca6c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:41:16.185932 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4da2b-bbcb-4a33-ac6c-bad4e1ca6c56 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:16.189720 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336fb0f-16e7-4650-a062-2c5b4dd4dce1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63645a88f5924a57b5b828aacd856902', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:16.190344 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336fb0f-16e7-4650-a062-2c5b4dd4dce1 service glance] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:16.190633 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336fb0f-16e7-4650-a062-2c5b4dd4dce1 service glance] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:16.190945 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336fb0f-16e7-4650-a062-2c5b4dd4dce1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:16.199401 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336fb0f-16e7-4650-a062-2c5b4dd4dce1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:16.200822 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336fb0f-16e7-4650-a062-2c5b4dd4dce1 service glance] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:16.210054 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1426/2854] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:41:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:41:26.114254 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=58,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:26.206058 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:DELETE=6,keystone:SELECT=67,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:30.618775 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b78b6f-3b87-4e4a-bc58-2157fee1326a None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:30.680499 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b78b6f-3b87-4e4a-bc58-2157fee1326a None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:30.684978 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf1a40-1072-4171-ada3-54fc877ee01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:30.685630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf1a40-1072-4171-ada3-54fc877ee01e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:30.685905 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf1a40-1072-4171-ada3-54fc877ee01e admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:30.686175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf1a40-1072-4171-ada3-54fc877ee01e admin admin] PATH_INFO: `/v3/users/cc04496c76e24400b33418f27120ac65` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:30.687268 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf1a40-1072-4171-ada3-54fc877ee01e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc04496c76e24400b33418f27120ac65)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:30.689247 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf1a40-1072-4171-ada3-54fc877ee01e admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:30.733475 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-93bf1a40-1072-4171-ada3-54fc877ee01e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc04496c76e24400b33418f27120ac65'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:30.740952 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-93bf1a40-1072-4171-ada3-54fc877ee01e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc04496c76e24400b33418f27120ac65'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:30.741638 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-93bf1a40-1072-4171-ada3-54fc877ee01e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc04496c76e24400b33418f27120ac65'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:30.754222 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-93bf1a40-1072-4171-ada3-54fc877ee01e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc04496c76e24400b33418f27120ac65'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:30.760889 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-93bf1a40-1072-4171-ada3-54fc877ee01e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc04496c76e24400b33418f27120ac65'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:30.766842 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1429/2855] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:41:30 2022] DELETE /identity/v3/users/cc04496c76e24400b33418f27120ac65 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:41:30.771265 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e3cb0-ee1a-4a3e-884a-dab31998e63b None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:30.771749 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e3cb0-ee1a-4a3e-884a-dab31998e63b None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:30.771858 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e3cb0-ee1a-4a3e-884a-dab31998e63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:30.790742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-164e3cb0-ee1a-4a3e-884a-dab31998e63b None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:41:30.791940 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-164e3cb0-ee1a-4a3e-884a-dab31998e63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:41:30.849431 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1427/2856] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:41:30.858939 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf1a40-1072-4171-ada3-54fc877ee01e admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:30.860330 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-93bf1a40-1072-4171-ada3-54fc877ee01e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:41:30.916945 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf1a40-1072-4171-ada3-54fc877ee01e admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:30.920677 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782272f3-7d1f-4cb7-95c5-4fe6068cfc92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:30.921304 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782272f3-7d1f-4cb7-95c5-4fe6068cfc92 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:30.921582 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782272f3-7d1f-4cb7-95c5-4fe6068cfc92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:30.921849 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782272f3-7d1f-4cb7-95c5-4fe6068cfc92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:30.931115 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782272f3-7d1f-4cb7-95c5-4fe6068cfc92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:30.932623 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782272f3-7d1f-4cb7-95c5-4fe6068cfc92 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:30.941852 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1430/2857] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:41:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:41:31.201091 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e3cb0-ee1a-4a3e-884a-dab31998e63b None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:31.202562 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-164e3cb0-ee1a-4a3e-884a-dab31998e63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:41:31.216868 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e3cb0-ee1a-4a3e-884a-dab31998e63b None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:31.223061 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78518f8b-978b-4771-8ccd-f9f2640ef878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:31.224135 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78518f8b-978b-4771-8ccd-f9f2640ef878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:31.224456 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78518f8b-978b-4771-8ccd-f9f2640ef878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:31.224725 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78518f8b-978b-4771-8ccd-f9f2640ef878 admin admin] PATH_INFO: `/v3/projects/c09024a17fce407899f052579325b889` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:31.225885 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78518f8b-978b-4771-8ccd-f9f2640ef878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c09024a17fce407899f052579325b889)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:31.227759 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78518f8b-978b-4771-8ccd-f9f2640ef878 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:31.274867 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-78518f8b-978b-4771-8ccd-f9f2640ef878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c09024a17fce407899f052579325b889', 'request_id': 'req-78518f8b-978b-4771-8ccd-f9f2640ef878'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:31.280360 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-78518f8b-978b-4771-8ccd-f9f2640ef878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c09024a17fce407899f052579325b889', 'request_id': 'req-78518f8b-978b-4771-8ccd-f9f2640ef878'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:31.286646 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-78518f8b-978b-4771-8ccd-f9f2640ef878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c09024a17fce407899f052579325b889', 'request_id': 'req-78518f8b-978b-4771-8ccd-f9f2640ef878'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:31.298383 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-78518f8b-978b-4771-8ccd-f9f2640ef878 admin admin] The token cache is being invalidate because project c09024a17fce407899f052579325b889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:41:31.298706 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-78518f8b-978b-4771-8ccd-f9f2640ef878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:31.299326 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-78518f8b-978b-4771-8ccd-f9f2640ef878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:31.300827 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1428/2858] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:41:31 2022] DELETE /identity/v3/projects/c09024a17fce407899f052579325b889 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:41:31.306042 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9830c4-a1de-4c4f-bfa4-c690975742de None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:31.306332 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9830c4-a1de-4c4f-bfa4-c690975742de None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:31.306612 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9830c4-a1de-4c4f-bfa4-c690975742de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:31.326410 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ba9830c4-a1de-4c4f-bfa4-c690975742de None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:41:31.327619 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ba9830c4-a1de-4c4f-bfa4-c690975742de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:41:31.344827 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:31.387311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1431/2859] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 02:41:31.395140 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b9752-ab5d-4b0b-9839-9a96ce39d48f None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:31.395425 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b9752-ab5d-4b0b-9839-9a96ce39d48f None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:31.395699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b9752-ab5d-4b0b-9839-9a96ce39d48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:31.414822 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-d39b9752-ab5d-4b0b-9839-9a96ce39d48f None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:41:31.416012 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-d39b9752-ab5d-4b0b-9839-9a96ce39d48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:41:31.423763 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1429/2860] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:41:31.427716 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9830c4-a1de-4c4f-bfa4-c690975742de None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:31.437462 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9830c4-a1de-4c4f-bfa4-c690975742de None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:31.442569 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cf258-51c2-45a5-a5bc-d0cb2932e2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:31.443158 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cf258-51c2-45a5-a5bc-d0cb2932e2be admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:31.443437 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cf258-51c2-45a5-a5bc-d0cb2932e2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:31.443706 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cf258-51c2-45a5-a5bc-d0cb2932e2be admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:31.444340 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87cf258-51c2-45a5-a5bc-d0cb2932e2be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:41:31.444640 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87cf258-51c2-45a5-a5bc-d0cb2932e2be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:31.446293 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87cf258-51c2-45a5-a5bc-d0cb2932e2be admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:31.458171 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1432/2861] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:41:31.462242 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b9752-ab5d-4b0b-9839-9a96ce39d48f None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:31.471315 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b9752-ab5d-4b0b-9839-9a96ce39d48f None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:31.476202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df3758-c117-4241-a007-308320b752ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:31.476788 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df3758-c117-4241-a007-308320b752ac admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:31.477096 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df3758-c117-4241-a007-308320b752ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:31.477369 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df3758-c117-4241-a007-308320b752ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:31.478052 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df3758-c117-4241-a007-308320b752ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:31.479931 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df3758-c117-4241-a007-308320b752ac admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:31.507226 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1430/2862] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:41:31 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:41:31.511672 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cf258-51c2-45a5-a5bc-d0cb2932e2be admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:31.522755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cf258-51c2-45a5-a5bc-d0cb2932e2be admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:31.578939 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89809395-0542-4882-b156-504766e63275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:31.579539 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89809395-0542-4882-b156-504766e63275 admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:31.579829 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89809395-0542-4882-b156-504766e63275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:31.580713 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89809395-0542-4882-b156-504766e63275 admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:31.581369 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89809395-0542-4882-b156-504766e63275 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:31.583291 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89809395-0542-4882-b156-504766e63275 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:31.604103 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1433/2863] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:41:31 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 02:41:31.608227 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df3758-c117-4241-a007-308320b752ac admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:31.619573 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df3758-c117-4241-a007-308320b752ac admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:31.624225 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c31131-ed13-445e-804e-52301df97da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:31.624839 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c31131-ed13-445e-804e-52301df97da9 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:31.625135 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c31131-ed13-445e-804e-52301df97da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:31.625410 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c31131-ed13-445e-804e-52301df97da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:31.626090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c31131-ed13-445e-804e-52301df97da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:31.628273 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c31131-ed13-445e-804e-52301df97da9 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:31.638153 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1431/2864] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:41:31.641793 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89809395-0542-4882-b156-504766e63275 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:31.651575 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89809395-0542-4882-b156-504766e63275 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:31.656110 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e31c2-f55a-4537-8ef9-93edb6a0d988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:31.656698 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e31c2-f55a-4537-8ef9-93edb6a0d988 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:31.656978 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e31c2-f55a-4537-8ef9-93edb6a0d988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:31.657280 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e31c2-f55a-4537-8ef9-93edb6a0d988 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:31.657931 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e31c2-f55a-4537-8ef9-93edb6a0d988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:31.659522 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e31c2-f55a-4537-8ef9-93edb6a0d988 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:31.669903 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1434/2865] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:41:31.674361 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c31131-ed13-445e-804e-52301df97da9 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:31.684109 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c31131-ed13-445e-804e-52301df97da9 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:31.688656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def67dc-2378-4d20-8351-0f446a6dd19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:31.689934 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def67dc-2378-4d20-8351-0f446a6dd19a admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:31.690221 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def67dc-2378-4d20-8351-0f446a6dd19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:31.690498 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def67dc-2378-4d20-8351-0f446a6dd19a admin admin] PATH_INFO: `/v3/projects/2821925da2554d76be6a16f293d4d773/users/4e5819c0cbb54573b1cc5dab36c0b329/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:31.704794 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def67dc-2378-4d20-8351-0f446a6dd19a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2821925da2554d76be6a16f293d4d773, user_id=4e5819c0cbb54573b1cc5dab36c0b329, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:31.707463 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def67dc-2378-4d20-8351-0f446a6dd19a admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:31.721596 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1432/2866] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:41:31 2022] PUT /identity/v3/projects/2821925da2554d76be6a16f293d4d773/users/4e5819c0cbb54573b1cc5dab36c0b329/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:41:31.733104 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecaf0e1-5e6a-4f69-9e18-3f767aad7e92 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:31.733399 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecaf0e1-5e6a-4f69-9e18-3f767aad7e92 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:31.733671 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecaf0e1-5e6a-4f69-9e18-3f767aad7e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:31.762859 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-7ecaf0e1-5e6a-4f69-9e18-3f767aad7e92 None None] MFA Rules not processed for user `4e5819c0cbb54573b1cc5dab36c0b329`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:41:31.764063 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-7ecaf0e1-5e6a-4f69-9e18-3f767aad7e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:41:31.826736 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1435/2867] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:41:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:41:31.841993 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def67dc-2378-4d20-8351-0f446a6dd19a admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:31.843745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6def67dc-2378-4d20-8351-0f446a6dd19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:41:31.865817 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:31.902162 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def67dc-2378-4d20-8351-0f446a6dd19a admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:31.905871 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4fd70-35d2-4526-be38-b908d82b66a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:31.906468 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4fd70-35d2-4526-be38-b908d82b66a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:31.906745 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4fd70-35d2-4526-be38-b908d82b66a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:31.907012 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4fd70-35d2-4526-be38-b908d82b66a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:31.915030 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4fd70-35d2-4526-be38-b908d82b66a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:31.916447 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4fd70-35d2-4526-be38-b908d82b66a9 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:31.925554 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1433/2868] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:41:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:41:41.823776 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:41.921127 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=17 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:43.270237 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecaf0e1-5e6a-4f69-9e18-3f767aad7e92 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:43.331015 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecaf0e1-5e6a-4f69-9e18-3f767aad7e92 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:43.335470 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2bd94-9859-4493-860a-8c88cf11f089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:43.336103 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2bd94-9859-4493-860a-8c88cf11f089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:43.336365 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2bd94-9859-4493-860a-8c88cf11f089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:43.336638 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2bd94-9859-4493-860a-8c88cf11f089 admin admin] PATH_INFO: `/v3/users/4e5819c0cbb54573b1cc5dab36c0b329` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:43.337777 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2bd94-9859-4493-860a-8c88cf11f089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e5819c0cbb54573b1cc5dab36c0b329)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:43.339693 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2bd94-9859-4493-860a-8c88cf11f089 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:43.384209 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-53d2bd94-9859-4493-860a-8c88cf11f089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e5819c0cbb54573b1cc5dab36c0b329'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:43.391069 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-53d2bd94-9859-4493-860a-8c88cf11f089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e5819c0cbb54573b1cc5dab36c0b329'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:43.391692 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-53d2bd94-9859-4493-860a-8c88cf11f089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e5819c0cbb54573b1cc5dab36c0b329'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:43.403492 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-53d2bd94-9859-4493-860a-8c88cf11f089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e5819c0cbb54573b1cc5dab36c0b329'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:43.410802 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-53d2bd94-9859-4493-860a-8c88cf11f089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e5819c0cbb54573b1cc5dab36c0b329'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:43.416494 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1436/2869] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:41:43 2022] DELETE /identity/v3/users/4e5819c0cbb54573b1cc5dab36c0b329 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:41:43.421097 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34753f27-bb60-48f5-b3c4-f07d5f77dccf None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:43.421573 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34753f27-bb60-48f5-b3c4-f07d5f77dccf None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:43.421675 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34753f27-bb60-48f5-b3c4-f07d5f77dccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:43.440901 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-34753f27-bb60-48f5-b3c4-f07d5f77dccf None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:41:43.442144 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-34753f27-bb60-48f5-b3c4-f07d5f77dccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:41:43.499746 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1434/2870] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:41:43.510156 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2bd94-9859-4493-860a-8c88cf11f089 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:43.511803 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-53d2bd94-9859-4493-860a-8c88cf11f089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:41:43.570253 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2bd94-9859-4493-860a-8c88cf11f089 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:43.573868 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c8b46-db2b-4333-8e2f-4072eda47ede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:43.574461 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c8b46-db2b-4333-8e2f-4072eda47ede service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:43.574738 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c8b46-db2b-4333-8e2f-4072eda47ede service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:43.575005 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c8b46-db2b-4333-8e2f-4072eda47ede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:43.584239 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c8b46-db2b-4333-8e2f-4072eda47ede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:43.585695 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c8b46-db2b-4333-8e2f-4072eda47ede service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:43.594843 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1437/2871] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:41:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:41:43.862503 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34753f27-bb60-48f5-b3c4-f07d5f77dccf None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:43.863975 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-34753f27-bb60-48f5-b3c4-f07d5f77dccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:41:43.876168 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34753f27-bb60-48f5-b3c4-f07d5f77dccf None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:43.880767 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd64589-6533-4278-8a5f-9f49b9ed41c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:43.881438 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd64589-6533-4278-8a5f-9f49b9ed41c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:43.881764 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd64589-6533-4278-8a5f-9f49b9ed41c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:43.882013 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd64589-6533-4278-8a5f-9f49b9ed41c3 admin admin] PATH_INFO: `/v3/projects/2821925da2554d76be6a16f293d4d773` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:43.883168 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd64589-6533-4278-8a5f-9f49b9ed41c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2821925da2554d76be6a16f293d4d773)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:43.885090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd64589-6533-4278-8a5f-9f49b9ed41c3 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:43.931404 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dcd64589-6533-4278-8a5f-9f49b9ed41c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2821925da2554d76be6a16f293d4d773', 'request_id': 'req-dcd64589-6533-4278-8a5f-9f49b9ed41c3'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:43.936952 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dcd64589-6533-4278-8a5f-9f49b9ed41c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2821925da2554d76be6a16f293d4d773', 'request_id': 'req-dcd64589-6533-4278-8a5f-9f49b9ed41c3'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:43.943249 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dcd64589-6533-4278-8a5f-9f49b9ed41c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2821925da2554d76be6a16f293d4d773', 'request_id': 'req-dcd64589-6533-4278-8a5f-9f49b9ed41c3'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:43.954774 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dcd64589-6533-4278-8a5f-9f49b9ed41c3 admin admin] The token cache is being invalidate because project 2821925da2554d76be6a16f293d4d773 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:41:43.955071 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dcd64589-6533-4278-8a5f-9f49b9ed41c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:43.956186 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-dcd64589-6533-4278-8a5f-9f49b9ed41c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:41:43.957695 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1435/2872] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:41:43 2022] DELETE /identity/v3/projects/2821925da2554d76be6a16f293d4d773 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:41:43.962446 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9cc36-70b8-4352-8ba3-068531efee50 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:43.962807 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9cc36-70b8-4352-8ba3-068531efee50 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:43.963107 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9cc36-70b8-4352-8ba3-068531efee50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:43.983401 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-96b9cc36-70b8-4352-8ba3-068531efee50 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:41:43.984613 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-96b9cc36-70b8-4352-8ba3-068531efee50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:41:44.001295 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:44.045055 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1438/2873] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:41:44.052742 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e66c6e-a1c2-4f22-8464-8af132f52c5c None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:44.053152 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e66c6e-a1c2-4f22-8464-8af132f52c5c None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:44.053496 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e66c6e-a1c2-4f22-8464-8af132f52c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:44.074691 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-c9e66c6e-a1c2-4f22-8464-8af132f52c5c None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:41:44.075896 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-c9e66c6e-a1c2-4f22-8464-8af132f52c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:41:44.084396 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1436/2874] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:41:44.088502 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9cc36-70b8-4352-8ba3-068531efee50 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:44.098120 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9cc36-70b8-4352-8ba3-068531efee50 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:44.102912 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476147a5-1861-44a9-adf3-f4d9b5fefbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:44.103495 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476147a5-1861-44a9-adf3-f4d9b5fefbcb admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:44.103781 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476147a5-1861-44a9-adf3-f4d9b5fefbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:44.104064 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476147a5-1861-44a9-adf3-f4d9b5fefbcb admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:44.104699 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476147a5-1861-44a9-adf3-f4d9b5fefbcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:41:44.105004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476147a5-1861-44a9-adf3-f4d9b5fefbcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:44.106635 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476147a5-1861-44a9-adf3-f4d9b5fefbcb admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:44.118040 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1439/2875] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:41:44.122077 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e66c6e-a1c2-4f22-8464-8af132f52c5c None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:44.131810 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e66c6e-a1c2-4f22-8464-8af132f52c5c None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:44.136524 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82f509-167d-4f0c-bd98-617bcc372475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:44.137166 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82f509-167d-4f0c-bd98-617bcc372475 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:44.137448 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82f509-167d-4f0c-bd98-617bcc372475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:44.137715 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82f509-167d-4f0c-bd98-617bcc372475 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:44.138368 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82f509-167d-4f0c-bd98-617bcc372475 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:44.140244 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82f509-167d-4f0c-bd98-617bcc372475 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:44.166962 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1437/2876] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:41:44 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:41:44.171111 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476147a5-1861-44a9-adf3-f4d9b5fefbcb admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:44.180916 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476147a5-1861-44a9-adf3-f4d9b5fefbcb admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:44.235623 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8c594-d99e-4cc2-86b3-5e2876f5b2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:44.236214 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8c594-d99e-4cc2-86b3-5e2876f5b2fa admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:44.236561 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8c594-d99e-4cc2-86b3-5e2876f5b2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:44.236801 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8c594-d99e-4cc2-86b3-5e2876f5b2fa admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:44.237469 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8c594-d99e-4cc2-86b3-5e2876f5b2fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:44.239379 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8c594-d99e-4cc2-86b3-5e2876f5b2fa admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:44.259978 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1440/2877] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:41:44 2022] POST /identity/v3/users => generated 283 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:41:44.263982 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82f509-167d-4f0c-bd98-617bcc372475 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:44.274728 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82f509-167d-4f0c-bd98-617bcc372475 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:44.279318 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815c653-237a-4f07-8fec-41cd80f79992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:44.279910 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815c653-237a-4f07-8fec-41cd80f79992 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:44.280190 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815c653-237a-4f07-8fec-41cd80f79992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:44.280458 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815c653-237a-4f07-8fec-41cd80f79992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:44.281135 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b815c653-237a-4f07-8fec-41cd80f79992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:44.282713 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b815c653-237a-4f07-8fec-41cd80f79992 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:44.292863 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1438/2878] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:41:44.296578 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8c594-d99e-4cc2-86b3-5e2876f5b2fa admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:44.306323 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8c594-d99e-4cc2-86b3-5e2876f5b2fa admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:44.310826 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49596941-461c-405e-bda4-7a269e1baa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:44.311408 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49596941-461c-405e-bda4-7a269e1baa0b admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:44.311688 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49596941-461c-405e-bda4-7a269e1baa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:44.311960 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49596941-461c-405e-bda4-7a269e1baa0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:44.312591 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49596941-461c-405e-bda4-7a269e1baa0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:44.314196 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49596941-461c-405e-bda4-7a269e1baa0b admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:44.324995 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1441/2879] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:41:44.328896 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815c653-237a-4f07-8fec-41cd80f79992 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:44.339206 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815c653-237a-4f07-8fec-41cd80f79992 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:44.343784 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b677ed7-ca40-4b34-96a2-4499195cacdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:44.344407 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b677ed7-ca40-4b34-96a2-4499195cacdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:44.344687 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b677ed7-ca40-4b34-96a2-4499195cacdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:44.344960 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b677ed7-ca40-4b34-96a2-4499195cacdd admin admin] PATH_INFO: `/v3/projects/b7891ebd0f8141bb99a18e8e60e99903/users/ed44be56dfff4ecdb4cc2154693eb0d1/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:44.359326 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b677ed7-ca40-4b34-96a2-4499195cacdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7891ebd0f8141bb99a18e8e60e99903, user_id=ed44be56dfff4ecdb4cc2154693eb0d1, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:44.362537 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b677ed7-ca40-4b34-96a2-4499195cacdd admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:44.374632 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1439/2880] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:41:44 2022] PUT /identity/v3/projects/b7891ebd0f8141bb99a18e8e60e99903/users/ed44be56dfff4ecdb4cc2154693eb0d1/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 02:41:44.385421 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1d20a-b55f-41c0-80f8-2b6921e6fde5 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:44.385708 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1d20a-b55f-41c0-80f8-2b6921e6fde5 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:44.386004 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1d20a-b55f-41c0-80f8-2b6921e6fde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:44.413598 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-6ed1d20a-b55f-41c0-80f8-2b6921e6fde5 None None] MFA Rules not processed for user `ed44be56dfff4ecdb4cc2154693eb0d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:41:44.414799 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-6ed1d20a-b55f-41c0-80f8-2b6921e6fde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:41:44.493611 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1442/2881] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:41:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:41:44.505351 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b677ed7-ca40-4b34-96a2-4499195cacdd admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:41:44.507034 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-6b677ed7-ca40-4b34-96a2-4499195cacdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:41:44.528192 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:44.563708 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b677ed7-ca40-4b34-96a2-4499195cacdd admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:41:44.568017 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffa069-5607-4cb0-a672-461ad877e0a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:41:44.568618 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffa069-5607-4cb0-a672-461ad877e0a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:41:44.568900 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffa069-5607-4cb0-a672-461ad877e0a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:41:44.569202 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffa069-5607-4cb0-a672-461ad877e0a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:41:44.577298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffa069-5607-4cb0-a672-461ad877e0a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:41:44.578710 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffa069-5607-4cb0-a672-461ad877e0a3 service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:41:44.587380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1440/2882] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:41:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:41:54.490252 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:41:54.583539 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=17 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:42:14.249779 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1d20a-b55f-41c0-80f8-2b6921e6fde5 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:42:14.311112 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1d20a-b55f-41c0-80f8-2b6921e6fde5 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:42:14.316207 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a491f53-871d-4618-81da-6cfac3c003fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:42:14.316822 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a491f53-871d-4618-81da-6cfac3c003fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:42:14.317133 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a491f53-871d-4618-81da-6cfac3c003fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:42:14.317407 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a491f53-871d-4618-81da-6cfac3c003fb admin admin] PATH_INFO: `/v3/users/ed44be56dfff4ecdb4cc2154693eb0d1` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:42:14.318508 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a491f53-871d-4618-81da-6cfac3c003fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed44be56dfff4ecdb4cc2154693eb0d1)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:42:14.320417 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a491f53-871d-4618-81da-6cfac3c003fb admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:42:14.365137 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4a491f53-871d-4618-81da-6cfac3c003fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed44be56dfff4ecdb4cc2154693eb0d1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:42:14.372263 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4a491f53-871d-4618-81da-6cfac3c003fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed44be56dfff4ecdb4cc2154693eb0d1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:42:14.372904 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4a491f53-871d-4618-81da-6cfac3c003fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed44be56dfff4ecdb4cc2154693eb0d1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:42:14.385570 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4a491f53-871d-4618-81da-6cfac3c003fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed44be56dfff4ecdb4cc2154693eb0d1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:42:14.392345 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-4a491f53-871d-4618-81da-6cfac3c003fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed44be56dfff4ecdb4cc2154693eb0d1'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:42:14.398175 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1443/2883] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:42:14 2022] DELETE /identity/v3/users/ed44be56dfff4ecdb4cc2154693eb0d1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:42:14.402730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8b888-8173-4036-ac11-e4a74deef773 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:42:14.403214 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8b888-8173-4036-ac11-e4a74deef773 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:42:14.403321 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8b888-8173-4036-ac11-e4a74deef773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:42:14.421622 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-11c8b888-8173-4036-ac11-e4a74deef773 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:42:14.422848 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-11c8b888-8173-4036-ac11-e4a74deef773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:42:14.481297 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1441/2884] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:42:14.491467 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a491f53-871d-4618-81da-6cfac3c003fb admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:42:14.492887 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-4a491f53-871d-4618-81da-6cfac3c003fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:42:14.548197 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a491f53-871d-4618-81da-6cfac3c003fb admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:42:14.552363 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9af8d7-9fb6-421a-85d5-8b110a7eb185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:42:14.552958 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9af8d7-9fb6-421a-85d5-8b110a7eb185 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:42:14.553269 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9af8d7-9fb6-421a-85d5-8b110a7eb185 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:42:14.553543 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9af8d7-9fb6-421a-85d5-8b110a7eb185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:42:14.562467 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9af8d7-9fb6-421a-85d5-8b110a7eb185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:42:14.563892 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9af8d7-9fb6-421a-85d5-8b110a7eb185 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:42:14.573813 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1444/2885] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:42:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:42:14.832236 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8b888-8173-4036-ac11-e4a74deef773 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:42:14.833699 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-11c8b888-8173-4036-ac11-e4a74deef773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:42:14.847973 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8b888-8173-4036-ac11-e4a74deef773 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:42:14.852877 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08198f84-fd16-4a9b-9f3e-cb4342320959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:42:14.854325 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08198f84-fd16-4a9b-9f3e-cb4342320959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:42:14.854614 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08198f84-fd16-4a9b-9f3e-cb4342320959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:42:14.854889 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08198f84-fd16-4a9b-9f3e-cb4342320959 admin admin] PATH_INFO: `/v3/projects/b7891ebd0f8141bb99a18e8e60e99903` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:42:14.856075 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08198f84-fd16-4a9b-9f3e-cb4342320959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7891ebd0f8141bb99a18e8e60e99903)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:42:14.857934 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08198f84-fd16-4a9b-9f3e-cb4342320959 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:42:14.905386 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-08198f84-fd16-4a9b-9f3e-cb4342320959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7891ebd0f8141bb99a18e8e60e99903', 'request_id': 'req-08198f84-fd16-4a9b-9f3e-cb4342320959'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:42:14.911340 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-08198f84-fd16-4a9b-9f3e-cb4342320959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7891ebd0f8141bb99a18e8e60e99903', 'request_id': 'req-08198f84-fd16-4a9b-9f3e-cb4342320959'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:42:14.917346 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-08198f84-fd16-4a9b-9f3e-cb4342320959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7891ebd0f8141bb99a18e8e60e99903', 'request_id': 'req-08198f84-fd16-4a9b-9f3e-cb4342320959'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:42:14.930057 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-08198f84-fd16-4a9b-9f3e-cb4342320959 admin admin] The token cache is being invalidate because project b7891ebd0f8141bb99a18e8e60e99903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:42:14.930343 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-08198f84-fd16-4a9b-9f3e-cb4342320959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:42:14.930952 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-08198f84-fd16-4a9b-9f3e-cb4342320959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:42:14.932413 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1442/2886] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:42:14 2022] DELETE /identity/v3/projects/b7891ebd0f8141bb99a18e8e60e99903 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:42:14.937272 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6d262-9be5-4ad4-b410-8552c416dbf8 None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:42:14.937587 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6d262-9be5-4ad4-b410-8552c416dbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:42:14.937868 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6d262-9be5-4ad4-b410-8552c416dbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:42:14.957002 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-a5f6d262-9be5-4ad4-b410-8552c416dbf8 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:42:14.958255 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-a5f6d262-9be5-4ad4-b410-8552c416dbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:42:14.976630 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:42:15.023250 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1445/2887] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:42:15.030895 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f36ef-29ef-4e81-a714-636bf0028299 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:42:15.031182 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f36ef-29ef-4e81-a714-636bf0028299 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:42:15.031456 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f36ef-29ef-4e81-a714-636bf0028299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:42:15.052181 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-ed3f36ef-29ef-4e81-a714-636bf0028299 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:42:15.053433 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-ed3f36ef-29ef-4e81-a714-636bf0028299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:42:15.061557 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1443/2888] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:42:15.065660 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6d262-9be5-4ad4-b410-8552c416dbf8 None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:42:15.075177 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6d262-9be5-4ad4-b410-8552c416dbf8 None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:42:15.079755 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbfeb9-adb1-4358-b76c-fa68e139ee83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:42:15.080845 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbfeb9-adb1-4358-b76c-fa68e139ee83 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:42:15.081155 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbfeb9-adb1-4358-b76c-fa68e139ee83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:42:15.081426 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbfeb9-adb1-4358-b76c-fa68e139ee83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:42:15.082067 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbfeb9-adb1-4358-b76c-fa68e139ee83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80285) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 02:42:15.082368 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbfeb9-adb1-4358-b76c-fa68e139ee83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:42:15.083951 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbfeb9-adb1-4358-b76c-fa68e139ee83 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:42:15.095186 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1446/2889] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 9 02:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 02:42:15.100132 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f36ef-29ef-4e81-a714-636bf0028299 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:42:15.111633 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f36ef-29ef-4e81-a714-636bf0028299 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:42:15.116412 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b332d51-0e35-4a8a-b879-3c0bdf825033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:42:15.117042 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b332d51-0e35-4a8a-b879-3c0bdf825033 admin admin] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:42:15.117330 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b332d51-0e35-4a8a-b879-3c0bdf825033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:42:15.117605 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b332d51-0e35-4a8a-b879-3c0bdf825033 admin admin] PATH_INFO: `/v3/projects` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:42:15.118243 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b332d51-0e35-4a8a-b879-3c0bdf825033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:42:15.120181 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b332d51-0e35-4a8a-b879-3c0bdf825033 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:42:15.147626 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1444/2890] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 9 02:42:15 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:42:15.151763 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbfeb9-adb1-4358-b76c-fa68e139ee83 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:42:15.162311 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbfeb9-adb1-4358-b76c-fa68e139ee83 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:42:15.220549 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aaa90f-82a0-4d5f-af4e-0fd4e954bf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:42:15.221721 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaa90f-82a0-4d5f-af4e-0fd4e954bf0d admin admin] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:42:15.222000 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaa90f-82a0-4d5f-af4e-0fd4e954bf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:42:15.222268 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaa90f-82a0-4d5f-af4e-0fd4e954bf0d admin admin] PATH_INFO: `/v3/users` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:42:15.222882 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aaa90f-82a0-4d5f-af4e-0fd4e954bf0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:42:15.225245 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aaa90f-82a0-4d5f-af4e-0fd4e954bf0d admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:42:15.248886 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1447/2891] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 9 02:42:15 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 02:42:15.252897 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b332d51-0e35-4a8a-b879-3c0bdf825033 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:42:15.263066 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b332d51-0e35-4a8a-b879-3c0bdf825033 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:42:15.268367 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154270f-49b9-4bc3-8e2f-023d201cea19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:42:15.268958 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154270f-49b9-4bc3-8e2f-023d201cea19 admin admin] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:42:15.269263 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154270f-49b9-4bc3-8e2f-023d201cea19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:42:15.269552 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154270f-49b9-4bc3-8e2f-023d201cea19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:42:15.270172 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154270f-49b9-4bc3-8e2f-023d201cea19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:42:15.271750 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154270f-49b9-4bc3-8e2f-023d201cea19 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:42:15.281681 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1445/2892] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:42:15.286127 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aaa90f-82a0-4d5f-af4e-0fd4e954bf0d admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:42:15.295781 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aaa90f-82a0-4d5f-af4e-0fd4e954bf0d admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:42:15.300820 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a742ea-d3c7-4ded-9c3c-66b5ae9b5b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:42:15.301440 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a742ea-d3c7-4ded-9c3c-66b5ae9b5b36 admin admin] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:42:15.301718 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a742ea-d3c7-4ded-9c3c-66b5ae9b5b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:42:15.301988 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a742ea-d3c7-4ded-9c3c-66b5ae9b5b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:42:15.302652 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a742ea-d3c7-4ded-9c3c-66b5ae9b5b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:42:15.304223 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a742ea-d3c7-4ded-9c3c-66b5ae9b5b36 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:42:15.315145 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1448/2893] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 9 02:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 02:42:15.318940 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154270f-49b9-4bc3-8e2f-023d201cea19 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:42:15.328730 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154270f-49b9-4bc3-8e2f-023d201cea19 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:42:15.333298 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd64bb-7ae9-4e43-bc9e-a26ba9fa53c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:42:15.334090 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd64bb-7ae9-4e43-bc9e-a26ba9fa53c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:42:15.334375 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd64bb-7ae9-4e43-bc9e-a26ba9fa53c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:42:15.334656 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd64bb-7ae9-4e43-bc9e-a26ba9fa53c7 admin admin] PATH_INFO: `/v3/projects/d5be53fd5285425ba69802347f3f8e85/users/332a1d70743a4f2183b6839c6293b8a4/roles/a463f0ebb5cf4516b0bec345d25071cb` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:42:15.349312 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd64bb-7ae9-4e43-bc9e-a26ba9fa53c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5be53fd5285425ba69802347f3f8e85, user_id=332a1d70743a4f2183b6839c6293b8a4, role_id=a463f0ebb5cf4516b0bec345d25071cb)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:42:15.352102 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd64bb-7ae9-4e43-bc9e-a26ba9fa53c7 admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:42:15.366117 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1446/2894] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 9 02:42:15 2022] PUT /identity/v3/projects/d5be53fd5285425ba69802347f3f8e85/users/332a1d70743a4f2183b6839c6293b8a4/roles/a463f0ebb5cf4516b0bec345d25071cb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:42:15.376235 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37a9d9-bc1d-4ec4-85df-f68d768f7c9b None None] REQUEST_METHOD: `POST` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:42:15.376542 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37a9d9-bc1d-4ec4-85df-f68d768f7c9b None None] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:42:15.376815 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37a9d9-bc1d-4ec4-85df-f68d768f7c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:42:15.403890 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.auth.core [None req-ef37a9d9-bc1d-4ec4-85df-f68d768f7c9b None None] MFA Rules not processed for user `332a1d70743a4f2183b6839c6293b8a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80285) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:42:15.405131 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-ef37a9d9-bc1d-4ec4-85df-f68d768f7c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:42:15.466562 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1449/2895] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:42:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:42:15.477723 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd64bb-7ae9-4e43-bc9e-a26ba9fa53c7 admin admin] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:42:15.479385 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-a9fd64bb-7ae9-4e43-bc9e-a26ba9fa53c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:42:15.501899 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:42:15.539056 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd64bb-7ae9-4e43-bc9e-a26ba9fa53c7 admin admin] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:42:15.542719 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2bd62a-3c27-4106-acdf-454fed5c696a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9500a1b1de2344f78580bed52cc302a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:42:15.543321 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bd62a-3c27-4106-acdf-454fed5c696a service cinder] REQUEST_METHOD: `GET` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:42:15.543786 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bd62a-3c27-4106-acdf-454fed5c696a service cinder] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:42:15.544072 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bd62a-3c27-4106-acdf-454fed5c696a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:42:15.553125 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2bd62a-3c27-4106-acdf-454fed5c696a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:42:15.554689 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2bd62a-3c27-4106-acdf-454fed5c696a service cinder] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:42:15.563628 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1447/2896] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:42:15 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:42:25.463783 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:42:25.559398 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=17 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:42:25.574298 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37a9d9-bc1d-4ec4-85df-f68d768f7c9b None None] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:42:25.635145 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37a9d9-bc1d-4ec4-85df-f68d768f7c9b None None] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:42:25.639523 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f00e5f-203e-495b-a151-6780449d1589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:42:25.640138 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f00e5f-203e-495b-a151-6780449d1589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:42:25.640413 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f00e5f-203e-495b-a151-6780449d1589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:42:25.640683 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f00e5f-203e-495b-a151-6780449d1589 admin admin] PATH_INFO: `/v3/users/332a1d70743a4f2183b6839c6293b8a4` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:42:25.641812 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f00e5f-203e-495b-a151-6780449d1589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=332a1d70743a4f2183b6839c6293b8a4)` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:42:25.643726 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f00e5f-203e-495b-a151-6780449d1589 admin admin] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:42:25.690280 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-61f00e5f-203e-495b-a151-6780449d1589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '332a1d70743a4f2183b6839c6293b8a4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:42:25.697444 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-61f00e5f-203e-495b-a151-6780449d1589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '332a1d70743a4f2183b6839c6293b8a4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:42:25.698216 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-61f00e5f-203e-495b-a151-6780449d1589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '332a1d70743a4f2183b6839c6293b8a4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:42:25.710100 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-61f00e5f-203e-495b-a151-6780449d1589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '332a1d70743a4f2183b6839c6293b8a4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:42:25.716979 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.notifications [None req-61f00e5f-203e-495b-a151-6780449d1589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '332a1d70743a4f2183b6839c6293b8a4'} {{(pid=80285) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:42:25.722981 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1450/2897] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 9 02:42:25 2022] DELETE /identity/v3/users/332a1d70743a4f2183b6839c6293b8a4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:42:25.727454 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b92c27-a638-47f6-a9ca-f014c223ad45 None None] REQUEST_METHOD: `POST` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:42:25.727740 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b92c27-a638-47f6-a9ca-f014c223ad45 None None] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:42:25.728015 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b92c27-a638-47f6-a9ca-f014c223ad45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:42:25.746854 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.auth.core [None req-85b92c27-a638-47f6-a9ca-f014c223ad45 None None] MFA Rules not processed for user `49d550c3e3b54e2aaebfc450900dd727`. Rule list: `[]` (Enabled: `True`). {{(pid=80286) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 02:42:25.748036 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-85b92c27-a638-47f6-a9ca-f014c223ad45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:42:25.806443 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1448/2898] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 9 02:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 02:42:25.816513 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f00e5f-203e-495b-a151-6780449d1589 admin admin] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:42:25.817943 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-61f00e5f-203e-495b-a151-6780449d1589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:42:25.879049 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f00e5f-203e-495b-a151-6780449d1589 admin admin] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:42:25.883148 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896dab7-00c2-4f5b-8eea-94864ebd1c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd608fede6f5e4b339f8de0354cc0562b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:42:25.883768 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896dab7-00c2-4f5b-8eea-94864ebd1c93 service neutron] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:42:25.884050 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896dab7-00c2-4f5b-8eea-94864ebd1c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:42:25.884348 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896dab7-00c2-4f5b-8eea-94864ebd1c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:42:25.893855 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896dab7-00c2-4f5b-8eea-94864ebd1c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:42:25.895296 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896dab7-00c2-4f5b-8eea-94864ebd1c93 service neutron] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:42:25.904749 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1451/2899] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:42:26.170775 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b92c27-a638-47f6-a9ca-f014c223ad45 None None] Authenticating user token {{(pid=80286) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:42:26.172285 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.fernet_utils [None req-85b92c27-a638-47f6-a9ca-f014c223ad45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80286) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:42:26.186593 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b92c27-a638-47f6-a9ca-f014c223ad45 None None] Validating token access rules against request {{(pid=80286) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:42:26.191217 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98446b3-99dd-4fdb-a51a-44ac22abd9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49d550c3e3b54e2aaebfc450900dd727', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5637b6dc3c504974958d887ed2c87b3c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80286) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:42:26.192380 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98446b3-99dd-4fdb-a51a-44ac22abd9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:42:26.192667 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98446b3-99dd-4fdb-a51a-44ac22abd9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:42:26.193143 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98446b3-99dd-4fdb-a51a-44ac22abd9ce admin admin] PATH_INFO: `/v3/projects/d5be53fd5285425ba69802347f3f8e85` {{(pid=80286) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:42:26.194289 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98446b3-99dd-4fdb-a51a-44ac22abd9ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5be53fd5285425ba69802347f3f8e85)` {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:42:26.196251 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98446b3-99dd-4fdb-a51a-44ac22abd9ce admin admin] RBAC: Authorization granted {{(pid=80286) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:42:26.248012 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f98446b3-99dd-4fdb-a51a-44ac22abd9ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5be53fd5285425ba69802347f3f8e85', 'request_id': 'req-f98446b3-99dd-4fdb-a51a-44ac22abd9ce'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:42:26.253875 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f98446b3-99dd-4fdb-a51a-44ac22abd9ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5be53fd5285425ba69802347f3f8e85', 'request_id': 'req-f98446b3-99dd-4fdb-a51a-44ac22abd9ce'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:42:26.260247 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f98446b3-99dd-4fdb-a51a-44ac22abd9ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5be53fd5285425ba69802347f3f8e85', 'request_id': 'req-f98446b3-99dd-4fdb-a51a-44ac22abd9ce'} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:42:26.273304 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f98446b3-99dd-4fdb-a51a-44ac22abd9ce admin admin] The token cache is being invalidate because project d5be53fd5285425ba69802347f3f8e85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80286) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 02:42:26.273596 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f98446b3-99dd-4fdb-a51a-44ac22abd9ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:42:26.274413 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG keystone.notifications [None req-f98446b3-99dd-4fdb-a51a-44ac22abd9ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80286) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 02:42:26.275928 dv-cinder-852461-1-smb devstack@keystone.service[80286]: [pid: 80286|app: 0|req: 1449/2900] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 9 02:42:26 2022] DELETE /identity/v3/projects/d5be53fd5285425ba69802347f3f8e85 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 02:42:35.900437 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:42:36.270216 dv-cinder-852461-1-smb devstack@keystone.service[80286]: DEBUG dbcounter [-] [80286] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 02:43:34.523300 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896dab7-00c2-4f5b-8eea-94864ebd1c93 service neutron] Authenticating user token {{(pid=80285) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 02:43:34.524721 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-f896dab7-00c2-4f5b-8eea-94864ebd1c93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:43:34.593121 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896dab7-00c2-4f5b-8eea-94864ebd1c93 service neutron] Validating token access rules against request {{(pid=80285) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 02:43:34.650219 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b15ac-20bf-45eb-b05f-ca67650e4bca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fe21d9a65a34abeae7329df924d7998', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '105476dcda7f48c28224d33c05860d6f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80285) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 02:43:34.650813 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b15ac-20bf-45eb-b05f-ca67650e4bca service placement] REQUEST_METHOD: `GET` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 02:43:34.651091 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b15ac-20bf-45eb-b05f-ca67650e4bca service placement] SCRIPT_NAME: `/identity` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 02:43:34.651359 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b15ac-20bf-45eb-b05f-ca67650e4bca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80285) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 02:43:34.653087 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.fernet_utils [None req-e02b15ac-20bf-45eb-b05f-ca67650e4bca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80285) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 02:43:34.664459 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b15ac-20bf-45eb-b05f-ca67650e4bca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 02:43:34.666056 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b15ac-20bf-45eb-b05f-ca67650e4bca service placement] RBAC: Authorization granted {{(pid=80285) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 02:43:34.675657 dv-cinder-852461-1-smb devstack@keystone.service[80285]: [pid: 80285|app: 0|req: 1452/2901] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 9 02:43:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 02:43:44.671471 dv-cinder-852461-1-smb devstack@keystone.service[80285]: DEBUG dbcounter [-] [80285] Writing DB stats keystone:SELECT=58 {{(pid=80285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}